{"id":1643,"date":"2020-12-08T14:00:24","date_gmt":"2020-12-08T14:00:24","guid":{"rendered":"https:\/\/thenextweb.com\/?p=1330789"},"modified":"2020-12-08T14:00:24","modified_gmt":"2020-12-08T14:00:24","slug":"a-simple-guide-to-redis-and-caching-with-nodejs","status":"publish","type":"post","link":"https:\/\/www.londonchiropracter.com\/?p=1643","title":{"rendered":"A simple guide to Redis and caching with NodeJS"},"content":{"rendered":"\n

In recent years, Redis has become a common occurrence in a Node.js application stack. Though its most popular use case is caching, Redis has many other use cases where you can take advantage of its blazing-fast in-memory database.<\/p>\n

In this tutorial, we are going to give you a quick introduction to Redis. We\u2019ll also use Redis to create a simple cache for a Node application to see how it impacts its performance.<\/p>\n

What is Redis?<\/h2>\n

Redis is an open-source (BSD licensed), in-memory data structure store used as a database, cache, and message broker.<\/p>\n

You can think of it as a No-SQL database, which stores data as a key-value pair in the system memory. Redis supports disk-persistent data storage, too, if needed.<\/p>\n

Redis has support for storing <\/span>multiple data structures and data types<\/a>, including strings, lists, hashes, sets, and sorted sets. Supported data structures give Redis the versatility for many use cases.<\/p>\n

Redis is best in situations that require data to be retrieved and delivered to the client in the least amount of time.<\/p>\n

Redis use cases<\/h2>\n

One of the most popular use cases of Redis is caching.<\/p>\n

What is caching?<\/strong><\/p>\n

Caching is the process of storing copies of data in caches to allow applications to access and retrieve data faster. The goal of caching is speeding up data access operations better than a database, or remote server could allow. It is especially the case for expensive (in time) operations.<\/p>\n

As a back-end developer, our task is to complete the clients\u2019 requests as fast as possible. Sometimes, queries require several operations like retrieving data from a database, performing calculations, retrieving additional data from other services, etc., that drag our performance down.<\/p>\n

It is here where caching excels as we can process the data once, store it on a cache and then retrieve it later directly from the cache without doing all those expensive operations. We would then periodically update the cache so that users can see updated information.<\/p>\n

[Read: Why AI is the future of home security<\/span><\/a>]<\/em><\/p>\n

Caching & Redis<\/strong><\/p>\n

Since Redis is an in-memory database, its data access operations are faster than any other disk-bound database could deliver. It makes Redis the perfect choice for caching. Its key-value data storage is another plus because it makes data storage and retrieval much simpler.<\/p>\n

In this tutorial, we are going to see how to do caching with Redis and Node.js.<\/p>\n

Redis for real-time analytics<\/strong><\/p>\n

Redis promises sub-millisecond long data processing operations. It makes Redis a perfect candidate for applications that rely on real-time data analysis.<\/p>\n

For example, you can use Redis to store user identities and their transaction details when implementing a real-time fraud detection service. Redis even provides an AI-supported faster transaction scoring system and faster statistical models to perform this use case better.<\/p>\n

Other use cases in real-time analytics include real-time inventory management systems and gaming leaderboards.<\/p>\n

Redis for session management<\/strong><\/p>\n

If your application uses sessions to track authenticated users and manage user-specific data, Redis is a perfect fit to use as session storage. Using Redis could significantly improve the system\u2019s performance while making it easier to process users\u2019 data, including credentials, recent activities, and even a shopping cart like system.<\/p>\n

Redis as a Queue<\/strong><\/p>\n

You can use Redis to queue application tasks that take a long time to complete. You can implement FIDO (first-in, first-out) queues or create delayed queues to delay task implementation until a pre-scheduled time.<\/p>\n

Caching with Node and Redis<\/h2>\n

Now, let\u2019s start with the primary focus of this tutorial: using Redis for caching in a NodeJS application.<\/p>\n

The process of caching with Redis is quite simple. When we receive a user request to a route that has caching enabled, we first check if the requested data is already stored in the cache. If yes, we can quickly retrieve data from Redis and send the response.<\/p>\n

However, if the data is not stored in the cache, which we call a cache miss, we have to first retrieve the data from the database or the external API and send it to the client. We also make sure to store the retrieved data in the cache so that the next time the same request is received, we can simply send the cached data to the user faster.<\/p>\n

Now that you have a clear idea of what we are going to do let\u2019s start the implementation.<\/p>\n

Install Redis<\/h2>\n

If you haven\u2019t already, you need to install Redis for this tutorial.<\/p>\n

You can download the binaries and compile them easily using the following commands.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

To make sure that the Redis server runs without an issue, send a ping to the server using the <\/span>redis-cli<\/code>.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

If you receive <\/span>pong<\/code> as a response, the Redis server is running successfully.<\/p>\n

Read the <\/span>official quick start guide<\/a> <\/span>to get a better idea if something goes wrong.<\/p>\n

Build the NodeJS application<\/h2>\n

Basic set-up<\/strong><\/p>\n

Set up the initial boilerplate for the Node application like this.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

Note how we use two additional packages named <\/span>axios<\/code> <\/span>and <\/span>redis<\/code>. <\/span>redis<\/code> <\/span>is the standard Redis client for Node. We use <\/span>axios<\/code> <\/span>to retrieve data from an external API for this tutorial.<\/p>\n

Before continuing, make sure to install those two packages using npm.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

Retrieve data from the external API<\/strong><\/p>\n

We will be using the <\/span>GitHub Jobs API<\/a> <\/span>to get data related to programming jobs available in different locations in the world.<\/p>\n

You can pass a search term related to the job you are looking for to the API and retrieve an array of available jobs in json format. A sample request to the API looks like this.<\/p>\n

\n

<\/i><\/a>POSTMAN \u2013 GitHub Jobs API results<\/figcaption><\/figure>\n<\/p>\n<\/figure>\n

In our Node application, we define a route named <\/span>\/jobs<\/code>, which retrieves job data from the above API and send them back to the client.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

Here, we use <\/span>axios<\/code> <\/span>to send a GET request to the GitHub Jobs API with the user-provided search term.<\/p>\n

Let\u2019s see how the route works now using Postman.<\/p>\n

\n

<\/i><\/a>POSTMAN \u2013 Our API results<\/figcaption><\/figure>\n<\/p>\n<\/figure>\n

Caching the results<\/h3>\n

Now, let\u2019s see how we can improve the performance of the application by caching.<\/p>\n

First, we need to connect to the Redis server through our application. We use the installed redis package for this task.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

Redis server listens on port 6379 on default. So, we pass the port number to connect to Redis and create a client.<\/p>\n

Then, implement the logic to store and retrieve data from the cache.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

What\u2019s going on here?<\/strong><\/p>\n

When we receive a client request to the \/jobs route, first, we get the search term sent with the request\u2019s query parameters.<\/span><\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/span><\/p>\n

Then, we try to retrieve the requested data from the cache bypassing the search term, which we use as the key when storing data in the cache. Since the Redis package doesn\u2019t have native support for promises, we have to pass a callback to process the retrieved data.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

If the value returned from Redis is not null, it means the related data exists in the cache, so it\u2019s easy to return that data in the response. Just make sure you cast back the string to JSON.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

If the returned value was null, we have to send a request to the external API to retrieve relevant data.<\/p>\n

<\/p>\n

<\/figure>\n

<\/span><\/p>\n

When we get the data from the API, before sending it back, we store it in Redis so that the next time the same request is sent to the Node server, it can respond with data stored in the cache instead of requesting them from the API.<\/p>\n

Note how we use the <\/span>setex<\/code> <\/span>function to store data in the cache. Using the <\/span>setex<\/code> <\/span>function specifically, instead of the regular <\/span>set<\/code> <\/span>function, we can set an expiration time to the stored key-value pair. Because we set a value for expiration time, Redis will automatically remove that key-value pair from the cache when the elapsed time expires.<\/p>\n

Full source code<\/h2>\n

<\/figure>\n<\/p>\n

That\u2019s it. We have created a simple cache for our application. That wasn\u2019t so hard, was it?<\/p>\n

Moment of the truth: time comparison<\/h2>\n

We\u2019ll see how the use of a cache impacted the performance of our app. I used Postman to send requests to the server and measure request completion time.<\/p>\n

\n

<\/i><\/a>Performance<\/figcaption><\/figure>\n<\/p>\n<\/figure>\n

The first time you send a request to the server with a new search term, the application takes longer to respond (over 7 seconds) because it has to get the data from the external API. The second time you make the same request, the server responds faster as the results already exist in the cache.<\/p>\n

The request completes within 10 ms. It\u2019s a huge performance increase from the application we saw before without the cache.<\/p>\n

Summary<\/h2>\n

In this tutorial, we gave you a quick introduction to Redis and created a simple cache with it for a Node.js application. Now you can use Redis to cache frequently queried data in your application to gain a considerable performance increase.<\/p>\n

You can also look into how to take advantage of the best features of Redis in other use cases too.<\/p>\n

This <\/span><\/i>article<\/span><\/i><\/a> was originally published on <\/span><\/i>Live Code Stream<\/span><\/i><\/a> by <\/span><\/i>Juan Cruz Martinez<\/span><\/i><\/a> (twitter: <\/span><\/i>@bajcmartinez<\/span><\/i><\/a>), founder and publisher of Live Code Stream, entrepreneur, developer, author, speaker, and doer of things.<\/span><\/i><\/p>\n

Live Code Stream<\/span><\/i><\/a> is also available as a free weekly newsletter. Sign up for updates on everything related to programming, AI, and computer science in general.<\/span><\/i><\/p>\n

Source<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

In recent years, Redis has become a common occurrence in a Node.js application stack. Though its most popular use case is caching, Redis has many other use cases where you can take…<\/p>\n","protected":false},"author":1,"featured_media":1644,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/1643"}],"collection":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1643"}],"version-history":[{"count":0,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/posts\/1643\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=\/wp\/v2\/media\/1644"}],"wp:attachment":[{"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1643"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1643"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.londonchiropracter.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1643"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}