open-source, networked, in-memory, key-value data store

learn more… | top users | synonyms

19
votes
1answer
9k views

How to implement a message queue over Redis?

Why Redis for queuing? I'm under the impression that Redis can make a good candidate for implementing a queueing system. Up until this point we've been using our MySQL database with polling, or ...
15
votes
1answer
6k views

Redis vs Zookeeper

It seems silly to compare these two servers considering that they're meant for very different things. But if you think about it, they can do lots of similar things: store configuration data, ...
2
votes
4answers
325 views

Are NoSQL databases the best choice for more efficiently querying large amounts of data?

We are planning to build a travel website in which we will be integrating multiple APIs (eg. DOTW, GTA, Expedia) for Hotels. I have initially tried to use MySQL but since there are huge amounts of ...
2
votes
2answers
2k views

Redis strategy for activity log data

Our application requires an activity log of actions that a user has done. For example: 3/19/2013 ------------- 9:37 AM Chuck Norris scrapped 3 robots. 9:15 AM Chuck Norris fought 3 robots. ...
2
votes
1answer
648 views

How would you use Redis for Exception Handling?

I was reading this transcript of an interview with a GitHub developer and he was describing how they use Redis: Q: You mentioned using Redis. How do you use that? A: We use Redis for exception ...
2
votes
1answer
709 views

Querying key/value store

I don't know whether this question is reasonably answerable (and therefore will be closed), but I will take my chances: What are the possible problems (and solutions), one might encounter, when ...
2
votes
1answer
211 views

In-memory DB to perform intersects on set slices

I have a specific programming need where I need to efficiently store large sorted sets in memory, query them for ranges, and intersect them against other sets that are also queried for ranged. I am ...
2
votes
1answer
195 views

Semi-securely storing data in a remote key-value store, ensuring minimal data corruption/tampering

I'm bashing around a few ideas for storing usage data (similar to google analytics) for some Javascript products that we are working on. Unfortunately as yet we don't quite know 100% what data we ...
2
votes
0answers
57 views

Scoring algorithm implementation with Django and Redis

I use DjangoREST & MySQL as a backend for a mobiel app. I have two models, User and Feed and for any call to api/feeds/ returns all feeds for authenticated user ordered by created_at parameter of ...
2
votes
0answers
118 views

Managing setTimeouts and setInterval in a distributed environment

I am building a turnbased game on nodejs using socket.io and redis as the datastore. I am planning on hosting the game on AWS opsworks with the ability to scale by adding more nodes. How should I ...
2
votes
0answers
848 views

How to tell SignalR Notifications Hub that there is a new notification without having SignalR poll on that table

I'm developing a push-notifications system for my ASP.NET MVC app. The idea is to use Redis for queueing, ServiceStack for queue processing and SignalR for push-notifications to implement a system ...
1
vote
1answer
434 views

Redis strategy for cache item dependency

I'm implementing cache structure using Redis, my domain is like this: There are multiple categories (3000+ categories). Each category contains multiple questions (around 20-30 questions per ...
1
vote
1answer
348 views

2 Servers 1 Database - Can I use Redis?

Ok I have a couple of questions here. First let me give you some background information. I'm starting a project where I have a node.js server running my application and my website running on another ...
1
vote
2answers
78 views

Creating fast, realtime dialogue search for television scripts

We have a database of television scripts and we'd like to search it, getting results as we type. We often remember words or snippets of dialogue but can't remember exactly what was said or what ...
1
vote
1answer
315 views

What is a good practice to push notifications in a “near real-time” delay in this case?

I want to enable some real-time notifications about friend's activities (social network). Technical context is: Webapp calling backend (REST API's). Scenario is: Kevin follows Bob. When Bob ...
1
vote
1answer
447 views

Storing primary keys of objects in Redis and then querying them in Postgres through Django

This is probably my second time posting in programmers. I'm usually on stackoverflow but this question is more fit for the community here. All suggestions, advice and insight on this matter is ...
0
votes
1answer
42 views

Redis for caching

I've heard a lot of positive about Redis but have not used it myself. Now I want to add a cache layer for my web app to reduce the DB load, and I suppose Redis is fine for this. But I don't clearly ...
0
votes
1answer
110 views

What is the best way to store short-lived data? [closed]

I have to save some data about users with their location. This data will only be valid for like 5-10 minutes, then it will never be used again. So I am having a simple data structure like: { ...
0
votes
1answer
382 views

Redis & MongoDB for Metrics Platform

I'm in the process of writing an app that will ultimately display analytics to the user. I've written a service that collects data from an API. This data will then be processed, stored, then when the ...
0
votes
1answer
318 views

Knowing who is the user in every request (every action, every view, every time)

I have many model classes that are mapped from/to tables using EF. Two of them are User and UserCookie, which are stored in tables Users and UserCookies. public class User { public long UserId { ...
0
votes
1answer
359 views

Should I persist notification before or after publishing it through Redis pub/sub?

I'm implementing a mechanism to notify a group of users about newly inserted blog comments. The architecture uses the Redis Pub/Sub mechanism. By definition, the pub/sub mechanism aims to propagate ...
0
votes
1answer
240 views

Backing up messages in S3 within a Storm topology

In my project we are trying to build up a KIND-of-a-lambda storm based architecture. The component would be responsible for indexing the site usage events so we expect a quite massive random load. The ...
0
votes
1answer
291 views

Best strategy for storing static data : json file vs DB (mongo) vs redis [closed]

I'm currently designing a set of webservices related to travel industry. one of this service need to be take in input a airport code and a locale, and return the localized city name. fn(cityCode) ...