open-source, networked, in-memory, key-value data store

learn more… | top users | synonyms

1
vote
0answers
37 views

how to store online status

I'm developing realtime web chat using pubsub pattern. To be concrete I'm using python and tornado-redis on back end and websockets (WS) (tornado) on front end. I have WS connection open and close ...
0
votes
1answer
53 views

Redis for caching

I've heard a lot of positive about Redis but have not used it myself. Now I want to add a cache layer for my web app to reduce the DB load, and I suppose Redis is fine for this. But I don't clearly ...
0
votes
1answer
431 views

Best strategy for storing static data : json file vs DB (mongo) vs redis [closed]

I'm currently designing a set of webservices related to travel industry. one of this service need to be take in input a airport code and a locale, and return the localized city name. fn(cityCode) ...
1
vote
1answer
125 views

What is the best way to store short-lived data? [closed]

I have to save some data about users with their location. This data will only be valid for like 5-10 minutes, then it will never be used again. So I am having a simple data structure like: { ...
2
votes
4answers
398 views

Are NoSQL databases the best choice for more efficiently querying large amounts of data?

We are planning to build a travel website in which we will be integrating multiple APIs (eg. DOTW, GTA, Expedia) for Hotels. I have initially tried to use MySQL but since there are huge amounts of ...
2
votes
0answers
69 views

Scoring algorithm implementation with Django and Redis

I use DjangoREST & MySQL as a backend for a mobiel app. I have two models, User and Feed and for any call to api/feeds/ returns all feeds for authenticated user ordered by created_at parameter of ...
1
vote
1answer
622 views

Redis strategy for cache item dependency

I'm implementing cache structure using Redis, my domain is like this: There are multiple categories (3000+ categories). Each category contains multiple questions (around 20-30 questions per ...
0
votes
1answer
385 views

Knowing who is the user in every request (every action, every view, every time)

I have many model classes that are mapped from/to tables using EF. Two of them are User and UserCookie, which are stored in tables Users and UserCookies. public class User { public long UserId { ...
1
vote
2answers
79 views

Creating fast, realtime dialogue search for television scripts

We have a database of television scripts and we'd like to search it, getting results as we type. We often remember words or snippets of dialogue but can't remember exactly what was said or what ...
1
vote
1answer
349 views

What is a good practice to push notifications in a “near real-time” delay in this case?

I want to enable some real-time notifications about friend's activities (social network). Technical context is: Webapp calling backend (REST API's). Scenario is: Kevin follows Bob. When Bob ...
0
votes
1answer
409 views

Should I persist notification before or after publishing it through Redis pub/sub?

I'm implementing a mechanism to notify a group of users about newly inserted blog comments. The architecture uses the Redis Pub/Sub mechanism. By definition, the pub/sub mechanism aims to propagate ...
2
votes
0answers
124 views

Managing setTimeouts and setInterval in a distributed environment

I am building a turnbased game on nodejs using socket.io and redis as the datastore. I am planning on hosting the game on AWS opsworks with the ability to scale by adding more nodes. How should I ...
1
vote
1answer
511 views

Storing primary keys of objects in Redis and then querying them in Postgres through Django

This is probably my second time posting in programmers. I'm usually on stackoverflow but this question is more fit for the community here. All suggestions, advice and insight on this matter is ...
2
votes
0answers
882 views

How to tell SignalR Notifications Hub that there is a new notification without having SignalR poll on that table

I'm developing a push-notifications system for my ASP.NET MVC app. The idea is to use Redis for queueing, ServiceStack for queue processing and SignalR for push-notifications to implement a system ...
0
votes
1answer
290 views

Backing up messages in S3 within a Storm topology

In my project we are trying to build up a KIND-of-a-lambda storm based architecture. The component would be responsible for indexing the site usage events so we expect a quite massive random load. The ...
19
votes
1answer
9k views

How to implement a message queue over Redis?

Why Redis for queuing? I'm under the impression that Redis can make a good candidate for implementing a queueing system. Up until this point we've been using our MySQL database with polling, or ...
0
votes
1answer
400 views

Redis & MongoDB for Metrics Platform

I'm in the process of writing an app that will ultimately display analytics to the user. I've written a service that collects data from an API. This data will then be processed, stored, then when the ...
2
votes
2answers
2k views

Redis strategy for activity log data

Our application requires an activity log of actions that a user has done. For example: 3/19/2013 ------------- 9:37 AM Chuck Norris scrapped 3 robots. 9:15 AM Chuck Norris fought 3 robots. ...
1
vote
1answer
354 views

2 Servers 1 Database - Can I use Redis?

Ok I have a couple of questions here. First let me give you some background information. I'm starting a project where I have a node.js server running my application and my website running on another ...
2
votes
1answer
214 views

In-memory DB to perform intersects on set slices

I have a specific programming need where I need to efficiently store large sorted sets in memory, query them for ranges, and intersect them against other sets that are also queried for ranged. I am ...
2
votes
1answer
676 views

How would you use Redis for Exception Handling?

I was reading this transcript of an interview with a GitHub developer and he was describing how they use Redis: Q: You mentioned using Redis. How do you use that? A: We use Redis for exception ...
2
votes
1answer
722 views

Querying key/value store

I don't know whether this question is reasonably answerable (and therefore will be closed), but I will take my chances: What are the possible problems (and solutions), one might encounter, when ...
2
votes
1answer
198 views

Semi-securely storing data in a remote key-value store, ensuring minimal data corruption/tampering

I'm bashing around a few ideas for storing usage data (similar to google analytics) for some Javascript products that we are working on. Unfortunately as yet we don't quite know 100% what data we ...
16
votes
1answer
6k views

Redis vs Zookeeper

It seems silly to compare these two servers considering that they're meant for very different things. But if you think about it, they can do lots of similar things: store configuration data, ...