The tag has no wiki summary.

learn more… | top users | synonyms

18
votes
2answers
10k views

When to use Advanced Message Queuing Protocol like RabbitMQ? [closed]

Can somebody explain me in what use-cases I should consider using AMQP like e.g. RabbitMQ? What are the pros and cons?
14
votes
1answer
5k views

How to implement a message queue over Redis?

Why Redis for queuing? I'm under the impression that Redis can make a good candidate for implementing a queueing system. Up until this point we've been using our MySQL database with polling, or ...
13
votes
1answer
3k views

What are the solutions to the Distributed Queue problem?

I am trying to learn more about the various ways that the problem of a Distributed Queue may be solved. So I would like know what products, services, implementations and research papers that are ...
8
votes
2answers
387 views

Product agnostic book on Message Queues? [closed]

Are there any recommendations for book(s) that are largely agnostic (with examples of MQ implementations is fine) on vendor but go to great details on the architecture, management, nomenclature, ...
6
votes
1answer
431 views

Why database as queue so bad? [closed]

I've just read this article, and I'm confused. Let's imagine 1 webapp and 1 distinct application acting as "worker", both sharing the same database. Oh, I said "sharing"..but what does the article ...
6
votes
2answers
410 views

Implementation of communication between packages (Java)

I'm making a project with 5 packages. The packages can communicate with each other by sending Messages to a central MessageQueue in the Main package and that MessageQueue takes care of all the ...
5
votes
1answer
2k views

Designing an scalable message queue architecture

I have recently started learning the nuances of scalable and enterprise computer architecture, and one of the central components is a messaging queue. In order to learn the most I can from any ...
4
votes
1answer
70 views

How to Recover from Inconsistent Job State without Database Polling

I'm working on scaling an application which is currently polling a mySQL database to send async jobs to a background processing system. A state machine is being used to keep track of the entities ...
4
votes
4answers
486 views

Architecting Python application consisting of many small scripts

I am building an application which, at the moment, consists of many small Python scripts. Each Python script processes items from one Amazon SQS queue. Emails come into an initial queue and are ...
3
votes
1answer
231 views

How to get JMS to front end

I currently have a web application and I would like to add a messaging feature to it. In order to do that, I use JMS(actually OpenMQ, the implementation provided with Glassfish 3). The problem is that ...
3
votes
2answers
449 views

Where does Windows Workflow Foundation fit into the messaging oriented middleware architecture?

I've been trying to find information online about where WWF 4.5 fits with in an architecture based around an enterprise message queue using central broker(s) (RabbitMQ in particular). It seems like ...
3
votes
3answers
1k views

NoSQL Document Database as a Message Queue

I am considering using a NoSQL Document database as a messaging queue. Here is why: I want a client to post a message (some serialized object) to the server and not have to wait for a synchronous ...
3
votes
2answers
207 views

How to solve an event-queue problem in a computer emulator in Java

I'm writing a low-level emulator (in Java) of the IBM 1620, a late-50s computer. By "low level," I mean that the lowest observable unit of work is the 20-microsecond "trigger" -- machine instructions ...
2
votes
2answers
238 views

Write own messaging system vs. utilize existing ones

We are trying to have our own startup, with a middleware application to glue small applications with enterprise legacy systems. for such middle-ware to function properly, we will need some sort of ...
2
votes
1answer
91 views

Passing notifications between programs written in different programming languages

I work in a team of people with experience in varied programming languages. Recently we were required to build a report when an order is placed in our system. Our ecommerce store runs on PHP and the ...
2
votes
1answer
235 views

When does one NOT need to use queues in an application?

I've been developing an application using the Laravel Framework & have been exposed to the idea of queues for the first time. There are a multitude of tutorials & articles about using queues ...
2
votes
2answers
577 views

How do I document a communication protocol on top of message queues and channels?

I'm working on a large project at the moment and I'm trying to document the communication protocol that sits on top of a message queue middleware. The documentation is intended for another ...
2
votes
1answer
93 views

Should I parse an email template before or after placing it in the queue?

I have a web application that sends out transactional (triggered) emails to users. We've setup a message queue for the web application to write to when it needs to send out an email (best practices ...
2
votes
1answer
413 views

Best way to notify the client in real time that their queue (e.g. SQS) job has finished?

Current Scenario Our application allows users to upload (Amazon S3) and manage their files through our interface. Currently those users can download the files directly from S3/Cloudfront through our ...
1
vote
2answers
240 views

Access JSON object in different Languages

I have a Java code which is writing some data in string format to Messaging queue. Now any one can subscribe to this queue and fetch this data. Here the client fetching this data can be written in any ...
1
vote
2answers
1k views

REST or a message queue in a multi-tier heterogeneous system?

I'm designing a REST API for a three-tier system like: Client application -> Front-end API cloud server -> user's home API server (Home). Home is a home device, and is supposed to maintain connection ...
1
vote
1answer
433 views

Is ZeroMQ a good choice to make a Python app and a C# managed assembly work together?

I have a task that involves talking to a .NET-based API (namely AutoCAD) to retrieve data, send commands, and react to events. I want to separate the API operations and the proper program logic ...
1
vote
1answer
247 views

Kafka, is it possible to get the message offset after producing?

While using Apache Kafka, is it possible to get the offset of the message that has been produced? From the Kafka documentation page it says: each message in the partition are assigned a unique ...
1
vote
0answers
23 views

How to use Messagequeing in a distributed web application

I am curious for solutions to this problem: Assume we are going to build an online-store. To better scale parts of the architecture, it is broken into independend subsystems. The typical scenario ...
1
vote
0answers
105 views

How to schedule large numbers of user-defined tasks?

Say you're running a website which generates a large number of tasks that should be run at particular times (e.g. reminder emails). You could run a cron which SELECTs a database table for unprocessed ...
1
vote
0answers
197 views

Apply filter in Kafka Queue

Is it possible to apply a filter on the Kafka stream of topic? What I want to do is filter out messages while consuming and then run some custom logic on top of it. It is a sort of thing that Storm ...
1
vote
1answer
213 views

Push-Based Events in a Services Oriented Architecture

I have come to a point, in building a services oriented architecture (on top of Thrift), that I need to expose events and allow listeners. My initial thought was, "create an EventService" to handle ...
1
vote
1answer
243 views

Which one is the fastest Message Broker in case of a single machine? [closed]

I would like to know, which Message Broker I should choose in case of communication among apps within a single PC, considering speed. Among Apache ActiveMQ , MSMQ , RabbitMQ , OpenAMQ which one is ...
0
votes
2answers
201 views

Create and delay task for 24 hours [closed]

I'm trying to come up with a sane architecture to delay a task for 24 hours. So far I've thought of: unix cron job, but this will not be able to take the load we give it, since we will have many ...
0
votes
1answer
70 views

Locking database records

What I have right now: A table with lot of records. About 200 users can select a record according to some rules based on the data in each record. There is a high chance that 2 or more users will ...
0
votes
1answer
51 views

Estimating time remaining in a queue with multiple workers

I've been trying to figure out a way of calculating the estimated time remaining for an item in a queue when there are multiple workers processing items from the single queue. A client submits a job ...
0
votes
1answer
413 views

Scheduling Thousands of *Recurring* Jobs

I'm looking for general approaches and ideally libraries/tools for scheduling many thousands of recurring jobs. A simple example is a feed aggregator, where I'd want to repeatedly poll thousands of ...
0
votes
0answers
42 views

Message Queue: Which one is the best scenario?

I write a web crawler. The crawler has 2 steps: get a html page then parse the page I want to use message queue to improve performance and throughput. I think 2 scenarios: scenario 1: ...
0
votes
0answers
23 views

Can rabbitmq client have its own exchange and queue in client environment itself?

Is that possible to create exchange and queue in client environment by the client? Below is the quote from http://blog.dtzq.com/2012/07/amqp-exchanges-and-rabbitmq.html AMQP clients are free to ...
0
votes
0answers
214 views

RabbitMQ and Microsoft Service Bus integration

We're running Microsoft Service Bus (AMQP 1.0) locally and are quite happy with it. We've recently started doing business with a provider that uses RabbitMQ (AMQP 0.9.1) as it's message broker. How ...
0
votes
0answers
510 views

MSMQ Receive Timeout Even With Items in Queue

Tried posting this on main StackOverflow site, but no replies in 5 days. I am having ongoing problems trying to implement a very simple MSMQ solution: 2 PCs (not servers) running Win7 and Win8 ...
0
votes
4answers
1k views

Online Poker Game Programming [closed]

I am trying to write a massive online multiplayer client for a poker site, where one user can be on a Flash client and the other on say an iOS client (iPhone / iPad), and would like to know how can ...
-1
votes
1answer
93 views

Will a MQ topic persist messages when one of the consumers is down

If I have a websphere MQ topic and 3 listeners have subscribed to the Topic. One listener is down when a message comes in the Topic. Other listeners consume the message. When the listener comes back ...