The tag has no usage guidance.

learn more… | top users | synonyms

1
vote
2answers
269 views

Distributed transactions with Kafka

I need to implement a transaction that spans over loosely coupled (SOA+MOM) components. When a particular event is received, FOO and BAR need to do a transactional operation: that is, both the ...
0
votes
1answer
21 views

How to guarantee web script execution sequence/order or not parallels queues

This is a very simplified version of the problem: You have an integer saved on a server called "B" and you have an script saved on a server call "A" exposed to the internet. The script pulls the ...
2
votes
0answers
351 views

Architecture design for Java servlet that triggers work (for sending push notifications)

I'm designing a push notification server (for pushing notification via APNS and Google servers) and have come up with the following design for a Java based web application server. I would really like ...
2
votes
0answers
213 views

How to schedule large numbers of user-defined tasks?

Say you're running a website which generates a large number of tasks that should be run at particular times (e.g. reminder emails). You could run a cron which SELECTs a database table for unprocessed ...
1
vote
0answers
140 views

Distributed computing - web services vs message queues

I Need to decide on the architecture for a distributed computing implementation. In the server, there is a database, which holds many mathematical problems, that need to be solved by crunching ...
1
vote
0answers
56 views

Job queue dispatching based on resource constraints

We have a job-queue shaped hole in our architecture, but it isn't immediately obvious that there's a piece of existing software to fill it. There may be a reason for this, or there might not, so let ...
1
vote
0answers
67 views

Improve communication between controller and trackers in a Twitter fetcher tool using RabbitMQ or Apache Flume

I've been working for a time with some researches developing a tool to fetch tweets from Twitter and process them in some way. The first prototype "worked" but became a pain as we used sockets to ...
1
vote
0answers
162 views

When to use a message queue as a web service database?

Does it make sense to implement a message queue system such as RabbitMQ or Kafka for the purpose of storing data in a queue? For example, this could be done in order to handle things such as ...
0
votes
0answers
67 views

A layer of abstraction too far?

Using an enterprise service bus, a message translator pulls a message off the queue ready to be consumed by a service. The translator picks up the message in a canonical data model (CDM) form and ...
-1
votes
0answers
35 views

How much poppler-utils is scalable?

We need to process large number of PDFs simultaneously to extract text, images and create htmls. We have been using poppler-utils for PDF processing and Ruby for making system calls to poppler-util ...