The tag has no wiki summary.

learn more… | top users | synonyms

1
vote
0answers
39 views

How do distributed applications verify that the data was processed correctly?

There are a lot of projects out there that rely on the public sphere to process data for them, but I do wonder how they ensure that every computer participating has processed the data properly. The ...
0
votes
0answers
36 views

JavaBeans vs. ActiveX: Strategic analysis

JavaBeans and ActiveX both serve the same basic function: to facilitate communication among software components within framework "containers." These containers include Web browsers and other document ...
3
votes
1answer
171 views

Single source of truth within an enterprise distributed system

Within an enterprise distributed system I have many services - an ecommerce service, a CRM, support desk, finance, billing. Many of these services share common data, such as Customer data. These ...
2
votes
0answers
94 views

How to implement efficient heterogeneous microservice data queries?

Our team has an idea of implementing a simple declarative DSL that would let users query the enterprise's domain model via a single interface without caring which specific microservices to call to get ...
2
votes
2answers
64 views

Parallelising processing of users

Update I updated my question to reflect the fact I'm working with a database. I need to process user actions: The actions for each user change the user's balance which is then persisted to a ...
0
votes
0answers
81 views

Distributed computing - web services vs message queues

I Need to decide on the architecture for a distributed computing implementation. In the server, there is a database, which holds many mathematical problems, that need to be solved by crunching ...
3
votes
1answer
73 views

Consistent snapshot

Suppose process A has a consitent snapshot of some entities. And it is constantly receiving updates for this enteties. Now client B connecting to A and it should receive the consistent snapshot of ...
1
vote
1answer
63 views

Is it possible to implement a robust 2 node P2P protocol? [closed]

I am thinking about how to implement a P2P protocol with only two nodes. At first I read about different DHT implementations in the hope that this scenario would be feasible. Turns out most ...
1
vote
1answer
35 views

Sequencing distributed tasks with a distributed DB

Background I have two separate processes, WriteIt() and ReadIt(). One creates records, and the other processes the records in a DB cluster. Once WriteIt() creates a record, it queues a ReadIt() ...
0
votes
0answers
64 views

what is the relationship between CORBA, JMS and MDB?

In the context of my previous fuzzy question on microservices, please help me break down the terminology involved in these technologies: CORBA JMS MDB Utilizing JNDI, I believe it's possible to do ...
1
vote
0answers
70 views

How is ORB distinct from an endpoint?

What, fundamentally, am I misunderstanding about how to use appclient? The Application Client Container (ACC) includes a set of Java classes, libraries, and other files that are required for ...
1
vote
1answer
70 views

Options for repeated distributed task

Scenario My project has a need to periodically scan the database and notify administrators for particular issues. For example: Any errors in the logs since last update? Do values match expected ...
3
votes
3answers
438 views

have we come full circle with microservices, back to very old school approaches?

In terms of software architecture and design, how do microservices "stack up" (pun intended) against middleware? I'm coming from Java, and it seems like as you move away from straight REST as an API, ...
1
vote
1answer
45 views

Matrix distribution to process grid

I need to write a program, which will perform LU-decomposition, etc. The problem is that I don't know about the preferred way to distribute the loaded matrix from the root process to other processes. ...
0
votes
1answer
77 views

Difference between server Jobs and Workers?

I am trying to understand the difference between server workers and server jobs. Google has not been very helpful because the keyword "jobs" is being construed as an employment term... I have yet to ...
0
votes
1answer
147 views

What is eventual consistency?

I've heard people talking about "eventual consistency" (for example in this question and this answer). What is "eventual consistency"? How does it compare to "transactional consistency"? When does it ...
3
votes
2answers
113 views

Distributing a set of “Jobs” across multiple computers

I'm rather new to distributed computing and would like some assistance with the overall architecture of my application. My application has Jobs that can be added to a JobQueue. Then one or more ...
-1
votes
2answers
165 views

Internship guidance, things to consider [closed]

I'm posting on here to hear some advice from the pros, people who have been there and done that. I'm currently a junior in Computer Science, minoring in Math. I'm sitting on two different offers from ...
1
vote
2answers
147 views

How to minimize networking cost of distributed game database?

We've been working on a networked online game project which will run in near future and looking for a satisfying solution for our distributed game database. We didn't take networking costs into ...
1
vote
2answers
164 views

How to deploy software automatically over SSH?

I am dealing with a distributed application which is going to mange a network of Linux-based servers spread among different places. Having the SSH credentials (as the most supported connection ...
1
vote
0answers
41 views

how to combine logs coming from multiple virtual machines for processing?

Scenario: Two virtual machines produce logs. I want these logs to be sent to a central server for processing (as soon as a line of these logs is generated-->streaming ). The condition here is that I ...
3
votes
1answer
196 views

Accepting the UUID collision risk based on number of clients

After reading some questions about the probability of UUID collisions it seems like collisions although unlikely, are still possible and a conflict solution is still needed. Therefore I am wondering ...
2
votes
2answers
527 views

How does Elastic Search approach the problem of distributed membership and consensus?

I already understand that Elastic Search is supposed to be deployed in a distributed topology, in that you can have multiple nodes for a cluster of ES instances. I like the API, and it looks ...
1
vote
1answer
216 views

Observing progress of a distributed system

For a distributed system, there is a requirement of observing the progress of smaller applications on distributed computers (runtime 5 - 20 minutes). There is a web fronted, which right now only ...
3
votes
1answer
2k views

Persistent storage for Apache Mesos

Recently I've discovered such a thing as a Apache Mesos. It all looks amazingly in all that demos and examples. I could easily imagine how one would run for stateless jobs - that fits to the whole ...
0
votes
1answer
146 views

Interconnect nodes in a Java distributed infrastructure for tweet processing

I'm working in a new version of an old project that I used to download and process user statuses from Twitter. The main problem of that project was its infrastructure. I used multiple instances of a ...
2
votes
0answers
122 views

Managing setTimeouts and setInterval in a distributed environment

I am building a turnbased game on nodejs using socket.io and redis as the datastore. I am planning on hosting the game on AWS opsworks with the ability to scale by adding more nodes. How should I ...
2
votes
1answer
90 views

Message Passing: How to detect and/or handle “dead ends”

I'm playing with a mental model for distributed actor system that communicates using messages. In this, it is possible for an actor to create another actor. I've encountered one specific situation ...
4
votes
1answer
284 views

Use a custom value object or a Guid as an entity identifier in a distributed system?

tl;dr I've been told that in domain-driven design, an identifier for an entity could be a custom value object, i.e. something other than Guid, string, int, etc. Can this really be advisable in a ...
1
vote
3answers
205 views

what are the things to take in consideration when designing a database that likely will be distributed after some time? [closed]

We are small start-up now, we don't have a DBA. if our project succeed, it will have a lot of data that will likely need to be distributed over several machines. So we want to make that step easier, ...
1
vote
1answer
240 views

Building a serverless p2p CMS/System

I'm thinking about building an Open Source, serverless, offline-replicated p2p CMS, but I'm concerned about it really working in a real environment. How would you go about doing that, reducing the ...
0
votes
1answer
114 views

How to avoid duplicating the domain model in a multi-language distributed application?

My team is currently working on a web platform and we are planning to divide the application in a set of independent services written in different languages, the problem is that these services rely on ...
0
votes
1answer
289 views

distributed computing with remote hetrogenous machines

The way i am doing it now is using boost::asio TCP sockets handling everything manually with a main server that orchestrates the processes between the available machines, but the number of machines ...
4
votes
3answers
1k views

Building a distributed system on Amazon Web Services

Would simply using AWS to build an application make this application a distributed system? For example if someone uses RDS for the database server, EC2 for the application itself and S3 for hosting ...
0
votes
1answer
254 views

What is lightweight lock in distributed shared memory systems?

I started reading Tanenbaum's Distributed Systems book a while ago. I read about two phase locking and timestamp reordering in transactions chapter. While having a deeper look from google I heard of ...
0
votes
3answers
104 views

New nodes joining distributed genetic algorithm

I'm sort of torn on what to do for implementation of my distributed genetic algorithm problem. I would like to be able to have nodes join and part at will and not take down the whole system. But this ...
4
votes
1answer
1k views

Design patterns for multi-threaded messaging server

I'm designing an instant messaging server as a personal exercise to improve my understanding and application of multi-threading and design patterns in Java. I'm still designing, there's no code yet. ...
0
votes
0answers
866 views

How to design a task scheduler (like cron) with a Calendar Queue

I've been working on a dynamic task scheduler based on a Calendar Queue structure and I've hit a bit of a wall. The Calendar Queue lets me enqueue and dequeue events, however I think I might not be ...
7
votes
1answer
328 views

What logic is used to control Lock and Update actions in P2P networks? (similar to Bitcoin)

Bitcoin relies on Proof of Work (hashing) to control the writing to a central repository (the blockchain). It also relies on a set of rules for these updates, and defines what happens if a conflict ...
1
vote
1answer
593 views

Chrome's multiple process per each tabs

I am wondering what is the purpose of Chrome using multiple processes for each tabs? I asked this to C++ chat room and one responded it is a product of laziness. I personally believe this is an ...
1
vote
1answer
130 views

Distributed system command and control

I have an application that consists of a set of Java and C++ of processes running on one or more systems and need to ability to monitor and control the components as if they were one complete system. ...
0
votes
1answer
107 views

Is a grid or p2p architecture a subset of a broker architecture?

Is a grid or p2p architecture a subset of a broker architecture? what are the key features that make these similar or distinct?
1
vote
1answer
80 views

How should subsytem in different locations interact and communicate?

Apologies for the long post... Where I work we have a system with many subsystems which are located in different locations. All the subsystems process some data and write the result on A database. In ...
5
votes
1answer
859 views

Best practice for handling asynchronous inter communication?

Recently completed a project for handling credit card processing. One of the difficulties I faced was handling the delay / possible failure of notification messages. The most complex example was: an ...
7
votes
3answers
1k views

Distributed Issue Tracking [closed]

Distributed issue tracking seems like a belting idea to me, but it has never really taken off in a big way. Is there a good reason for that? I am aware of: bugz everywhere too complex to set up ...
2
votes
1answer
124 views

Does map-reduce transmit the data and executable instructions?

When map-reduce divides a task and sends the data to each worker process, does it also transmit the instructions for how to operate on the data? For example, let's say Google has some huge array of ...
0
votes
1answer
394 views

Distributing cron-like tasks over multiple servers

Currently I'm using something like a master-cron server, which starts the tasks on the slave-worker servers. But there are so many tasks, that the timing gets lost entirely. Is there a an algorithm, ...
3
votes
1answer
502 views

Is it possible to modify Lamport's mutual exclusion algorithm to work without a FIFO guarantee?

I'm trying to implement a modified version of the Lamport Mutual Exclusion algorithm. The original algorithm assumes FIFO message ordering between connected systems, but I would like to use UDP a ...
2
votes
2answers
218 views

Open Source Cloud Computing

Recently I realized that the most popular social platforms on the net are in the hand of just a few companies, Google, Twitter, Facebook, to name just a few. Taking into account the world changing ...
3
votes
0answers
183 views

Open Grid Engine or Akka/Something more fault tolerant?

My use case is that I have a pipeline of independent, stand alone programs, that I want to execute in a certain order on specific pieces of data that are output from previous pipeline stages. The ...