The tag has no wiki summary.

learn more… | top users | synonyms

-1
votes
1answer
26 views

What category of workloads/problems would best suit learning about C/Linux Optimisation and distributed systems/HPC? [closed]

I've got a bunch of spare hardware and I'm really fascinated in optimising C code and Linux, while also working with distributed systems. To do this, I'm keen to start coding distributed solvers for ...
0
votes
0answers
27 views

How does FDS (flat datacenter storage) make optimizations around locality unnecessary?

I was reading the following computer systems paper: https://www.usenix.org/system/files/conference/osdi12/osdi12-final-75.pdf And I was trying to understand why it claims that it does not need data ...
0
votes
1answer
88 views

Building a serverless p2p CMS/System

I'm thinking about building an Open Source, serverless, offline-replicated p2p CMS, but I'm concerned about it really working in a real environment. How would you go about doing that, reducing the ...
0
votes
1answer
44 views

How to avoid duplicating the domain model in a multi-language distributed application?

My team is currently working on a web platform and we are planning to divide the application in a set of independent services written in different languages, the problem is that these services rely on ...
0
votes
1answer
127 views

distributed computing with remote hetrogenous machines

The way i am doing it now is using boost::asio TCP sockets handling everything manually with a main server that orchestrates the processes between the available machines, but the number of machines ...
2
votes
2answers
513 views

Building a distributed system on Amazon Web Services

Would simply using AWS to build an application make this application a distributed system? For example if someone uses RDS for the database server, EC2 for the application itself and S3 for hosting ...
0
votes
1answer
102 views

What is lightweight lock in distributed shared memory systems?

I started reading Tanenbaum's Distributed Systems book a while ago. I read about two phase locking and timestamp reordering in transactions chapter. While having a deeper look from google I heard of ...
0
votes
3answers
95 views

New nodes joining distributed genetic algorithm

I'm sort of torn on what to do for implementation of my distributed genetic algorithm problem. I would like to be able to have nodes join and part at will and not take down the whole system. But this ...
4
votes
1answer
539 views

Design patterns for multi-threaded messaging server

I'm designing an instant messaging server as a personal exercise to improve my understanding and application of multi-threading and design patterns in Java. I'm still designing, there's no code yet. ...
0
votes
0answers
190 views

How to design a task scheduler (like cron) with a Calendar Queue

I've been working on a dynamic task scheduler based on a Calendar Queue structure and I've hit a bit of a wall. The Calendar Queue lets me enqueue and dequeue events, however I think I might not be ...
0
votes
0answers
39 views

How to replicate state update to all the nodes in middle-ware cluster?

I am developing a middle-ware components that receives a stream of self-contained events. If event corresponds to a business rule a notification is generated. A system outgrew vertical scaling and it ...
7
votes
1answer
317 views

What logic is used to control Lock and Update actions in P2P networks? (similar to Bitcoin)

Bitcoin relies on Proof of Work (hashing) to control the writing to a central repository (the blockchain). It also relies on a set of rules for these updates, and defines what happens if a conflict ...
1
vote
1answer
353 views

Chrome's multiple process per each tabs

I am wondering what is the purpose of Chrome using multiple processes for each tabs? I asked this to C++ chat room and one responded it is a product of laziness. I personally believe this is an ...
1
vote
1answer
119 views

Distributed system command and control

I have an application that consists of a set of Java and C++ of processes running on one or more systems and need to ability to monitor and control the components as if they were one complete system. ...
0
votes
0answers
42 views

How are “super peers”, rendezvous peers and relay peers distinguished?

How are "super peers", rendezvous peers and relay peers defined and what distinguishes each of them in p2p discovery models ?
0
votes
1answer
85 views

Is a grid or p2p architecture a subset of a broker architecture?

Is a grid or p2p architecture a subset of a broker architecture? what are the key features that make these similar or distinct?
1
vote
1answer
72 views

How should subsytem in different locations interact and communicate?

Apologies for the long post... Where I work we have a system with many subsystems which are located in different locations. All the subsystems process some data and write the result on A database. In ...
1
vote
2answers
828 views

Design pattern for client/server sessions? [closed]

Are there any common patterns or general guidance I can learn from for how to design a client/server system where the both the client and server must maintain some kind per-client session state? I've ...
0
votes
1answer
336 views

How can I implement Paxos to develop a project for consensus in distributed systems? [closed]

I have to implement Paxos algorithm, to experiment on consensus in an asynchronous distributed system. Following is a pdf related to Paxos: ...
5
votes
1answer
538 views

Best practice for handling asynchronous inter communication?

Recently completed a project for handling credit card processing. One of the difficulties I faced was handling the delay / possible failure of notification messages. The most complex example was: an ...
6
votes
3answers
734 views

Distributed Issue Tracking

Distributed issue tracking seems like a belting idea to me, but it has never really taken off in a big way. Is there a good reason for that? I am aware of: bugz everywhere too complex to set up ...
2
votes
1answer
118 views

Does map-reduce transmit the data and executable instructions?

When map-reduce divides a task and sends the data to each worker process, does it also transmit the instructions for how to operate on the data? For example, let's say Google has some huge array of ...
0
votes
1answer
955 views

What is meant by Distributed Systems Coding interview questions

I was told that I will be asked coding questions in my interview and that the context will be related to Distributed Systems (I took ONE Distributed Systems course and I don't even remember much from ...
0
votes
1answer
211 views

Distributing cron-like tasks over multiple servers

Currently I'm using something like a master-cron server, which starts the tasks on the slave-worker servers. But there are so many tasks, that the timing gets lost entirely. Is there a an algorithm, ...
3
votes
1answer
301 views

Is it possible to modify Lamport's mutual exclusion algorithm to work without a FIFO guarantee?

I'm trying to implement a modified version of the Lamport Mutual Exclusion algorithm. The original algorithm assumes FIFO message ordering between connected systems, but I would like to use UDP a ...
2
votes
2answers
199 views

Open Source Cloud Computing

Recently I realized that the most popular social platforms on the net are in the hand of just a few companies, Google, Twitter, Facebook, to name just a few. Taking into account the world changing ...
2
votes
0answers
136 views

Open Grid Engine or Akka/Something more fault tolerant?

My use case is that I have a pipeline of independent, stand alone programs, that I want to execute in a certain order on specific pieces of data that are output from previous pipeline stages. The ...
1
vote
1answer
360 views

Building a Redundant / Distributed Application

This is more of a "point me in the right direction" question. My team of three and I have built a hosted web app that queues and routes customer chat requests to available customer service agents (It ...
4
votes
1answer
54 views

Is there any technology for dynamic assignment of execution context for programs that target many platforms with widely varying runtime performance? [closed]

This may very well be nothing new and probably exists, but I've never learned about it and would like to. The simplest way to be more specific is just to give an example. I was on the bus and ...
1
vote
2answers
98 views

Exclusive use of a Jini server during long-running call

I'm trying to use Jini, in a "Masters/Workers" arrangement, but the Worker jobs may be long running. In addition, each worker needs to have exclusive access to a singleton resource on that machine. ...
2
votes
3answers
411 views

Can an issue tracking system be distributed?

I was thinking about issue tracking software like Redmine, Trac or even the one that is in Fossil and something hit me: Is there a reason why Redmine and Trac are not possible to be distributed? Or ...
0
votes
1answer
112 views

Question for Enterprise control language(HPCC) [closed]

does anyone got some idea about ECL which is Enterprise control language used in HPCC(high performance cluster computing) used for distributed computing? i got some problem and not getting any answer ...
0
votes
2answers
475 views

why are transaction monitors on decline? or are they?

http://www.itjobswatch.co.uk/jobs/uk/cics.do http://www.itjobswatch.co.uk/jobs/uk/tuxedo.do Look at the demand for programmers (% of job ads that the keyword appears), first graph under the table. ...
2
votes
3answers
178 views

How to rewrite a TCP MMOG server designed to run in a single machine, in a distributed way?

I have a MMOG server running on C++, using winsockets. My server won't support more than 200 players. I had the idea of redesigning it so it will use multiple servers instead of one, so, maybe, for ...
2
votes
3answers
686 views

Synchronizing local and remote cache in distributed caching

With a distributed cache, a subset of the cache is kept locally while the rest is held remotely. In a get operation, if the entry is not available locally, the remote cache will be used and and the ...
2
votes
1answer
58 views

Any reference doc /model/ implementation of enforcing events dependency/ordering in distributed computing?

For example, Process P is listening to events E(A) and E(B), but to process either of the events, P needs the other event available too. Naively, when P receives either of the events, it will check if ...
7
votes
3answers
273 views

Optimistic work sharing on sparsely distributed systems

What would a system like BOINC look like if it were written today? At the time BOINC was written, databases were the primary choice for maintaining a shared state and concurrency among nodes. Since ...
10
votes
3answers
3k views

Good books to learn distributed computing [closed]

Are there any good books to learn about distributed computing ? I work on large scale java applications. Recently my colleagues started talking about things like distributed cache, load balancing, ...
14
votes
8answers
977 views

What exactly is distributed computing?

So I'm a senior in college and a couple of weeks ago, I interviewed at Microsoft for an entry-level SDE position. While most of the interviews (out of the total 7) were on the general principles of ...
2
votes
3answers
538 views

Scalable distributed file system for blobs like images and other documents [closed]

Cassandra & HBase both do not efficiently support storage of blobs like images. Storing directly on HDFS stresses the Namenode because of huge number of files. Facebook uses Haystack for images ...
5
votes
4answers
400 views

How to effectively (but minimally) *simulate* a distributed computing environment?

I am doing some personal research on Byzantine Faults. I am trying out algorithms from various research papers which present algorithms for consensus in distributed systems like this one. For this i ...
4
votes
2answers
635 views

How to implement a lightweight clustered architecture for a distributed application

I currently have a distributed application that runs on multiple embedded PCs. The whole application is composed of one master server and several nodes. Each node is an embedded PC that runs Windows 7 ...
2
votes
3answers
246 views

Promoting scalability in small business applications

I am part of a small software company that specializes in small to medium-sized business applications and my experience with distributed architectures/SOA is limited. Please let me know if I'm going ...
8
votes
2answers
467 views

Is there a canonical book on distributing computing in Java? [closed]

I have spent the last 2-1/2 years building a distributed application. We started testing it a couple months ago and we're moving it into production. Everything runs fairly well, but it could ...
2
votes
1answer
456 views

Client–server models and Client-centric models

For distributed applications, emphasis mine: Where classic software systems of the past century were mostly based on Client–server models and Client-centric application development, both ...
1
vote
3answers
270 views

Does the new field of “Autonomic Computing” strike you as an achievable goal with current computing power?

Autonomic Computing is mainly studied in academia. IBM does have a fairly advanced DB2 system with fail-safe capability. What do you think is the main challenge with Autonomic Computing? And what PL ...
1
vote
1answer
107 views

How do you control nodes in a server farm?

I've been reading about hadoop and multi-node setups, and it says in the documentation that you must have a JVM and hadoop software already running on those nodes. My question is, do people install ...
2
votes
6answers
162 views

Distributed/Network application development that is user focused but NOT web application development

I was curious, what other architectures exist for business or user focused development that aren't written using web applications. Are these architectures used today? If you are or were in the ...
8
votes
4answers
1k views

How do I get into a career in distributed systems?

I am enamored by reliable distributed systems and want to spend my career improving them rather than merely using them to write the same CRUD applications over and over. What experience will convince ...
3
votes
3answers
675 views

Making a virtual supercomputer with distributed P2P computing

I was just having this idea once and wondering if there's any possibility to harness the power of p2p distributed computing to make a virtual supercomputer with the following features: Works like a ...