The tag has no wiki summary.

learn more… | top users | synonyms

2
votes
1answer
64 views

Random forest ML algorithm suitable for use on cluster based HPC?

I need help in identifying a better algorithm. I have developed a script using pythons scipy package to analyse a rather large model that I wish to solve. The model contains over 12GB of data ...
1
vote
1answer
94 views

Session serialization in JavaEE environment

Please consider the following scenario: We are working on a JavaEE project for which the scalability starts to become an issue. Up until now, we were able to scale up but this is no longer an option. ...
-1
votes
2answers
46 views

Determine Cluster Label in K-means

I have dataset that is contain 150 data that is actually divided into 3 group. Each group has it’s own label. I do clustering process with K-means algorithm to group the data. I need to assign the ...
0
votes
1answer
154 views

Why does storm not supply a mechanism for supplying topology necessary dependent jars other than the fat jar?

Following is a question that I had posted at the incubator-storm-user mailing list (verbatim). I had decided to open up the question here as well, because it also contains a conceptual side to it, ...
1
vote
2answers
190 views

Improving ZooKeeper to increase availability

Running Apache ZooKeeper (this applies to PAXOS style system just as well) with 2 members - which is not recommended - does not make sense, because if either member1 goes down member2 goes down ...
1
vote
1answer
170 views

How to test issues in a local development environment that can only be introduced by clustering in production?

We recently clustered an application, and it came to light that because of how we're doing SSL offloading via the load balancer in production it didn't work right. I had to mimic this functionality on ...
20
votes
5answers
478 views

Algorithm to Find the Aggregate Mass of “Granola Bar”-Like Structures?

I'm a planetary science researcher and one project I'm working on is N-body simulations of Saturn's rings. The goal of this particular study is to watch as particles clump together under their own ...
2
votes
1answer
138 views

How to deal with runtime changes to tenant-location in a clustered, multitenant web application with app-managed datasources?

I have a Java web application that supports multi-tenancy to keep customer data separate. Connection pools to each customer database are created at runtime. The details of each customer shard ...
1
vote
2answers
313 views

Relation of CPU Hz's and network speed in clusters

In cluster the Amdahl's law, Gustafson's law exists. I though that there might be some law which states the relation between CPU Hz's and network speed: maximum network speed after which no ...
0
votes
0answers
42 views

How to replicate state update to all the nodes in middle-ware cluster?

I am developing a middle-ware components that receives a stream of self-contained events. If event corresponds to a business rule a notification is generated. A system outgrew vertical scaling and it ...
0
votes
1answer
116 views

which is better of these two architectures and why

PhpServer will handle gSoap requests and http requests from clients. PushServer will push notifications to clients and act a file server. There are many server machines. Every PhpServer will ...
2
votes
0answers
408 views

Clustering Strings on the basis of Common Substrings

I have around 10000+ strings and have to identify and group all the strings which looks similar(I base the similarity on the number of common words between any two give strings). The more number of ...
14
votes
3answers
6k views

How to design highly scalable web services in Java?

I am creating some Web Services that would have 2000 concurrent users. The services are offered for free and are hence expected to get a large user base. In the future it may be required to scale up ...
-1
votes
1answer
5k views

What is the difference, between a server and a mainframe? [closed]

To me, it seems as though "mainframe" is a somewhat dated term; is it simply an older synonym of "server," or does it server a purpose more similar to a cluster/supercomputer?
0
votes
1answer
117 views

Clustering and custom applications

So lets say we have a clustered environment setup. We have a cluster SQL Server (I don't know exactly how its done but lets just say its been done for the sake of argument). Now if a website or ...
1
vote
1answer
583 views

Custom .NET apps and clustering

So for a clustered environment - how would this work with your apps? what about your own custom .NET apps? Would there be a special way to develop them? I know that you can say create a simple Hello ...
2
votes
1answer
181 views

How do I debug a cluster running Microsoft server 2003?

I'm sole developer of a complex critical software system, written in Visual C++ 2005. It's deployed on a classical Microsoft cluster scenario (active/passive), that has Windows Server 2003 R2. If a ...
3
votes
1answer
268 views

Grouping numbers to minimize group-means

I need to find a way or an algorithm that groups members of a given data set (of positive integers) so that the difference between group means is minimized (not maximized, as usual). There are two ...
13
votes
3answers
5k views

Efficient graph clustering algorithm

I'm looking for an efficient algorithm to find clusters on a large graph (It has approximately 5000 vertices and 10000 edges). So far I am using the Girvan–Newman algorithm implemented in the JUNG ...
1
vote
2answers
673 views

Mahout's Flexibility for generating recommendations

I am currently working on a system that will generate product recommendations like those on Amazon: "People who bought this also bought this.." This is how I plan to do it: Process the data using ...
4
votes
2answers
715 views

How to implement a lightweight clustered architecture for a distributed application

I currently have a distributed application that runs on multiple embedded PCs. The whole application is composed of one master server and several nodes. Each node is an embedded PC that runs Windows 7 ...
1
vote
1answer
127 views

Apply for supercomputing time

For testing and running some very intensive C++ number crunching applications, we need to apply for supercomputing time. I would like to get feedback and opinions from you; which calls do you follow, ...
0
votes
1answer
379 views

Transactional database and Datawarehouse on the same Postgresql cluster?

Is it conceptually feasible to have on a Postgresql Cluster a transactional database and at the same time a datawarehouse that would get feeded by the transactional database ?
2
votes
2answers
227 views

How does one make a cluster capable program?

In cluster computing, there seems to be two options: task redirection and task splitting. Task redirection seems easy enough, you just have the master dispatch the small calls to other nodes in the ...