Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms

12
votes
4answers
16k views

why are noSQL databases more scalable than SQL? [duplicate]

Recently I read a lot about noSQL DBMSs. I understand CAP theorem, ACID rules, BASE rules and the basic theory. But didn't find any resources on why is noSQL scalable more easily than RDBMS (e.g. in ...
2
votes
4answers
782 views

How concerned about load balancing do I need to be?

I'm currently working on a project which will have client applications (desktop & android & web) communicate with varies processes running on a server(s). My question is how much should I be ...
1
vote
2answers
478 views

Why OTServs have an item cloning problem if the server crashes? [closed]

OTServs are open source MMORPGs with a huge community. Mostly all of them have a serious problem: if the server crashes, people can clone items. This is a dirty trick that can be executed because the ...
1
vote
1answer
2k views

Is map-reduce the basic factor that makes NoSQL more scalable than SQL?

I'm studying the differences between NoSQL and SQL, and what makes the first more scalable. I think I got the point, so I'll try to explain: Suppose an app has a list of billions of users, each with ...
19
votes
4answers
2k views

Is BDD scalable for medium to large projects?

In every Website you read about BDD (Behaviour Driven Development) you find a very simple nice example showing you how obvious and easy is it to define your requirements. But trying to implement this ...
4
votes
1answer
1k views

How can I scale spring application context?

I'm currently working on a project that need to be dynamically scaled on demand according to the need. My question is about scaling spring context. My web application has a classical multi module ...
4
votes
2answers
6k views

How to design a scalable notification system? [closed]

I need to write a notification system manager. Here is my requirements: I need to be able to send a Notification on different platforms, which may be totally different (for exemple, I need to be ...
3
votes
0answers
183 views

Open Grid Engine or Akka/Something more fault tolerant?

My use case is that I have a pipeline of independent, stand alone programs, that I want to execute in a certain order on specific pieces of data that are output from previous pipeline stages. The ...
4
votes
3answers
2k views

Splitting big request in multiple small ajax requests

I am unsure regarding the scalability of the following model. I have little experience with large systems, big number of requests and so on but I'm trying to build some features considering ...
2
votes
2answers
244 views

How can I distribute a unique database already in production?

Let's assume a successful web Spring application running on a MySQL or PostgreSQL database. The traffic is becoming so high and the amount of data is becoming so big that a distributed database ...
13
votes
3answers
12k views

Why would more CPU cores on virtual machine slow compile times?

[edit#2] If anyone from VMWare can hit me up with a copy of VMWare Fusion, I'd be more than happy to do the same as a VirtualBox vs VMWare comparison. Somehow I suspect the VMWare hypervisor will be ...
14
votes
3answers
10k views

How to design highly scalable web services in Java?

I am creating some Web Services that would have 2000 concurrent users. The services are offered for free and are hence expected to get a large user base. In the future it may be required to scale up ...
1
vote
2answers
352 views

Centrally managing 100+ websites without bankrupting a small company [closed]

I'm mainly interested in opinions on the trade-offs between having a single central server all the websites connect to as opposed to each website mirroring a subset of the master database with all the ...
8
votes
4answers
838 views

scalablity of Scala over Java

I read an article that says Scala handles concurrency better than Java. http://www.theserverside.com/feature/Solving-the-Scalability-Paradox-with-Scala-Clojure-and-Groovy ...the scalability ...
1
vote
2answers
105 views

How to handle file access transactions properly?

I'm looking for good practices or any advice regarding file access transaction mechanisms. We will have multiple instances of an application spread over a redundant network (cloud) watching a ...
3
votes
3answers
1k views

A Huge Database: Picking the right schema and data model

We want to store some genomic variant data but there are some problems, more important ones like problem of the data's immense size and variability. Variant data can be huge. For example, a single ...
5
votes
5answers
2k views

Structuring database for multi-object “activity” and “following” functionalities

I am working on a web application which operate with different types of objects such as user, profiles, pages etc. All objects have unique object_id. When objects interact it may produce "activity", ...
1
vote
2answers
289 views

Proper way to measure the scalability of web Application

Let's say that I have a web Application where i'm going to have 300 users and each one have to see data on real time, imagine that each client make an ajax call to the server to see in real time ...
3
votes
4answers
1k views

Scaling Scrum within a group of 100s of programmers

Most Scrum teams lean toward 7-15 people **, though it's not clear how to scale Scrum among 100s of people, or how the effectiveness of a given team might be compared to another team within the group; ...
1
vote
4answers
3k views

What are some good tips for a developer trying to design a scalable MySQL database?

As the question states, I am a developer, not a DBA. I have experience with designing good ER schemas and am fairly knowledgeable about normalization and good schema design. I have also worked with ...
5
votes
4answers
2k views

JSF for an internet facing, high traffic web application

I, perhaps, made a wrong choice of going with a Component-based Framework like JSF for an internet facing, high traffic web application. Development with JSF has although been easier but what I fear ...
8
votes
5answers
555 views

Most common website scalability pitfalls

We are designing a website/web application where we hope to to achieve high user counts and, in general, lots of use. More specifically, we intend to be using PHP as the programming/scripting language ...
2
votes
2answers
462 views

Dealing with large amounts of web service requests and storing that data

I have a desktop application that sends a POST request to my website every 5 minutes. This post request can contain a variable amount of data about the PC sending the request, but typically it ...
4
votes
1answer
907 views

How is Scala scalable? [duplicate]

Possible Duplicate: Why is Scala more scalable than other languages? The Wikipedia page on Scala says: The name Scala is a portmanteau of "scalable" and "language", signifying that it ...
4
votes
3answers
409 views

What is “Scalable Integrated Systems”? [closed]

I've come across a job posting that asks for experience with "Scalable Integrated Systems", but honestly that sounds like "generic buzzword," and I'm trying to figure out what the actual work behind ...
6
votes
3answers
1k views

Work load balance/Task distribution algorithm

I'm looking for an algorithm to either use or as a jump point for load balancing. Environment: We have ~7 job types that can be scheduled at any time by our users. Some jobs are fast, others are ...
3
votes
3answers
132 views

migrating product and team from startup race to quality development [duplicate]

Possible Duplicate: A simple ways to improve the release quality in RAD environment This is year 3 and product is selling good enough. Now we need to enforce good software development ...
6
votes
1answer
649 views

How can I gather client's data on Google App Engine without using Datastore/Backend Instances too much?

One of the projects I'm working on is online survey engine. It's my first big commercial project on Google App Engine. I need your advice on how to collect stats and efficiently record them in ...
5
votes
4answers
2k views

Why scalability issues cannot be solved by more servers ?

I know that big websites suffer from scalability issues and I guess that more servers (hardware) can help to handle scalabililty issues but I see that big websites are stuck about scalability even if ...
17
votes
2answers
8k views

Does Node.js actually increase scalability?

I've been reading about the C10K Problem, and of particular note is the part that refers to asynchronous server I/O. http://www.kegel.com/c10k.html#aio I believe this pretty much summarises what ...
3
votes
3answers
3k views

Are there any non-blocking web servers for Java?

I was studying about the infrastructure being used by Facebook, as I was developing a website based on social interaction for a university project. Facebook is using Tornado Web Server as its ...
5
votes
2answers
219 views

Storing stop/start points in a database

Let's say I am storing start and stop points per user into a database table. For example... let's say in a chat system, a user only needs to see lines 24-293, and 500-512. (Let's say he logged off ...
4
votes
3answers
267 views

Developing scalable applications using Agile methods

Maybe someone can share from his experience about developing an application that is meant to scale big time where just throwing more money at better hardware isn't a realistic option using development ...
18
votes
8answers
6k views

What is the best way to design a web site to be highly scalable?

For websites that need to be highly scalable, such as social networks like facebook, what's the best way to design the website? Should I have a web service which the site queries to get data that it ...
3
votes
1answer
165 views

How and when do you scale Azure instances?

When dealing with Azure instances that are under-performing, how do you decide when to scale the instances? Do you scale horizontally by adding more instances or vertically by making the existing ...
1
vote
1answer
108 views

can we do scaling by throwing ruby stone

I heard developers at my office discussing Ruby language can be used for following purposes: Desktop apps,Web Apps,and may be handheld devices. Actually,we are in phase of selecting technology to ...
4
votes
5answers
2k views

Scalability and Programming languages

What makes a language scalable ? I believe scalability is more about system design. It sounds really odd to me, to say that one language is more scalable than the another.
18
votes
8answers
2k views

Dangers of huge monolithic application

The big project I'm working on for a couple years now is a control (and everything) application of an advanced device, heart of its firmware. The device is quite advanced, with more different ...
7
votes
6answers
422 views

Starting up in a basement and scaling

So I have this 'great' idea in my head that I want to start working on and build a company around it. Been working on desktop development for 5+ years and the idea revolves around the web. My exposure ...
3
votes
1answer
451 views

CMS and Databases vs. DIY

I have been programming for many years now, primarily in PHP and the like and would consider myself an intermediate programmer. Some of my online projects have now gone global and very widely used, i ...
2
votes
2answers
475 views

how to write a scalable/flexible php system? [closed]

I am trying to write a joomla type system in PHP to improve my coding/programming skills i need guidelines/rules of thumb to do that. what i basically want to do is create a index.php file which ...
5
votes
1answer
277 views

How do I build a highly scalable user/profile service?

Question -- I currently have a large monolithic Java application which I am working to break up into services components. One of the components I want to separate out is the service which handles ...
7
votes
3answers
288 views

Scaling Up applications

What should I consider when taking an application (web) from a few users to hundreds or thousands? Basically, what should I be considering when thinking about escalating?
31
votes
3answers
7k views

What does Douglas Crockford mean when he says jQuery doesn't scale? [closed]

In the Q&A section of this talk, Douglas Crockford says that jQuery doesn't scale as well as some other popular libraries. What does he mean by that, and what is it about the other libraries that ...
2
votes
5answers
2k views

Are web applications limited by the amount of memory or by the speed of the database server on the server side?

Many web sites mostly only do CRUD (create, read, update, delete) operations to the database for different URLs. Suppose that we have a 3-tier solution with the database server on a dedicated server ...
9
votes
4answers
12k views

Java or Python for internet application? [closed]

In choosing a technology for internet applications where the number of users may scale over time, which one should we consider: Java or Python? What are the considerations in choosing one and not the ...
7
votes
5answers
1k views

How do you off load work from the database?

In at least the web development field, web servers are everywhere but are backed by very few database servers. As web servers get hit with requests they execute large queries on the database, putting ...
6
votes
1answer
1k views

What are the challenges in building a scalable real-time web app?

I'm looking into real-time web applications using websockets and node.js. I'm interested to see what are some technical challenges with scaling such a setup. One such problem I've heard is that each ...
2
votes
1answer
116 views

How to find a scaling expert?

The web application is in ASP.NET and Sql Server and is growing much faster than anticipated. Where can I find an expert who has previously had experience of going from a small website to solution ...
6
votes
6answers
3k views

Is it recommended to use SQL Server as database for massively scalable applications?

Let's say you are planning to create a website of the scale of Facebook (If I am going to cite a website's name then why not Facebook?!). Is it recommended to use SQL Server as your database for such ...