Scalability is the ability of a system, network, or process, to handle growing amount of work in a capable manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms

1
vote
2answers
2 views

Databases: Where should the application logic run?

http://highscalability.com/blog/2010/11/9/facebook-uses-non-stored-procedures-to-update-social-graphs.html talks about how Facebook moved logic out of the database into the application in order to ...
6
votes
3answers
260 views

Proper Response to HTTP Request When Too Much Data is Requested

I'm building an API for an ad serving platform that will allow you to request tracker data for ad campaigns. Campaigns often exceed hundreds of millions of requests, which means there will be many ...
0
votes
1answer
25 views

Scaling Azure across subscriptions

I've been doing a lot of work with VMs recently and can see the massive advantages of the platform. It's my understanding that subscriptions are a very good way of managing your clients. For example ...
0
votes
2answers
59 views

Static and dynamic data : should I use different databases?

Say I am building a website that uses two different types of data : Static : information that will hardly change, like movie awards or world countries names (I want fast access so no external API) ...
2
votes
2answers
139 views

Should we always create web application scalable? [closed]

Fact that now a days everyone is moving to cloud due to ease in scalability, configuration and maintenance. But my question is should we develop all web application scalable event if it is not ...
1
vote
5answers
127 views

Can one always design for scale out?

When designing an application where scalability is going to be important, it would be useful if the application could be designed to "scale out" on cheap commodity servers. However, there are many ...
17
votes
3answers
368 views

How to test and optimize when you can't reproduce the environment?

In the past, I've worked in a variety of environments. Desktop apps, games, embedded stuff, web services, command line jobs, web sites, database reporting, and so on. All of these environments shared ...
2
votes
2answers
103 views

Scalable Job Handler

We have a job table that triggers a notification when a new job gets inserted. Clients that can handle such jobs may subscribe to those notifications. When a client receives a notification, he can ...
1
vote
1answer
267 views

Store scores for players and produce a high score list

This question is derived from an interview question that I got for a job I was declined. I have asked for code review for my solution at the dedicated Stack Exchange site ...
2
votes
1answer
143 views

Website as an API client vs using the API only when needed?

I'm developing a website (using Django) which will depend on an API for it's main functionality which is create/update/delete objects. But the API also provides: User sign up and login User ...
0
votes
1answer
63 views

Single Page Web Application Web Service Scalability

I am trying to build a single page web application that will call multiple web services (both SOAP and RESTful) and aggregate the data in the UI. Initially I though I could do it all client-side, ...
0
votes
2answers
108 views

How should I create object after database insert PHP

I have just been working on a new project and doing things the same way I have for years now. However for the first time, I am constantly thinking about scalability and performance of both the ...
0
votes
0answers
51 views

Is having coupled hosting in one platform better than having decoupled hosting?

Recently I have been thinking of converting some ideas into apps with couple of like minded friends. Our app will have an module, where users must include an instant messaging. The requirement for ...
1
vote
1answer
171 views

Why are JOINS deprecated for a in-memory database?

Correct me if I'm misunderstanding. Refer to the following sentence: Stack Overflow copied a key part of the Wikipedia database design. This turned out to be a mistake which will need massive ...
17
votes
5answers
1k views

Fighting technical debt as the “lowest developer”?

Let's say you work for a company and what you do is develop software for them. You have no idea of the big picture or maybe slight. What you do have are tasks assigned to you via issue tracking ...
2
votes
3answers
121 views

Difference between Optimization and Scalability?

If I quote a paragraph from Wikipedia about Optimization: In computer science, program optimization or software optimization is the process of modifying a software system to make some aspect of ...
0
votes
0answers
23 views

UDP distributing/sharding methods

Currently I'm sending UDP messages to a server which handles and processes the message. To make the processing more scalable, I'd like to have some sort of autoscaling mechanism for the receiving ...
1
vote
1answer
72 views

Even distribution through a chain of resources

I'm working on an algorithm which routes tasks through a chain of distributed resources based on a hash (or random number). For example, say you have 10 gateways into a service which distribute tasks ...
4
votes
1answer
866 views

OOCSS / BEM / SMACSS architecture

I've been working through this article to organize my front-end code. It references articles on BEM / SMACSS, which in turn reference other articles. I'm really trying to understand what the best ...
1
vote
2answers
851 views

How do I make multiple calls to a web service without taxing that service heavily? Scaling question

is there a good pattern for how to send multiple calls to a web service but without taxing it and ensuring the data is sent back? I don't know enough to correctly describe the problem to even start ...
22
votes
2answers
1k views

Internal-use websites: Is there a compelling case against SQLite?

Many web frameworks, such as Flask or Django use SQLite as their default database. SQLite is compelling because it's included in python, and administrative overhead is pretty low. However, most high ...
3
votes
2answers
95 views

Scalability of using environment variables

I just moved into the Ruby on Rails world and with it I am being introduced to much more liberal use of environment variables than what I have been exposed to in the past. Specifically, it appears ...
2
votes
1answer
278 views

PHP high traffic default page

I have a php website that will be experiencing high levels of traffic in a few weeks. We scaled the servers to accept the traffic, but want some sort of fallback page in the event that something ...
3
votes
2answers
424 views

Handling multiple clients using single application

We are developing an ERP web application using Vaadin framework where each of the potential client companies will have their own data and file storage. Current implementation only allows having one ...
-4
votes
1answer
292 views

Is there any “Set” database? [closed]

Is there any "set" database? For example Neo4j is a "graph" database. What I'm looking for is database which can be used to organize "items" into "sets" and then be able to query them with set ...
3
votes
3answers
702 views

Is the database the bottleneck or not? High Scalability talk

I found an interesting article on high scalability web site where it talks about EBay scalability and especially a specific passage struck me: "(Ebay strategies)...Move work out of the database ...
10
votes
1answer
473 views

How much does the data model affect scalability and performance in so called “NoSQL” database?

You can't ever have a talk about so called "NoSQL" database without bringing the CAP theorem (Consistency, Availability, Partition : pick two). If you have to pick say, between MongoDB (Partition, ...
10
votes
7answers
415 views

When to start thinking about scalability? [closed]

I'm having a funny but also terrible problem. I'm about to launch a new (iPhone) app. It's a turn-based multiplayer game running on my own custom backend. But I'm afraid to launch. For some reason, I ...
1
vote
1answer
110 views

How to implement a distributed proxy with quotas?

I'm in the process of developing a scalable proxy (Linux/C/C++, Nginx modules or custom HTTP server) handling incoming HTTP requests, and re-routing them to others locations based on parameters ...
5
votes
1answer
1k views

Is Node.js correct choice for JSON parsing and IO driven

My program should perform following task: It listen on http port after getting request it does following things. Connect to gearman Parse gearman payload to JSON (Upto 100 bytes) Connect to Redis ...
7
votes
1answer
2k views

Designing an scalable message queue architecture

I have recently started learning the nuances of scalable and enterprise computer architecture, and one of the central components is a messaging queue. In order to learn the most I can from any ...
8
votes
2answers
565 views

Is this solution RESTful and secure?

Our product registers new players on our service, and we've chosen to host it on Azure (we're using .NET) and we wanted it to be stateless (for scalability) and relatively secure. Since this is the ...
0
votes
1answer
3k views

How do you write scalable Java? [duplicate]

I like to think I write good maintainable Java code, using best practices, design patterns and try and get good test coverage with unit tests. Recently whilst looking for a job, I came across a ...
3
votes
1answer
392 views

Thinking pragmatically about scalability

I was recently asked as an exercise to design a scalable graph. My first intuition was how to seperate the graph and distribute it (sharding,consistent hashing..etc) Turns out my thinking was on ...
6
votes
4answers
9k views

why are noSQL databases more scalable than SQL? [duplicate]

Recently I read a lot about noSQL DBMSs. I understand CAP theorem, ACID rules, BASE rules and the basic theory. But didn't find any resources on why is noSQL scalable more easily than RDBMS (e.g. in ...
2
votes
4answers
459 views

How concerned about load balancing do I need to be?

I'm currently working on a project which will have client applications (desktop & android & web) communicate with varies processes running on a server(s). My question is how much should I be ...
1
vote
2answers
449 views

Why OTServs have an item cloning problem if the server crashes? [closed]

OTServs are open source MMORPGs with a huge community. Mostly all of them have a serious problem: if the server crashes, people can clone items. This is a dirty trick that can be executed because the ...
1
vote
1answer
2k views

Is map-reduce the basic factor that makes NoSQL more scalable than SQL?

I'm studying the differences between NoSQL and SQL, and what makes the first more scalable. I think I got the point, so I'll try to explain: Suppose an app has a list of billions of users, each with ...
18
votes
4answers
1k views

Is BDD scalable for medium to large projects?

In every Website you read about BDD (Behaviour Driven Development) you find a very simple nice example showing you how obvious and easy is it to define your requirements. But trying to implement this ...
4
votes
1answer
877 views

How can I scale spring application context?

I'm currently working on a project that need to be dynamically scaled on demand according to the need. My question is about scaling spring context. My web application has a classical multi module ...
3
votes
2answers
3k views

How to design a scalable notification system? [closed]

I need to write a notification system manager. Here is my requirements: I need to be able to send a Notification on different platforms, which may be totally different (for exemple, I need to be ...
2
votes
0answers
160 views

Open Grid Engine or Akka/Something more fault tolerant?

My use case is that I have a pipeline of independent, stand alone programs, that I want to execute in a certain order on specific pieces of data that are output from previous pipeline stages. The ...
3
votes
3answers
978 views

Splitting big request in multiple small ajax requests

I am unsure regarding the scalability of the following model. I have little experience with large systems, big number of requests and so on but I'm trying to build some features considering ...
2
votes
2answers
220 views

How can I distribute a unique database already in production?

Let's assume a successful web Spring application running on a MySQL or PostgreSQL database. The traffic is becoming so high and the amount of data is becoming so big that a distributed database ...
13
votes
3answers
9k views

Why would more CPU cores on virtual machine slow compile times?

[edit#2] If anyone from VMWare can hit me up with a copy of VMWare Fusion, I'd be more than happy to do the same as a VirtualBox vs VMWare comparison. Somehow I suspect the VMWare hypervisor will be ...
14
votes
3answers
7k views

How to design highly scalable web services in Java?

I am creating some Web Services that would have 2000 concurrent users. The services are offered for free and are hence expected to get a large user base. In the future it may be required to scale up ...
1
vote
2answers
343 views

Centrally managing 100+ websites without bankrupting a small company [closed]

I'm mainly interested in opinions on the trade-offs between having a single central server all the websites connect to as opposed to each website mirroring a subset of the master database with all the ...
8
votes
4answers
738 views

scalablity of Scala over Java

I read an article that says Scala handles concurrency better than Java. http://www.theserverside.com/feature/Solving-the-Scalability-Paradox-with-Scala-Clojure-and-Groovy ...the scalability ...
1
vote
2answers
97 views

How to handle file access transactions properly?

I'm looking for good practices or any advice regarding file access transaction mechanisms. We will have multiple instances of an application spread over a redundant network (cloud) watching a ...
3
votes
3answers
881 views

A Huge Database: Picking the right schema and data model

We want to store some genomic variant data but there are some problems, more important ones like problem of the data's immense size and variability. Variant data can be huge. For example, a single ...