Take the 2-minute tour ×
Programmers Stack Exchange is a question and answer site for professional programmers interested in conceptual questions about software development. It's 100% free, no registration required.

I am working on generating some statistics by using twitter trends and streaming API. ( I have adjusted keywords such that traffic I get from twitter daily is of max size 1GB)

I was currently working on localhost using PHP/MySQL combination(batch input to db, also using Redis in middle).

For testing purposes, everything is fine but my question is Would a normal hosting server be enough to handle the load(of stream data from twitter+ cron script for fetching trends + the user traffic)?

I have heard that app engine also supports php now. Will it be able to support the computational power with PHP as backend?

I have worked with nodejs, but due to some reasons, I want this to be in PHP if possible. Please suggest if this is possible with PHP, otherwise I'll have to move my code to nodejs.

share|improve this question

put on hold as off-topic by amon, MichaelT, GlenH7, Bart van Ingen Schenau, gnat Dec 22 at 12:27

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "Questions asking us to recommend a tool, library or favorite off-site resource are off-topic for Programmers as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it." – amon, MichaelT, GlenH7
If this question can be reworded to fit the rules in the help center, please edit the question.

Are you processing the entire 1GB on your laptop, or a subset? If a subset, what happens (time, memory, disk usage, etc) when you increase the subset size by a factor of 10? 100? 1000? –  Dan Pichelman Jun 6 '13 at 0:44
Can you explain what you consider a "normal hosting server"? –  Mike Jun 6 '13 at 13:51
@Mike: servers like Godaddy,Hostgater (shared hosting PHP/Linux). It's not very clear to me what is their compute power actually. –  crazydiv Jun 7 '13 at 19:28
@DanPichelman I am currently processing stream as it comes (completely, there are many operations done) and over a day, the data reaches around 700MB to 1GB. The connection is never terminated due to overflow/ lack of compute power. But I've not tested it with multiple users( user display pages also involve some select/sort/group etc db operations). What I want to understand is if a server would be able to handle the load when actual users come, as on my localhost, system is in near-hanging state(with 1 user display or even without a display). –  crazydiv Jun 7 '13 at 19:33