The big-data tag has no wiki summary.
0
votes
0answers
56 views
Need server suggestion to handle Twitter API
I am working on generating some statistics by using twitter trends and streaming API. ( I have adjusted keywords such that traffic I get from twitter daily is of max size 1GB)
I was currently ...
-2
votes
0answers
59 views
How to search for number of users on a website like Fiverr.com? [closed]
All of the users on Fiverr.com are assigned a username. Following is how you can see a persons profile,
www.fiverr.com/users/username
Now, there aren't many other pages on the site as compared to ...
1
vote
1answer
95 views
Experimenting with “big data” and map reduce
I was thinking about experimenting a bit with using mapreduce and such on a dataset we have to see if we can benefit from it in any way.
What route should I go if I want to be able to instantly, ...
-7
votes
1answer
113 views
What is BigData? and how it is related to NOSQL? [closed]
I want to know what is BigData and NOSQL. Can anybody explain these two things and
how they are interrelated?
4
votes
4answers
434 views
Suggested Web Application Framework and Database for Enterprise, “Big-Data” App?
I have a web application that I have been developing for a small group within my company over the past few years, using Pipeline Pilot (plus jQuery and Python scripting) for web development and ...
3
votes
4answers
605 views
NoSQL and BIG DATA
I am doing an internship on Big Data technologies so I am new to this area. My question is about the use of NoSQL in the Big Data architecture. Do we need always to use a distributed storage (like ...
0
votes
2answers
283 views
Algorithms for data structures in distributed system
The hash table data structure can be easily spread across multiple machines with a simple algorithm to distribute the keys:
machine_to_query = item_key % machine_count
When you want to read and ...
6
votes
3answers
549 views
Python in Big Data?
Can python be efficiently implemented in big data field? To be precise I am building an web app that analyses really big data in medical health care field consisting of medical history and huge ...
3
votes
2answers
331 views
How does Google store search trends in backend?
Google trends shows what query has been searched how many times and some other properties of the said query. But how is this data stored in a database?
Storing a new row for every search does not ...
1
vote
2answers
136 views
Using replacement to get possible outcomes to then search through HUGE amount of data
I have a database table holding 40 million records (table A).
Each record has a string a user can search for.
I also have a table with a list of character replacements (table B) i.e. i = Y, I = 1 ...
1
vote
1answer
428 views
Java BufferedReader vs Separate Producer consumer thread
I have a very big file delimited by some sequence of characters '*L*I*N*E'. The file will be of the order of 250G. And each line comes around 600bytes to 1000 bytes. I will be performing the following ...
1
vote
1answer
149 views
Developing an analytics's system processing large amounts of data - where to start
Imagine you're writing some sort of Web Analytics system - you're recording raw page hits along with some extra things like tagging cookies etc and then producing stats such as
Which pages got most ...
12
votes
6answers
4k views
How to learn Cloud Computing and Big Data at home? [closed]
I want to learn Cloud Computing and Big Data at home.
Is it possible to learn these technologies on home PC?
Which technologies to learn in Cloud Computing?
Which technologies to learn Big Data ...
17
votes
5answers
749 views
What is the definition of “Big Data”?
Is there one?
All the definitions I can find describe the size, complexity / variety or velocity of the data.
Wikipedia's definition is the only one I've found with an actual number
Big data ...
3
votes
1answer
189 views
Tools for Operating on Large Amounts of Text Data
I need to handle and process ~5 million news articles, an amount small enough to fit on a commodity desktop but too large to process serially. Thus far, I have been using Python/pickle for ...
11
votes
3answers
965 views
Choose C++ or Java for applications requiring huge amounts of RAM?
I'm thinking of scientific applications that are mostly processor-bound and heavy on heap usage (at least several gigabytes). Any other time of the year I would happily go with C++, but in this case I ...
2
votes
2answers
2k views
Interview questions to expect for Big Data position [closed]
A lot of new Big Data jobs are popping out recently.
What sort of technologies could one learn to get better familiar with this new field?
Are there any interview questions in particular that may ...
