0
votes
0answers
28 views

How to upload huge data into SimpleDB quickly? [migrated]

I have a 2GB text file. I want to upload this into Amazon SimpleDB. I am using SDBExplorer to bulk upload the data. However the upload process is taking a lot of time. You can only upload around 25 ...
1
vote
2answers
642 views

Data Aggregation of CSV files java

I have k csv files (5 csv files for example), each file has m fields which produce a key and n values. I need to produce a single csv file with aggregated data. I'm looking for the most efficient ...
4
votes
5answers
911 views

Suggested Web Application Framework and Database for Enterprise, “Big-Data” App?

I have a web application that I have been developing for a small group within my company over the past few years, using Pipeline Pilot (plus jQuery and Python scripting) for web development and ...
4
votes
4answers
1k views

NoSQL and BIG DATA

I am doing an internship on Big Data technologies so I am new to this area. My question is about the use of NoSQL in the Big Data architecture. Do we need always to use a distributed storage (like ...
3
votes
2answers
543 views

How does Google store search trends in backend?

Google trends shows what query has been searched how many times and some other properties of the said query. But how is this data stored in a database? Storing a new row for every search does not ...