Take the 2-minute tour ×
Programmers Stack Exchange is a question and answer site for professional programmers interested in conceptual questions about software development. It's 100% free.

Cassandra & HBase both do not efficiently support storage of blobs like images. Storing directly on HDFS stresses the Namenode because of huge number of files. Facebook uses Haystack for images and attachments storage, but this is not open source. So is Lustre a good choice for distributed blob storage? I have read that Amazon S3 is used by many, but this would cost money and personally, I would not like to rely on third party system. What are other suggestions?

share|improve this question

closed as off-topic by gnat, MichaelT, GlenH7, Kilian Foth, Bart van Ingen Schenau Oct 8 '13 at 9:54

This question appears to be off-topic. The users who voted to close gave this specific reason:

  • "Questions asking us to recommend a tool, library or favorite off-site resource are off-topic for Programmers as they tend to attract opinionated answers and spam. Instead, describe the problem and what has been done so far to solve it." – gnat, MichaelT, GlenH7, Kilian Foth, Bart van Ingen Schenau
If this question can be reworded to fit the rules in the help center, please edit the question.

3 Answers 3

How about Coda or GlusterFS? Those are scalable distributed file systems and open source.

share|improve this answer

GlusterFS can work fine because it can work on very cheap hardware, but it's hard to tune. I have my own concerns about performance, but I'll expect to have on cluster working in the following months to watch how it works but myself.

share|improve this answer

GitHub uses Riak to store GitHub Pages documents. It would probably be a good fit for other blob storage uses as well.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.