Hi, I'm considering using HDFS for storing a large number of files.
We will be storing a couple of million files, each 5-30 megabytes in size. There will be few writes, and many reads of these files. Am I right to be worried about the memory requirements on the name servers? What sort of requirements would this have? Would mogilefs be a better fit for this sort of load, or maybe HBase? or is there a better option that I haven't considered? I'm sure this should be in the FAQ, but all I have found is vague "designed for few, large files", and similar warnings. Thanks for your help. David -- Dijkstra probably hates me -- Linus Torvalds, in kernel/sched.c
