Re: Hadoop HDFS vs. NFS latency

2008-03-24 Thread Robert Krüger
Thank you very much for sharing your experience! This is very helpful and we will take a loog at mogile. I have two questions regarding your decision against HDFS. You mention issues with scale regarding the number of files. Could you elaborate a bit? At which orders of magnitude would you

Re: Hadoop HDFS vs. NFS latency

2008-03-24 Thread Robert Krüger
Ted Dunning wrote: A few million files should fit pretty easily in hdfs. One problem is that hadoop is not designed with full high availability in mind. Mogile is easier to adapt to those needs. Sorry to be so persistent but what failure scenario would mogile handle better than hadoop hdfs or