Thanks Owen,
I have some related questions, and think you might know the answers:
1. Any solution for namenode failure?
2. When snapshot will be impemented?
3. Is there any writting/reading throughput testing?
Dongsheng
Owen O'Malley <[EMAIL PROTECTED]> wrote:
On Sep 5, 2007, at 1:03 PM, Dongsheng Wang wrote:
> The concern is that since itÂ’s been engineered to support MapReduce
> there may be fundamental assumptions that the data being stored by
> HDFS is transient in nature. Obviously for our scalable storage
> solution zero data loss or corruption is a heavy requirement.
Actually, HDFS was started before Map/Reduce. *smile* Map/Reduce does
not use HDFS for the transient storage, just the persistent storage
at the end of the job. HDFS should be a fairly good match for your
needs.
> Is anybody using HDFS as a long term storage solution? Interested
> in any info. Thanks
We have 1 petabyte of relatively persistent user data...
-- Owen
---------------------------------
Park yourself in front of a world of choices in alternative vehicles.
Visit the Yahoo! Auto Green Center.
