And Ellis H. Wilson, III writes: > 4. Although I'm not the biggest fan of HDFS, but this post misses the > /entire/ point of HDFS: reliability in the face of (numerous) > failures.
This is what I keep reminding people when they rag on HDFS performance. Most of HPC tries adding just enough fault tolerance without overly hindering performance (and pretty much fails outside c/r). HDFS tries to add performance without hindering fault tolerance. Different design space, and quite worth watching. (Although the current inane (yes, inane) practice of placing MR jobs on nodes separate from the storage baffles me.) _______________________________________________ Beowulf mailing list, [email protected] sponsored by Penguin Computing To change your subscription (digest mode or unsubscribe) visit http://www.beowulf.org/mailman/listinfo/beowulf
