Does HDFS guarantee that all the blocks of a particular compressed file exist on the same datanode? (same question for any of its replicas)
This is important because in HaDoop, each Map is required to process the entire compressed file. If the blocks of the compressed file exist on different datanodes, that could introduce significant network transfer cost. Any ideas of that? Thanks, -Songting Chen
