Which would mean that if I want to have my logs to reside in HDFS I will have to move them using copyFromLocal or some version thereof and then run Map/Reduce process against them ? Am I right ?
Thanks Avinash On 6/13/07, Owen O'Malley <[EMAIL PROTECTED]> wrote:
On Jun 13, 2007, at 3:29 PM, Phantom wrote: > Hmm I was under the impression that HDFS is like GFS optimized for > appends > although GFS supports random writes. HDFS doesn't support appends. There has been discussion of implementing single-writer appends, but it hasn't reached the top of anyone's priority list. Some people (me included) aren't thrilled by the semantics of atomic append in GFS. To me, it seems like atomic append is basically a poor-man's map/reduce. *smile* -- Owen
