Thanks! A gigantic Duh moment.
-----Original Message----- From: Runping Qi [mailto:[EMAIL PROTECTED] Sent: Friday, October 26, 2007 9:59 AM To: [email protected] Subject: RE: problems reading compressed sequencefiles in streaming (0.13.1) Try to add the package name too: o.a.h.m. SequenceFileAsTextInputFormat Runping > -----Original Message----- > From: Joydeep Sen Sarma [mailto:[EMAIL PROTECTED] > Sent: Friday, October 26, 2007 12:30 AM > To: [email protected] > Subject: problems reading compressed sequencefiles in streaming (0.13.1) > > I was hoping to use -inputformat SequenceFileAsTextInputFormat to process > compressed sequencefiles in streaming jobs > > > > However, using a python mapper that just echoes out each line as it gets, > and numreducetasks=0 - here's what the streaming job output looks like: > > > > SEQ^F > org.apache.hadoop.io.IntWritable^Yorg.apache.hadoop.io.Text^A^A'org.apache > [EMAIL PROTECTED]@[EMAIL PROTECTED]@Z+r������^F� > > > > So seems like the input file was not treated as sequencefile. > > > > I must be missing some args - except don't understand what. Help > appreciated .. > > > > Thx, > > > > Joydeep
