Chris, could you send us any of your error logs? What kind of failures are you running into?
Andy On Wed, May 16, 2012 at 11:47 AM, Chris Diehl <[email protected]> wrote: > Hi All, > > I'm attempting to load sequence files for the first using Elephant Bird's > sequence file loader and having absolutely no luck. > > I did a hadoop fs -text one on of the sequence files and noticed all the > keys are (null). Not sure if that is throwing off things here. > > Here are various approaches I've tried that all have failed. > > REGISTER > '/opt/shared_storage/elephant-bird/build/elephant-bird-2.2.3-SNAPSHOT.jar'; > %declare SEQFILE_LOADER > 'com.twitter.elephantbird.pig.load.SequenceFileLoader'; > %declare TEXT_CONVERTER 'com.twitter.elephantbird.pig.util.TextConverter'; > %declare NULL_CONVERTER > 'com.twitter.elephantbird.pig.util.NullWritableConverter' > > raw_logs = LOAD > '/logs/jive/internal/raw/2012/05/07/2012050795652.0627-720078349.seq' USING > $SEQFILE_LOADER ('-c $NULL_CONVERTER','-c $TEXT_CONVERTER') AS (key: > bytearray, value: chararray); > --raw_logs = LOAD > '/logs/jive/internal/raw/2012/05/07/2012050795652.0627-720078349.seq' USING > $SEQFILE_LOADER ('-c $TEXT_CONVERTER','-c $TEXT_CONVERTER') AS (key: > chararray, value: chararray); > --raw_logs = LOAD > '/logs/jive/internal/raw/2012/05/07/2012050795652.0627-720078349.seq' USING > $SEQFILE_LOADER (); > > STORE raw_logs INTO '/data/SearchLogJSON/'; > > Any thoughts on what might be the problem? Anything else I should try? I'm > totally out of ideas. > > Appreciate any pointers! > > Chris >
