Sorry, Missed the part about loading custom types from SequenceFiles. The LoadFunc from piggybank will only load pig types. However, (as you already know), you can use elephant-bird. Not sure why you need to build it. The artifact exists in maven central.
http://search.maven.org/#artifactdetails%7Ccom.twitter.elephantbird%7Celephant-bird-pig%7C4.5%7Cjar Hope this helps. On Tue, May 20, 2014 at 1:44 PM, abhishek dodda <[email protected]>wrote: > Iam getting this error > > A = load '/a/part-m-0000' using > org.apache.pig.piggybank.storage.SequenceFileLoader(); > > org.apache.pig.backend.BackendException: ERROR 0: Unable to translate > class org.apache.hadoop.io.NullWritable to a Pig datatype > > > at > org.apache.pig.piggybank.storage.SequenceFileLoader.setKeyType(SequenceFileLoader.java:81) > at > org.apache.pig.piggybank.storage.SequenceFileLoader.getNext(SequenceFileLoader.java:138) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigRecordReader.nextKeyValue(PigRecordReader.java:211) > at > org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:484) > at > org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:76) > at > org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:85) > at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:139) > at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:673) > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:331) > at org.apache.hadoop.mapred.Child$4.run(Child.java:268) > at java.security.AccessController.doPrivileged(Native Method) > > > > On Tue, May 20, 2014 at 5:41 AM, Pradeep Gollakota > <[email protected]>wrote: > >> You can use the SequenceFileLoader from the piggybank. >> >> >> http://pig.apache.org/docs/r0.12.0/api/org/apache/pig/piggybank/storage/SequenceFileLoader.html >> >> >> On Tue, May 20, 2014 at 2:46 AM, abhishek dodda >> <[email protected]>wrote: >> >> > Hi All, >> > >> > I have trouble building code for this project. >> > >> > https://github.com/kevinweil/elephant-bird >> > >> > can some one tell how to read sequence files in pig. >> > >> > -- >> > Thanks, >> > Abhishek >> > >> > > > > -- > Thanks, > Abhishek > 2018509769 >
