[ https://issues.apache.org/jira/browse/AVRO-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sudhir Ranjan updated AVRO-1429: -------------------------------- Description: Getting exception on storing null valued record/tupple as avro. Please suggest if I am wrong some where as per the bellow codebase or else please provide the patch. ******My code base. REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/snappy-java-1.0.4.1.jar REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/avro-1.7.5.jar REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/json-simple-1.1.jar; REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/piggybank.jar; REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/jackson-core-asl-1.5.5.jar; REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/jackson-mapper-asl-1.5.5.jar; -- The input file only have 1 column (normal TEXT data i.e TSV format) and the file having a null value means nothing A = load '/home/hadoop/work/sudhir/AvroAnalysis/input/TSV_uncompressed/part*' using PigStorage('\t') as (USER_ID:long); -- The soutput to be stored in avro data format STORE A INTO '/home/hadoop/work/sudhir/AvroAnalysis/output/TSV_uncompressed/part*' USING org.apache.pig.piggybank.storage.avro.AvroStorage('schema','{"namespace":"com.sudhir.schema.users.avro","type":"long","name":"users_avro","doc":"Avro storing with schema using Pig.","fields":[{"name":"USER_ID","type":["null","long"],"default":null}]}'); *******Getting Error like: INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete ERROR org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to recreate exception from backed error: org.apache.avro.file.DataFileWriter$AppendWriteException: java.lang.NullPointerException: null of long ERROR org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed! was: Getting exception on storing null valued record/tupple as avro. Please suggest if I am wrong some where as per the bellow codebase or else please provide the patch. ******My code base. REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/snappy-java-1.0.4.1.jar REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/avro-1.7.5.jar REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/json-simple-1.1.jar; REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/piggybank.jar; REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/jackson-core-asl-1.5.5.jar; REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/jackson-mapper-asl-1.5.5.jar; -- The input file only have 1 column (normal TEXT data i.e TSV format) and the file having a null value means nothing A = load '/home/hadoop/work/sudhir/AvroAnalysis/input/TSV_uncompressed/part*' using PigStorage('\t') as (USER_ID:long); -- The soutput to be stored in avro data format STORE A INTO '/home/hadoop/work/sudhir/AvroAnalysis/output/TSV_uncompressed/part*' USING org.apache.pig.piggybank.storage.avro.AvroStorage('schema','{"namespace":"com.sudhir.schema.users.avro","type":"record","name":"users_avro","doc":"Avro storing with schema using Pig.","fields":[{"name":"USER_ID","type":["null","long"],"default":null}]}'); *******Getting Error like: INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete ERROR org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to recreate exception from backed error: org.apache.avro.file.DataFileWriter$AppendWriteException: java.lang.NullPointerException: null of long ERROR org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed! > Exception on storing Null value through AvroStorage using PIG > ------------------------------------------------------------- > > Key: AVRO-1429 > URL: https://issues.apache.org/jira/browse/AVRO-1429 > Project: Avro > Issue Type: Task > Environment: Hadoop 0.20.2-cdh3u5 > Apache Pig version 0.8.1-cdh3u5 > java version "1.6.0_27" > Reporter: Sudhir Ranjan > Labels: features, patch > > Getting exception on storing null valued record/tupple as avro. > Please suggest if I am wrong some where as per the bellow codebase or else > please provide the patch. > ******My code base. > REGISTER > /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/snappy-java-1.0.4.1.jar > REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/avro-1.7.5.jar > REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/json-simple-1.1.jar; > REGISTER /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/piggybank.jar; > REGISTER > /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/jackson-core-asl-1.5.5.jar; > REGISTER > /home/hadoop/work/sudhir/AvroAnalysis/Avrojars/jackson-mapper-asl-1.5.5.jar; > -- The input file only have 1 column (normal TEXT data i.e TSV format) and > the file having a null value means nothing > A = load '/home/hadoop/work/sudhir/AvroAnalysis/input/TSV_uncompressed/part*' > using PigStorage('\t') as (USER_ID:long); > -- The soutput to be stored in avro data format > STORE A INTO > '/home/hadoop/work/sudhir/AvroAnalysis/output/TSV_uncompressed/part*' USING > org.apache.pig.piggybank.storage.avro.AvroStorage('schema','{"namespace":"com.sudhir.schema.users.avro","type":"long","name":"users_avro","doc":"Avro > storing with schema using > Pig.","fields":[{"name":"USER_ID","type":["null","long"],"default":null}]}'); > *******Getting Error like: > INFO > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher > - 100% complete > ERROR org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to recreate > exception from backed error: > org.apache.avro.file.DataFileWriter$AppendWriteException: > java.lang.NullPointerException: null of long > ERROR org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed! -- This message was sent by Atlassian JIRA (v6.1.5#6160)