hi all,
Running pig with avro storage and facing the below issue
pig 0.10 and avro 1.7
*
*
*org.apache.avro.file.DataFileWriter$AppenderWriteException :
java.lang.RuntimeException : Dataum 23.0 is not in union ["null" , "int"]*
*
*
my pig script does the following
a = load '/user/abhi/abc.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();
b = load '/user/abhi/def.txt' using
org.apache.pig.piggybank.storage.avro.AvroStorage();
joined = join a by $0 left outer , b by $0;
final = foreach joined generate
{
...
...
};
store final into '/user/abhi/output' using
org.apache.pig.piggybank.storage.avro.AvroStorage();
Thanks
abhishek