Pig does not support storing nested data using default storage
--------------------------------------------------------------
Key: PIG-527
URL: https://issues.apache.org/jira/browse/PIG-527
Project: Pig
Issue Type: Bug
Affects Versions: types_branch
Reporter: Santhosh Srinivasan
Assignee: Santhosh Srinivasan
Fix For: types_branch
Pig does not allow storing nested data using the default storage function
(PigStorage)
{code}
grunt> a = load 'student_tab.data' as (name, age, gpa);
grunt> b = group a by age;
grunt> store b into '/user/sms/data/complex.data';
2008-11-13 16:21:17,711 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 50% complete
2008-11-13 16:21:52,747 [main] ERROR
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Map reduce job failed
2008-11-13 16:21:52,747 [main] ERROR
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Job failed!
2008-11-13 16:21:52,764 [main] ERROR
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error
message from task (reduce) task_200809241441_21188_r_000000java.io.IOException:
Cannot store a non-flat tuple using PigStorage
at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:196)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:116)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:300)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:238)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:224)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:136)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
2008-11-13 16:21:52,764 [main] ERROR
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error
message from task (reduce) task_200809241441_21188_r_000000java.io.IOException:
Cannot store a non-flat tuple using PigStorage
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
