[ 
https://issues.apache.org/jira/browse/PIG-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Santhosh Srinivasan updated PIG-527:
------------------------------------

    Attachment: PIG-527.patch

Attached patch (PIG-527.patch) addresses the following:

1. PigStorage allows storage of nested data
2. Unit tests to test the same

All unit tests pass

> Pig does not support storing nested data using default storage
> --------------------------------------------------------------
>
>                 Key: PIG-527
>                 URL: https://issues.apache.org/jira/browse/PIG-527
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: types_branch
>            Reporter: Santhosh Srinivasan
>            Assignee: Santhosh Srinivasan
>             Fix For: types_branch
>
>         Attachments: PIG-527.patch
>
>
> Pig does not allow storing nested data using the default storage function 
> (PigStorage)
> {code}
> grunt> a = load 'student_tab.data' as (name, age, gpa);
> grunt> b = group a by age;
> grunt> store b into '/user/sms/data/complex.data';
> 2008-11-13 16:21:17,711 [main] INFO  
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - 50% complete
> 2008-11-13 16:21:52,747 [main] ERROR 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Map reduce job failed
> 2008-11-13 16:21:52,747 [main] ERROR 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
>  - Job failed!
> 2008-11-13 16:21:52,764 [main] ERROR 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error 
> message from task (reduce) 
> task_200809241441_21188_r_000000java.io.IOException: Cannot store a non-flat 
> tuple using PigStorage
>         at org.apache.pig.builtin.PigStorage.putNext(PigStorage.java:196)
>         at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:116)
>         at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat$PigRecordWriter.write(PigOutputFormat.java:90)
>         at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:300)
>         at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.processOnePackageOutput(PigMapReduce.java:238)
>         at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:224)
>         at 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapReduce$Reduce.reduce(PigMapReduce.java:136)
>         at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:318)
>         at 
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2207)
> 2008-11-13 16:21:52,764 [main] ERROR 
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher - Error 
> message from task (reduce) 
> task_200809241441_21188_r_000000java.io.IOException: Cannot store a non-flat 
> tuple using PigStorage
> {code}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to