[
https://issues.apache.org/jira/browse/PIG-1119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12785662#action_12785662
]
Jing Huang commented on PIG-1119:
---------------------------------
Here is the pig script for the test:(group_wrong.pig)
register /grid/0/dev/hadoopqa/jars/zebra.jar;
A = load 'filter.txt' as (name:chararray, age:int);
B = group A by name;
C = foreach B generate group, COUNT(A.name) as cnt;
Store C into 'group1' using
org.apache.hadoop.zebra.pig.TableStorer('[group];[cnt]');
===================
Here is the error message before the fix:
ackend error message during job submission
-------------------------------------------
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered " "group" "group "" at line 1, column 2.
Was expecting one of:
<IDENTIFIER> ...
"]" ...
at
org.apache.hadoop.zebra.io.BasicTable$Writer.<init>(BasicTable.java:1259)
at
org.apache.hadoop.zebra.pig.TableOutputFormat.checkOutputSpecs(TableStorer.java:135)
at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:772)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
at
org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247)
at
org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:279)
at java.lang.Thread.run(Thread.java:619)
Pig Stack Trace
---------------
ERROR 2997: Unable to recreate exception from backend error:
java.io.IOException: ColumnGroup.Writer constructor failed : Partition
constructor failed :Encountered " "group" "group "" at line 1, column 2.
org.apache.pig.backend.executionengine.ExecException: ERROR 2997: Unable to
recreate exception from backend error: java.io.IOException: ColumnGroup.Writer
constructor failed : Partition constructor failed :Encountered " "group" "group
"" at line 1, column 2.
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.Launcher.getStats(Launcher.java:176)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:253)
at
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.execute(HExecutionEngine.java:249)
at
org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:780)
at org.apache.pig.PigServer.execute(PigServer.java:773)
at org.apache.pig.PigServer.access$100(PigServer.java:89)
at org.apache.pig.PigServer$Graph.execute(PigServer.java:951)
at org.apache.pig.PigServer.executeBatch(PigServer.java:248)
at
org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:115)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:172)
at
org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:89)
at org.apache.pig.Main.main(Main.java:386)
================================================================================
Now with the patch we can successfully create the table with the same script.
$HADOOP_HOME/bin/hadoop fs -cat group1/.btschema
[group];[cnt]cnt:long
group:strincnt:long
> [zebra] "group" is a Pig preserved word, zebra needs to use other string for
> table's group information
> ------------------------------------------------------------------------------------------------------
>
> Key: PIG-1119
> URL: https://issues.apache.org/jira/browse/PIG-1119
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.6.0
> Reporter: Jing Huang
> Fix For: 0.6.0
>
> Attachments: PIG-1119.patch
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
