[
https://issues.apache.org/jira/browse/PIG-310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12616212#action_12616212
]
Santhosh Srinivasan commented on PIG-310:
-----------------------------------------
The issue has been fixed. The logical, type checked and physical plans for the
query will now look like:
{noformat}
ForEach Test-Plan-Builder-8 Schema: {bytearray} Type: bag
| |
| Project Test-Plan-Builder-6 Projections: [*] Overloaded: false
FieldSchema: c1: tuple Type: tuple
| Input: SORT Test-Plan-Builder-5|
| |---SORT Test-Plan-Builder-5 Schema: null Type: bag
| | |
| | Project Test-Plan-Builder-4 Projections: [1] Overloaded: false
FieldSchema: bytearray Type: bytearray
| | Input: Project Test-Plan-Builder-3 Projections: [1] Overloaded: fals
| |
| |---Project Test-Plan-Builder-3 Projections: [1] Overloaded: false
FieldSchema: a: bag Type: bag
| Input: CoGroup Test-Plan-Builder-2
|
|---CoGroup Test-Plan-Builder-2 Schema: {group: bytearray,a: {null}} Type:
Unknown
| |
| Project Test-Plan-Builder-1 Projections: [0] Overloaded: false
FieldSchema: bytearray Type: bytearray
| Input: Load Test-Plan-Builder-
|
|---Load Test-Plan-Builder-0 Schema: null Type: bag
Printing the logical plan
ForEach Test-Plan-Builder-8 Schema: {bytearray} Type: bag
| |
| Project Test-Plan-Builder-6 Projections: [*] Overloaded: false
FieldSchema: c1: bag Type: bag
| Input: SORT Test-Plan-Builder-5|
| |---SORT Test-Plan-Builder-5 Schema: null Type: bag
| | |
| | Project Test-Plan-Builder-4 Projections: [1] Overloaded: false
FieldSchema: bytearray Type: bytearray
| | Input: Project Test-Plan-Builder-3 Projections: [1] Overloaded: tru
| |
| |---Project Test-Plan-Builder-3 Projections: [1] Overloaded: true
FieldSchema: a: tuple Type: tuple
| Input: CoGroup Test-Plan-Builder-2
|
|---CoGroup Test-Plan-Builder-2 Schema: {group: bytearray,a: (null)} Type: bag
| |
| Project Test-Plan-Builder-1 Projections: [0] Overloaded: false
FieldSchema: bytearray Type: bytearray
| Input: Load Test-Plan-Builder-
|
|---Load Test-Plan-Builder-0 Schema: null Type: bag
Printing the physical plan
New For Each(true)[bag] - Test-Plan-Builder-18
| |
| Project[bag][*] - Test-Plan-Builder-17
| |
| |---POSort[bag]() - Test-Plan-Builder-16
| | |
| | Project[bytearray][1] - Test-Plan-Builder-15
| |
| |---Project[tuple][1] - Test-Plan-Builder-14
|
|---Package[tuple]{bytearray} - Test-Plan-Builder-11
|
|---Global Rearrange[tuple] - Test-Plan-Builder-10
|
|---Local Rearrange[tuple]{bytearray} - Test-Plan-Builder-12
| |
| Project[bytearray][0] - Test-Plan-Builder-13
|
|---Load(myfile:org.apache.pig.builtin.PigStorage) -
Test-Plan-Builder-9
{noformat}
> Some nested order by queries fail in logical to physical translator
> -------------------------------------------------------------------
>
> Key: PIG-310
> URL: https://issues.apache.org/jira/browse/PIG-310
> Project: Pig
> Issue Type: Bug
> Affects Versions: types_branch
> Reporter: Alan Gates
> Assignee: Santhosh Srinivasan
> Priority: Critical
> Fix For: types_branch
>
>
> The query:
> {code}
> a = load 'myfile';
>
> b = group a by $0;
>
>
> c = foreach b {c1 = order $1 by $1; generate flatten(c1); };
>
>
> store c into 'outfile'
> {code}
> dies with the error message:
> java.io.IOException: Unable to store for alias: c [null]
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:232)
> at org.apache.pig.PigServer.compilePp(PigServer.java:556)
> at org.apache.pig.PigServer.execute(PigServer.java:482)
> at org.apache.pig.PigServer.store(PigServer.java:324)
> at org.apache.pig.PigServer.store(PigServer.java:310)
> at
> org.apache.pig.tools.grunt.GruntParser.processStore(GruntParser.java:173)
> at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:317)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:77)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:58)
> at org.apache.pig.Main.main(Main.java:311)
> Caused by: org.apache.pig.backend.executionengine.ExecException
> ... 10 more
> Caused by: org.apache.pig.impl.plan.VisitorException
> at
> org.apache.pig.impl.logicalLayer.LogToPhyTranslationVisitor.visit(LogToPhyTranslationVisitor.java:726)
> at org.apache.pig.impl.logicalLayer.LOSort.visit(LOSort.java:141)
> at org.apache.pig.impl.logicalLayer.LOSort.visit(LOSort.java:35)
> at
> org.apache.pig.impl.plan.DependencyOrderWalkerWOSeenChk.walk(DependencyOrderWalkerWOSeenChk.java:68)
> at
> org.apache.pig.impl.logicalLayer.LogToPhyTranslationVisitor.visit(LogToPhyTranslationVisitor.java:651)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:87)
> at org.apache.pig.impl.logicalLayer.LOForEach.visit(LOForEach.java:36)
> at
> org.apache.pig.impl.plan.DependencyOrderWalker.walk(DependencyOrderWalker.java:68)
> at org.apache.pig.impl.plan.PlanVisitor.visit(PlanVisitor.java:51)
> at
> org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.compile(HExecutionEngine.java:229)
> ... 9 more
> Caused by: org.apache.pig.impl.plan.PlanException: Attempt to connect
> operator Project[tuple][1] - gates-Sat Jul 12 17:57:09 PDT 2008-16 which is
> not in the pla
> at
> org.apache.pig.impl.plan.OperatorPlan.checkInPlan(OperatorPlan.java:254)
> at org.apache.pig.impl.plan.OperatorPlan.connect(OperatorPlan.java:140)
> at
> org.apache.pig.impl.physicalLayer.plans.PhysicalPlan.connect(PhysicalPlan.java:77)
> at
> org.apache.pig.impl.logicalLayer.LogToPhyTranslationVisitor.visit(LogToPhyTranslationVisitor.java:723)
> ... 18 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
