[
https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cheolsoo Park reopened PIG-3782:
--------------------------------
[~daijy] and [~knoguchi], sorry for reopening the jira. But
{{testForeachJoinWithUserDefinedSchemaAndPruning}} fails in branch-0.12
although it passes in trunk. Can you take a look?
Here is the stack trace-
{code}
Testcase: testForeachJoinWithUserDefinedSchemaAndPruning took 0.019 sec
Caused an ERROR
null
java.lang.reflect.InvocationTargetException
at org.apache.pig.test.Util.buildLp(Util.java:1057)
at
org.apache.pig.test.TestNewPlanPushDownForeachFlatten.migrateAndOptimizePlanWithPruning(TestNewPlanPushDownForeachFlatten.java:1165)
at
org.apache.pig.test.TestNewPlanPushDownForeachFlatten.testForeachJoinWithUserDefinedSchemaAndPruning(TestNewPlanPushDownForeachFlatten.java:1126)
Caused by: org.apache.pig.impl.logicalLayer.validators.TypeCheckerException:
ERROR 1059:
<line 1, column 191> Problem while reconciling output schema of ForEach
at
org.apache.pig.newplan.logical.visitor.TypeCheckingRelVisitor.throwTypeCheckerException(TypeCheckingRelVisitor.java:142)
at
org.apache.pig.newplan.logical.visitor.TypeCheckingRelVisitor.visit(TypeCheckingRelVisitor.java:182)
at
org.apache.pig.newplan.logical.relational.LOForEach.accept(LOForEach.java:76)
at
org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
at org.apache.pig.PigServer$Graph.compile(PigServer.java:1733)
at org.apache.pig.PigServer$Graph.compile(PigServer.java:1710)
at org.apache.pig.PigServer$Graph.access$200(PigServer.java:1411)
at org.apache.pig.PigServer.buildLp(PigServer.java:1376)
Caused by: org.apache.pig.impl.logicalLayer.validators.TypeCheckerException:
ERROR 1052:
<line 1, column 215> Cannot cast bytearray to int
at
org.apache.pig.newplan.logical.visitor.TypeCheckingExpVisitor.visit(TypeCheckingExpVisitor.java:516)
at
org.apache.pig.newplan.logical.expression.CastExpression.accept(CastExpression.java:44)
at
org.apache.pig.newplan.ReverseDependencyOrderWalker.walk(ReverseDependencyOrderWalker.java:70)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
at
org.apache.pig.newplan.logical.visitor.TypeCheckingRelVisitor.visitExpressionPlan(TypeCheckingRelVisitor.java:191)
at
org.apache.pig.newplan.logical.visitor.TypeCheckingRelVisitor.visit(TypeCheckingRelVisitor.java:157)
at
org.apache.pig.newplan.logical.relational.LOGenerate.accept(LOGenerate.java:244)
at
org.apache.pig.newplan.DependencyOrderWalker.walk(DependencyOrderWalker.java:75)
at org.apache.pig.newplan.PlanVisitor.visit(PlanVisitor.java:52)
at
org.apache.pig.newplan.logical.visitor.TypeCheckingRelVisitor.visit(TypeCheckingRelVisitor.java:174)
{code}
> PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing
> due to incorrect UID assignment
> -----------------------------------------------------------------------------------------------------------
>
> Key: PIG-3782
> URL: https://issues.apache.org/jira/browse/PIG-3782
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.10.1, 0.12.0, 0.11.1
> Reporter: Koji Noguchi
> Assignee: Daniel Dai
> Fix For: 0.12.1, 0.13.0
>
> Attachments: PIG-3782-2.patch, pig-3782-v01.patch
>
>
> {noformat}
> a = load '1.txt' as (a0:int, a1, a2:bag{});
> b = load '2.txt' as (b0:int, b1);
> c = foreach a generate a0, flatten(a2) as (q1, q2);
> d = join c by a0, b by b0;
> e = foreach d generate a0, q1, q2;
> f = foreach e generate a0, (int)q1, (int)q2;
> store f into 'output';
> {noformat}
> This pig script fails with
> 2014-02-27 11:49:45,657 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR
> 2229: Couldn't find matching uid -1 for project (Name: Project Type:
> bytearray Uid: 13 Input: 0 Column: 1)
--
This message was sent by Atlassian JIRA
(v6.2#6252)
