Inconsistent column pruning in LOUnion
--------------------------------------
Key: PIG-1146
URL: https://issues.apache.org/jira/browse/PIG-1146
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.6.0
Reporter: Daniel Dai
Fix For: 0.7.0
This happens when we do a union on two relations, if one column comes from a
loader, the other matching column comes from a constant, and this column get
pruned. We prune for the one from loader and did not prune the constant. Thus
leaves union an inconsistent state. Here is a script:
{code}
a = load '1.txt' as (a0, a1:chararray, a2);
b = load '2.txt' as (b0, b2);
c = foreach b generate b0, 'hello', b2;
d = union a, c;
e = foreach d generate $0, $2;
dump e;
{code}
1.txt:
{code}
ulysses thompson 64 1.90
katie carson 25 3.65
{code}
2.txt:
{code}
luke king 0.73
holly davidson 2.43
{code}
expected output:
(ulysses thompson,1.90)
(katie carson,3.65)
(luke king,0.73)
(holly davidson,2.43)
real output:
(ulysses thompson,)
(katie carson,)
(luke king,0.73)
(holly davidson,2.43)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
