Custom partitioner not set when POSplit is involved in Plan
-----------------------------------------------------------
Key: PIG-2627
URL: https://issues.apache.org/jira/browse/PIG-2627
Project: Pig
Issue Type: Bug
Affects Versions: 0.9.2, 0.10
Reporter: Vivek Padmanabhan
{code}
A = load 'i3.txt' as (k,v);
L = FILTER A BY k == 'k1';
B = GROUP A BY k PARTITION BY SimpleCustomPartitioner PARALLEL 3;
C = FOREACH B GENERATE FLATTEN(A) PARALLEL 3;
STORE C INTO 'output1';
STORE L INTO 'output2';
{code}
For the above script the custom partitioner mentioned in the GROUP BY statement
is ignored by Pig.
To workaround this issue I had to disable Multiquery or put exec statements in
between.
The configuration is getting missed out while the Physical plan is getting
converted into the MR plan.
(Note the POGlobalRearrange is visited on a different MROper than what the
actual MRPlan returns)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira