[
https://issues.apache.org/jira/browse/PIG-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077175#comment-14077175
]
Rohini Palaniswamy commented on PIG-4079:
-----------------------------------------
I think with Hadoop 2, multiple reducers are possible in local mode. Let me try
find the jira.
> Parallel clause is not honored in local mode
> --------------------------------------------
>
> Key: PIG-4079
> URL: https://issues.apache.org/jira/browse/PIG-4079
> Project: Pig
> Issue Type: Bug
> Components: impl
> Reporter: Cheolsoo Park
> Assignee: Cheolsoo Park
> Fix For: 0.14.0
>
> Attachments: PIG-4079-1.patch
>
>
> I want to debug my custom partitioner in local mode. But it's not possible
> with Pig because:
> # MR does not invoke partitioner if # of reducers is equal to 1.
> https://issues.apache.org/jira/browse/MAPREDUCE-1287
> # Pig always forces a single reducers in local mode.
> {code:title=LogicalPlanBuilder.java}
> void setParallel(LogicalRelationalOperator op, Integer parallel) {
> if( parallel != null ) {
> op.setRequestedParallelism( pigContext.getExecType() ==
> ExecType.LOCAL ? 1 : parallel );
> }
> }
> {code}
> After I change Pig to honor the parallel clause, my custom partitioner gets
> invoked in local mode.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
