[ https://issues.apache.org/jira/browse/PIG-4079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077175#comment-14077175 ]
Rohini Palaniswamy commented on PIG-4079: ----------------------------------------- I think with Hadoop 2, multiple reducers are possible in local mode. Let me try find the jira. > Parallel clause is not honored in local mode > -------------------------------------------- > > Key: PIG-4079 > URL: https://issues.apache.org/jira/browse/PIG-4079 > Project: Pig > Issue Type: Bug > Components: impl > Reporter: Cheolsoo Park > Assignee: Cheolsoo Park > Fix For: 0.14.0 > > Attachments: PIG-4079-1.patch > > > I want to debug my custom partitioner in local mode. But it's not possible > with Pig because: > # MR does not invoke partitioner if # of reducers is equal to 1. > https://issues.apache.org/jira/browse/MAPREDUCE-1287 > # Pig always forces a single reducers in local mode. > {code:title=LogicalPlanBuilder.java} > void setParallel(LogicalRelationalOperator op, Integer parallel) { > if( parallel != null ) { > op.setRequestedParallelism( pigContext.getExecType() == > ExecType.LOCAL ? 1 : parallel ); > } > } > {code} > After I change Pig to honor the parallel clause, my custom partitioner gets > invoked in local mode. -- This message was sent by Atlassian JIRA (v6.2#6252)