[ 
https://issues.apache.org/jira/browse/PIG-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13785876#comment-13785876
 ] 

Aniket Mokashi commented on PIG-3497:
-------------------------------------

+1. Committed to trunk.
[~daijy], should we also commit this to 0.12?

> JobControlCompiler should only do reducer estimation when the job has a 
> reduce phase
> ------------------------------------------------------------------------------------
>
>                 Key: PIG-3497
>                 URL: https://issues.apache.org/jira/browse/PIG-3497
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Akihiro Matsukawa
>            Assignee: Akihiro Matsukawa
>            Priority: Minor
>         Attachments: reducer_estimation.patch
>
>
> Currently, JobControlCompiler makes an estimation for the number of reducers 
> required (by default based on input size into mappers) regardless of whether 
> there is a reduce phase in the job. This is unnecessary, especially when 
> running more complex custom reducer estimators. 
> Change to only estimate reducers when necessary.



--
This message was sent by Atlassian JIRA
(v6.1#6144)

Reply via email to