Pradeep Kamath updated PIG-563:

    Attachment: PIG-563-v2.patch

Same as earlier patch except for the change to remove a log message from 
PigCombiner.java - the log message was put to log each time the combiner is 
invoked for initial testing.

> PERFORMANCE: enable combiner to be called 0 or more times whenver the 
> combiner is used for a pig query
> ------------------------------------------------------------------------------------------------------
>                 Key: PIG-563
>                 URL: https://issues.apache.org/jira/browse/PIG-563
>             Project: Pig
>          Issue Type: Improvement
>    Affects Versions: types_branch
>            Reporter: Pradeep Kamath
>            Assignee: Pradeep Kamath
>             Fix For: types_branch
>         Attachments: PIG-563-v2.patch, PIG-563.patch
> Currently Pig's use of the combiner assumes the combiner is called exactly 
> once in Hadoop. With Hadoop 18, the combiner could be called 0, 1 or more 
> times. This issue is to track changes needed in the CombinerOptimizer visitor 
> and the builtin Algebraic UDFS (SUM, COUNT, MIN, MAX, AVG) to be able to work 
> in this new model.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to