[
https://issues.apache.org/jira/browse/PIG-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pradeep Kamath updated PIG-563:
-------------------------------
Attachment: PIG-563-v2.patch
Same as earlier patch except for the change to remove a log message from
PigCombiner.java - the log message was put to log each time the combiner is
invoked for initial testing.
> PERFORMANCE: enable combiner to be called 0 or more times whenver the
> combiner is used for a pig query
> ------------------------------------------------------------------------------------------------------
>
> Key: PIG-563
> URL: https://issues.apache.org/jira/browse/PIG-563
> Project: Pig
> Issue Type: Improvement
> Affects Versions: types_branch
> Reporter: Pradeep Kamath
> Assignee: Pradeep Kamath
> Fix For: types_branch
>
> Attachments: PIG-563-v2.patch, PIG-563.patch
>
>
> Currently Pig's use of the combiner assumes the combiner is called exactly
> once in Hadoop. With Hadoop 18, the combiner could be called 0, 1 or more
> times. This issue is to track changes needed in the CombinerOptimizer visitor
> and the builtin Algebraic UDFS (SUM, COUNT, MIN, MAX, AVG) to be able to work
> in this new model.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
