[ 
https://issues.apache.org/jira/browse/PIG-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Santhosh Srinivasan updated PIG-646:
------------------------------------

    Attachment: PIG-646.patch

Attached patch fixes the issue with reporting progress in Distinct.java and 
also sets up the reporter correctly in PigCombiner.java and 
PigMapReduce.ReduceWithComparator. In addition there are unit test cases in 
TestBuiltin.java and TestEvalPipeline.java

All unit tests pass.

> Distinct UDF should report progress
> -----------------------------------
>
>                 Key: PIG-646
>                 URL: https://issues.apache.org/jira/browse/PIG-646
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Olga Natkovich
>            Assignee: Santhosh Srinivasan
>         Attachments: PIG-646.patch
>
>
> We have seen the case where if a bag passed to distinct UDF is too large to 
> fit into main memory the job fails with a time out because no progress is 
> reported.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to