[
https://issues.apache.org/jira/browse/PIG-357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alan Gates updated PIG-357:
---------------------------
Priority: Major (was: Critical)
I tried commenting out all reporting and in runs of 200 million rows on 25
machines it made absolutely no measurable difference. We may still need to fix
this, but it isn't an immediate performance issue.
> progress reported on every tuple
> --------------------------------
>
> Key: PIG-357
> URL: https://issues.apache.org/jira/browse/PIG-357
> Project: Pig
> Issue Type: Improvement
> Affects Versions: types_branch
> Reporter: Olga Natkovich
> Assignee: Alan Gates
> Fix For: types_branch
>
>
> Currently, if the reporter is set, we report progress on every tuple. This
> could be too expensive and impact performance. In the old code, we used to do
> it on every 1000th tuple or something like that.
> We might want to go to similar model.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
