[
https://issues.apache.org/jira/browse/HADOOP-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas updated HADOOP-3229:
----------------------------------
Attachment: 3229-0.patch
Is this causing a problem? If you're running a combiner, then progress is
reported for each record. Progress is also reported during the sort. It's also
reported as records are read, which should be concurrent to writing. Are you
seeing timeouts?
The attached patch reports progress once per partition, and at for every 10000
records written to a partition when not using a combiner.
> Map OutputCollector does not report progress on writes
> ------------------------------------------------------
>
> Key: HADOOP-3229
> URL: https://issues.apache.org/jira/browse/HADOOP-3229
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Environment: all
> Reporter: Alejandro Abdelnur
> Fix For: 0.17.0
>
> Attachments: 3229-0.patch
>
>
> It seem that the collector implementation used during the map phase does not
> report progress on writing.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
