[
https://issues.apache.org/jira/browse/MAPREDUCE-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joe Mudd updated MAPREDUCE-5860:
--------------------------------
Attachment: MAPREDUCE-5860.patch
A properly named and dev-support/test-patch tested patch.
This patch is ready for code review.
> Hadoop pipes Combiner is closed before all of its reduce calls
> --------------------------------------------------------------
>
> Key: MAPREDUCE-5860
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5860
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: pipes
> Affects Versions: 0.23.0
> Environment: 0.23.0 on 64 bit linux
> Reporter: Joe Mudd
> Priority: Minor
> Attachments: HadoopPipes.cc.patch, MAPREDUCE-5860.patch
>
>
> When a Combiner is specified to runTask() its reduce() method may be called
> after its close() method has been called due to how the Combiner's containing
> object, CombineRunner, is closed after the TaskContextImpl's reducer member
> is closed (see TaskContextImpl::closeAll()).
> I believe the fix is to delegate the Combiner's ownership to CombineRunner,
> making it responsible for calling the Combiner's close() method and deleting
> the Combiner instance.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
