[
https://issues.apache.org/jira/browse/MAPREDUCE-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Wittenauer updated MAPREDUCE-5860:
----------------------------------------
Labels: BB2015-05-TBR (was: )
> Hadoop pipes Combiner is closed before all of its reduce calls
> --------------------------------------------------------------
>
> Key: MAPREDUCE-5860
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5860
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: pipes
> Affects Versions: 0.23.0
> Environment: 0.23.0 on 64 bit linux
> Reporter: Joe Mudd
> Labels: BB2015-05-TBR
> Attachments: MAPREDUCE-5860.patch
>
>
> When a Combiner is specified to runTask() its reduce() method may be called
> after its close() method has been called due to how the Combiner's containing
> object, CombineRunner, is closed after the TaskContextImpl's reducer member
> is closed (see TaskContextImpl::closeAll()).
> I believe the fix is to delegate the Combiner's ownership to CombineRunner,
> making it responsible for calling the Combiner's close() method and deleting
> the Combiner instance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)