InMemFSMergeThread.doInMemMerge() miss the lass MapOutput for each merge round
--------------------------------------------------------------------------------
Key: MAPREDUCE-2396
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2396
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.20.2
Reporter: Elton Tian
Priority: Critical
In ReduceTask.shuffleInMemory(), once a new MapOutput is read, the
ramManager.closeInMemoryFile() is called to notify waitForDataToMerge() to
check if a in memory merge is required. If the threshold is met, the
doInMemMerge() may start before the MapOutput just read been added to
mapOutputsFilesInMemory. So the "dataAvailable.notify();" should be removed and
let the noteCopiedMapOutput() notify the merge.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
