MultithreadedMapper doesn't update completion percentage before mapper is
finished
----------------------------------------------------------------------------------
Key: MAPREDUCE-2319
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2319
Project: Hadoop Map/Reduce
Issue Type: Improvement
Affects Versions: 0.20.2
Reporter: Forest Tan
MultithreadedMapper runs multiple threads in one mapper, but it doesn't update
the completion percentage before all the threads are completed.
If is better to update the completion percentage when threads are running to
reflect real progress.
The code is like this:
runners = new ArrayList(numberOfThreads);
for(int i = 0; i < numberOfThreads; i++)
{
MapRunner thread = new MapRunner(context);
thread.start();
runners.add(i, thread);
}
for(int i = 0; i < numberOfThreads; i++)
{
MapRunner thread = (MapRunner)runners.get(i);
thread.join(); // wait
...
}
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
