Prasad Pingali wrote:
I am using 0.18.1-dev, upgraded from 0.18.0. I am also using compression for
map outputs.
I think this is fixed in 19. Look here
https://issues.apache.org/jira/browse/HADOOP-3131. We see this with
compression turned ON.
Amar
- Prasad.
On Wednesday 17 September 2008 01:26:28 am Arun C Murthy wrote:
On Sep 16, 2008, at 12:26 PM, pvvpr wrote:
Hello,
A strange thing happened in my job. In reduce phase, one of the tasks
status shows 101.44% complete and runs till some 102% and successfully
finished back to 100%. Is this a right behavior?
Which version of Hadoop are you running; and are you using compression
for map-outputs?
Arun
I put a quick copy-paste of the web GUI reporting completion of the
tasks. (sorry for the bad formatting below).
thanks,
Prasad Pingali,
IIIT Hyderabad.
Task Complete Status Start Time Finish Time Errors Counters
task_200809151235_0026_r_000000 90.91%
reduce > reduce
15-Sep-2008 18:40:06
0
task_200809151235_0026_r_000004 86.13%
reduce > reduce
15-Sep-2008 18:40:11
0
task_200809151235_0026_r_000008 85.08%
reduce > reduce
15-Sep-2008 18:40:16
0
task_200809151235_0026_r_000012 82.57%
reduce > reduce
15-Sep-2008 18:40:21
0
task_200809151235_0026_r_000014 97.90%
reduce > reduce
15-Sep-2008 18:40:22
0
task_200809151235_0026_r_000017 101.44%
reduce > reduce
15-Sep-2008 23:34:04
0
