On Fri, Aug 28, 2009 at 10:13 AM, Rares Vernica<[email protected]> wrote: > > On Fri, Aug 28, 2009 at 4:46 AM, Jothi Padmanabhan<[email protected]> > wrote: >> >> Could you attach the complete reducer logs for the two runs? > > Attached.
Forgot the attachments... Here they are. Cheers! Rares Vernica
2009-08-27 12:06:17,008 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId= 2009-08-27 12:06:17,101 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=1932584576, MaxSingleShuffleLimit=483146144 2009-08-27 12:06:17,114 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2009-08-27 12:06:17,116 INFO org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2009-08-27 12:06:17,116 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 12:06:17,116 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 12:06:17,117 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 12:06:17,117 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 12:06:17,117 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 12:06:17,130 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Thread started: Thread for merging on-disk files 2009-08-27 12:06:17,130 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Thread started: Thread for merging in memory files 2009-08-27 12:06:17,130 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Thread waiting: Thread for merging on-disk files 2009-08-27 12:06:17,131 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 12:06:17,133 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 0 new map-outputs 2009-08-27 12:06:17,133 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:07:17,142 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 12:07:17,145 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 0 new map-outputs 2009-08-27 12:07:17,145 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:08:17,155 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 12:08:17,155 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 0 new map-outputs 2009-08-27 12:08:17,156 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:09:17,165 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 12:09:17,166 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 0 new map-outputs 2009-08-27 12:09:17,166 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:09:52,173 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 2 new map-outputs 2009-08-27 12:09:52,173 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:09:52,190 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3284150 bytes (1041717 raw bytes) into RAM from attempt_200908262019_0014_m_000000_0 2009-08-27 12:09:52,229 INFO org.apache.hadoop.mapred.ReduceTask: Read 3284150 bytes from map-output for attempt_200908262019_0014_m_000000_0 2009-08-27 12:09:52,229 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_200908262019_0014_m_000000_0 -> (7, 8) from asterix-008 2009-08-27 12:09:54,171 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 1 new map-outputs 2009-08-27 12:09:54,171 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:09:54,174 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3285397 bytes (1042169 raw bytes) into RAM from attempt_200908262019_0014_m_000003_0 2009-08-27 12:09:54,211 INFO org.apache.hadoop.mapred.ReduceTask: Read 3285397 bytes from map-output for attempt_200908262019_0014_m_000003_0 2009-08-27 12:09:54,211 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_200908262019_0014_m_000003_0 -> (7, 8) from asterix-008 2009-08-27 12:09:56,171 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:09:56,173 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3284435 bytes (1042689 raw bytes) into RAM from attempt_200908262019_0014_m_000001_0 2009-08-27 12:09:56,228 INFO org.apache.hadoop.mapred.ReduceTask: Read 3284435 bytes from map-output for attempt_200908262019_0014_m_000001_0 2009-08-27 12:09:56,228 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_200908262019_0014_m_000001_0 -> (7, 8) from asterix-008 2009-08-27 12:10:03,171 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0: Got 1 new map-outputs 2009-08-27 12:10:03,171 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0014_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 12:10:03,174 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 3285442 bytes (1042623 raw bytes) into RAM from attempt_200908262019_0014_m_000002_0 2009-08-27 12:10:03,213 INFO org.apache.hadoop.mapred.ReduceTask: Read 3285442 bytes from map-output for attempt_200908262019_0014_m_000002_0 2009-08-27 12:10:03,213 INFO org.apache.hadoop.mapred.ReduceTask: Rec #1 from attempt_200908262019_0014_m_000002_0 -> (7, 8) from asterix-008 2009-08-27 12:10:04,171 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2009-08-27 12:10:04,171 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 0 files left. 2009-08-27 12:10:04,172 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 4 files left. 2009-08-27 12:10:04,197 INFO org.apache.hadoop.mapred.Merger: Merging 4 sorted segments 2009-08-27 12:10:04,197 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 4 segments left of total size: 13139424 bytes 2009-08-27 12:10:04,203 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new compressor 2009-08-27 12:10:06,695 INFO org.apache.hadoop.mapred.ReduceTask: Merged 4 segments, 13139424 bytes to disk to satisfy reduce memory limit 2009-08-27 12:10:06,696 INFO org.apache.hadoop.mapred.ReduceTask: Merging 1 files, 2952848 bytes from disk 2009-08-27 12:10:06,696 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce 2009-08-27 12:10:06,696 INFO org.apache.hadoop.mapred.Merger: Merging 1 sorted segments 2009-08-27 12:10:06,699 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 12:10:06,700 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 2952844 bytes 2009-08-27 12:10:08,087 INFO org.apache.hadoop.mapred.TaskRunner: Task:attempt_200908262019_0014_r_000000_0 is done. And is in the process of commiting 2009-08-27 12:10:09,092 INFO org.apache.hadoop.mapred.TaskRunner: Task attempt_200908262019_0014_r_000000_0 is allowed to commit now 2009-08-27 12:10:09,102 INFO org.apache.hadoop.mapred.FileOutputCommitter: Saved output of task 'attempt_200908262019_0014_r_000000_0' to hdfs://asterix-010:9000/data/tokens.10.phase1 2009-08-27 12:10:09,104 INFO org.apache.hadoop.mapred.TaskRunner: Task 'attempt_200908262019_0014_r_000000_0' done.
2009-08-27 10:49:22,758 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=SHUFFLE, sessionId= 2009-08-27 10:49:22,883 INFO org.apache.hadoop.mapred.ReduceTask: ShuffleRamManager: MemoryLimit=1932584576, MaxSingleShuffleLimit=483146144 2009-08-27 10:49:22,890 INFO org.apache.hadoop.util.NativeCodeLoader: Loaded the native-hadoop library 2009-08-27 10:49:22,892 INFO org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 2009-08-27 10:49:22,893 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 10:49:22,893 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 10:49:22,893 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 10:49:22,894 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 10:49:22,894 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 10:49:22,897 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread started: Thread for merging on-disk files 2009-08-27 10:49:22,897 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread waiting: Thread for merging on-disk files 2009-08-27 10:49:22,897 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread started: Thread for merging in memory files 2009-08-27 10:49:22,898 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:49:22,901 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:49:22,901 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:50:22,911 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:50:22,911 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:50:22,911 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:51:22,921 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:51:22,923 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:51:22,923 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:52:22,936 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:52:22,937 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:52:22,937 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:53:22,946 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:53:22,947 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:53:22,947 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:54:22,956 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:54:22,957 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:54:22,957 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:55:22,966 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:55:22,967 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:55:22,967 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:56:22,976 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:56:22,977 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:56:22,977 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:57:24,810 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:57:24,810 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:57:24,810 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:58:24,819 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:58:24,820 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:58:24,820 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 10:59:24,828 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 10:59:24,829 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 10:59:24,829 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:00:24,839 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 4 map output(s) where 0 is already in progress 2009-08-27 11:00:24,840 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 11:00:24,840 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:01:04,850 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 1 new map-outputs 2009-08-27 11:01:04,850 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:01:04,920 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 529729988 bytes (127202336 raw bytes) into Local-FS from attempt_200908262019_0011_m_000003_0 2009-08-27 11:01:05,847 INFO org.apache.hadoop.mapred.ReduceTask: Read 127202336 bytes from map-output for attempt_200908262019_0011_m_000003_0 2009-08-27 11:01:05,853 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread waiting: Thread for merging on-disk files 2009-08-27 11:01:17,848 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 1 new map-outputs 2009-08-27 11:01:17,848 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:01:17,854 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 529371749 bytes (127082876 raw bytes) into Local-FS from attempt_200908262019_0011_m_000002_0 2009-08-27 11:01:18,723 INFO org.apache.hadoop.mapred.ReduceTask: Read 127082876 bytes from map-output for attempt_200908262019_0011_m_000002_0 2009-08-27 11:01:18,724 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread waiting: Thread for merging on-disk files 2009-08-27 11:01:24,848 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Need another 2 map output(s) where 0 is already in progress 2009-08-27 11:01:24,849 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 0 new map-outputs 2009-08-27 11:01:24,849 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 0 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:01:39,851 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0: Got 2 new map-outputs 2009-08-27 11:01:39,852 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:01:39,864 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 529471790 bytes (127137196 raw bytes) into Local-FS from attempt_200908262019_0011_m_000000_0 2009-08-27 11:01:40,547 INFO org.apache.hadoop.mapred.ReduceTask: Read 127137196 bytes from map-output for attempt_200908262019_0011_m_000000_0 2009-08-27 11:01:40,548 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread waiting: Thread for merging on-disk files 2009-08-27 11:01:41,851 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Scheduled 1 outputs (0 slow hosts and0 dup hosts) 2009-08-27 11:01:41,856 INFO org.apache.hadoop.mapred.ReduceTask: Shuffling 529535269 bytes (127106164 raw bytes) into Local-FS from attempt_200908262019_0011_m_000001_0 2009-08-27 11:01:42,405 INFO org.apache.hadoop.mapred.ReduceTask: Read 127106164 bytes from map-output for attempt_200908262019_0011_m_000001_0 2009-08-27 11:01:42,406 INFO org.apache.hadoop.mapred.ReduceTask: attempt_200908262019_0011_r_000000_0 Thread waiting: Thread for merging on-disk files 2009-08-27 11:01:42,851 INFO org.apache.hadoop.mapred.ReduceTask: Closed ram manager 2009-08-27 11:01:42,851 INFO org.apache.hadoop.mapred.ReduceTask: Interleaved on-disk merge complete: 4 files left. 2009-08-27 11:01:42,851 INFO org.apache.hadoop.mapred.ReduceTask: In-memory merge complete: 0 files left. 2009-08-27 11:01:42,862 INFO org.apache.hadoop.mapred.ReduceTask: Merging 4 files, 508528572 bytes from disk 2009-08-27 11:01:42,862 INFO org.apache.hadoop.mapred.ReduceTask: Merging 0 segments, 0 bytes from memory into reduce 2009-08-27 11:01:42,866 INFO org.apache.hadoop.mapred.Merger: Merging 4 sorted segments 2009-08-27 11:01:42,873 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 11:01:42,874 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 11:01:42,876 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 11:01:42,876 INFO org.apache.hadoop.io.compress.CodecPool: Got brand-new decompressor 2009-08-27 11:01:42,877 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 4 segments left of total size: 508528556 bytes 2009-08-27 11:06:06,780 INFO org.apache.hadoop.mapred.TaskRunner: Task:attempt_200908262019_0011_r_000000_0 is done. And is in the process of commiting 2009-08-27 11:06:07,793 INFO org.apache.hadoop.mapred.TaskRunner: Task attempt_200908262019_0011_r_000000_0 is allowed to commit now 2009-08-27 11:06:07,840 INFO org.apache.hadoop.mapred.FileOutputCommitter: Saved output of task 'attempt_200908262019_0011_r_000000_0' to hdfs://asterix-010:9000/data/ridpairs.10 2009-08-27 11:06:07,841 INFO org.apache.hadoop.mapred.TaskRunner: Task 'attempt_200908262019_0011_r_000000_0' done.
