I'm having a problem when running larger sized jobs with hadoop streaming. Small jobs (100MB or so of data) work fine. Larger jobs (60GB) complete the map to 100% and then die with no error message in the UI. Looking into the taskrunner log this is what I see: Any ideas what is going on? It's not the disk space. 2007-08-29 14:30:44,524 INFO org.apache.hadoop.mapred.TaskRunner: task_200708291152_0001_m_000325_0 done; removing files.
2007-08-29 14:30:44,588 INFO org.apache.hadoop.mapred.TaskRunner: task_200708291152_0001_m_000596_0 done; removing files. 2007-08-29 14:30:44,655 INFO org.apache.hadoop.mapred.TaskRunner: task_200708291152_0001_m_000643_0 done; removing files. 2007-08-29 14:30:44,761 INFO org.apache.hadoop.mapred.TaskRunner: task_200708291152_0001_m_000688_0 done; removing files. 2007-08-29 14:30:44,882 WARN org.apache.hadoop.mapred.TaskTracker: Unknown child task finshed: task_200708291152_0001_r_000000_0. Ignored. 2007-08-29 14:30:44,914 WARN org.apache.hadoop.ipc.Server: IPC Server handler 0 on 50050, call getMapCompletionEvents(job_200708291152_0001, 737, 50) from 10.50.40.102:49387: output error java.nio.channels.ClosedChannelException at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:125) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:294) at org.apache.hadoop.ipc.SocketChannelOutputStream.flushBuffer(SocketChannelOut putStream.java:108) at org.apache.hadoop.ipc.SocketChannelOutputStream.write(SocketChannelOutputStr eam.java:89) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65) at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123) at java.io.DataOutputStream.flush(DataOutputStream.java:106) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:585) 2007-08-29 14:30:44,916 WARN org.apache.hadoop.ipc.Server: IPC Server handler 1 on 50050, call ping(task_200708291152_0001_r_000000_0) from 10.50.40.102:49387: output error java.nio.channels.ClosedChannelException at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(SocketChannelImpl.java:125) at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:294) at org.apache.hadoop.ipc.SocketChannelOutputStream.flushBuffer(SocketChannelOut putStream.java:108) at org.apache.hadoop.ipc.SocketChannelOutputStream.write(SocketChannelOutputStr eam.java:89) at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65) at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123) at java.io.DataOutputStream.flush(DataOutputStream.java:106) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:585
