Hello everyone,
I'm using hadoop streaming. Getting the following error for 9 reduces
of 32. The tasks are retried by hadoop and everythings fine then.
Do you have an idea, why I'm getting this.
java.io.IOException: subprocess exited with error code 141
R/W/S=237891/234843/0 in:14868=237891/16 [rec/s] out:14677=234843/16 [rec/s]
minRecWrittenToEnableSkip_=9223372036854775807 LOGNAME=null
HOST=null
USER=hd2
HADOOP_USER=null
last Hadoop input: |null|
last tool output: |68064006?838?12?1?+905303343108?9|
Date: Thu Jun 09 01:38:46 EEST 2011
Broken pipe
at org.apache.hadoop.streaming.PipeReducer.reduce(PipeReducer.java:131)
at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:468)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:416)
at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1115)
at org.apache.hadoop.mapred.Child.main(Child.java:262)
