[
https://issues.apache.org/jira/browse/HADOOP-1716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Owen O'Malley updated HADOOP-1716:
----------------------------------
Attachment: fix-test-pipes.patch
This patch fixes the wordcount-nonpipe example and the TestPipes code to deal
with the fact that the input and output paths now include schemas. Clearly they
need to be removed before they are passed to the C++ file utils. *smile*
> TestPipes.testPipes fails
> -------------------------
>
> Key: HADOOP-1716
> URL: https://issues.apache.org/jira/browse/HADOOP-1716
> Project: Hadoop
> Issue Type: Bug
> Components: pipes
> Affects Versions: 0.14.0
> Reporter: Nigel Daley
> Assignee: Owen O'Malley
> Priority: Blocker
> Fix For: 0.14.0
>
> Attachments: fix-test-pipes.patch
>
>
> I recently started running the unit tests with -Dcompile.c++=yes so that
> pipes is compiled and it's unit tests are run.
> TestPipes.testPipes consistently fails on Linux with
> junit.framework.AssertionFailedError: got exception: java.io.IOException: Job
> failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:625)
> at
> org.apache.hadoop.mapred.pipes.Submitter.submitJob(Submitter.java:250)
> at org.apache.hadoop.mapred.pipes.Submitter.main(Submitter.java:404)
> at
> org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:173)
> at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)
> at
> org.apache.hadoop.mapred.pipes.TestPipes.runNonPipedProgram(TestPipes.java:180)
> at org.apache.hadoop.mapred.pipes.TestPipes.testPipes(TestPipes.java:69)
> which is perhaps caused by
> 2007-08-14 02:10:18,831 INFO mapred.TaskRunner
> (ReduceTaskRunner.java:close(45)) - task_200708140209_0003_r_000000_0 done;
> removing files.
> 2007-08-14 02:10:18,841 INFO mapred.TaskInProgress
> (TaskInProgress.java:updateStatus(371)) - Error from
> task_200708140209_0003_r_000000_0: java.io.IOException: pipe child exception
> at
> org.apache.hadoop.mapred.pipes.Application.abort(Application.java:130)
> at
> org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:103)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:328)
> at
> org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1778)
> Caused by: java.net.SocketException: Broken pipe
> at java.net.SocketOutputStream.socketWrite0(Native Method)
> at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
> at java.net.SocketOutputStream.write(SocketOutputStream.java:115)
> at java.io.DataOutputStream.writeByte(DataOutputStream.java:136)
> at org.apache.hadoop.io.WritableUtils.writeVLong(WritableUtils.java:278)
> at org.apache.hadoop.io.WritableUtils.writeVInt(WritableUtils.java:258)
> at
> org.apache.hadoop.mapred.pipes.BinaryProtocol.close(BinaryProtocol.java:281)
> at
> org.apache.hadoop.mapred.pipes.PipesReducer.close(PipesReducer.java:95)
> ... 2 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
