[
https://issues.apache.org/jira/browse/HADOOP-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rick Cox updated HADOOP-5623:
-----------------------------
Attachment: HADOOP-5623-streaming-status.patch
This patch calls reporter.progress() instead of reporter.setStatus("Records
R/W...") in the case where the streaming process has provided a status message.
It also adds a test case for the "reporter:status:" syntax, which covers this
problem since the test task writes the status before writing the first line of
output, so without this patch, the status is immediately overwritten:
[junit] Running org.apache.hadoop.streaming.TestStreamingStatus
[junit] Tests run: 1, Failures: 0, Errors: 0, Time elapsed: 19.121 sec
ant test-patch indicates an eclipse classpath change, which I don't understand:
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 6 new or
modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning
messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number
of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs
warnings.
[exec]
[exec] -1 Eclipse classpath. The patch causes the Eclipse classpath to
differ from the contents of the lib directories.
[exec]
[exec] +1 release audit. The applied patch does not increase the
total number of release audit warnings.
[exec]
[exec]
> Streaming: process provided status messages are overwritten every 10 seoncds
> ----------------------------------------------------------------------------
>
> Key: HADOOP-5623
> URL: https://issues.apache.org/jira/browse/HADOOP-5623
> Project: Hadoop Core
> Issue Type: Bug
> Components: contrib/streaming
> Affects Versions: 0.19.0, 0.19.1
> Reporter: Rick Cox
> Assignee: Rick Cox
> Attachments: HADOOP-5623-streaming-status.patch
>
>
> Every 10 seconds (if the streaming process is producing output key/values on
> stdout), PipeMapRed sets the task's status string to "Records R/W=N/N". This
> replaces any custom task status that the streaming process may have specified
> using the "reporter:status:" stderr lines.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
