[
https://issues.apache.org/jira/browse/HADOOP-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tom White updated HADOOP-1328:
------------------------------
Attachment: hadoop-1328.patch
This patch adds support for counters in streaming. Scripts write lines to
standard error of the form:
counter:<group>,<counter>,<amount>
For example, in python you might write
sys.stderr.write("counter:counters,linecount,1\n")
> Hadoop Streaming needs to provide a way for the stream plugin to update
> global counters
> ---------------------------------------------------------------------------------------
>
> Key: HADOOP-1328
> URL: https://issues.apache.org/jira/browse/HADOOP-1328
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/streaming
> Reporter: Runping Qi
> Assignee: Christopher Zimmerman
> Attachments: hadoop-1328.patch
>
>
> Sometimes, the stream plugin may want to create/update its own global
> counters.
> There is no way to do so currently.
> One possible way to enable that is to use the stderr output of the stream
> process.
> The stream process can emit the global counter update information (such as
> GLOCAL_COUNTER COUNTER_NAME NUM)
> to the stderr of the process. The Stderr handling thread can call the global
> counter API whenever it encounters the global counter update information line.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
