[
https://issues.apache.org/jira/browse/YARN-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190236#comment-16190236
]
Tanping Wang commented on YARN-7265:
------------------------------------
[~jlowe] What the application developers need is a free yet default way of
grabbing all the yarn logs, for example. Certainly there could be scripts
build to grab the logs, but Hadoop should contain a tool set that provides all
the yarn logs related with one job. This does not include any other Hadoop
services like Hive, Pig or Oozie, but just Hadoop itself.
> Hadoop Server Log Correlation
> -------------------------------
>
> Key: YARN-7265
> URL: https://issues.apache.org/jira/browse/YARN-7265
> Project: Hadoop YARN
> Issue Type: Wish
> Components: log-aggregation
> Reporter: Tanping Wang
>
> Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs..
> There are also a lot of different ways can be used to expose the logs, build
> relationship horizontally to correlate the logs or search the logs by
> keyword. There is a need for a default and yet convenient logging analytics
> mechanism in Hadoop itself that at least covers all the server logs of
> Hadoop. This log analytics system can correlate the Hadoop server logs by
> grouping them by various dimensions including application ID, task ID, job
> ID or node ID etc. The raw logs with correlation can be easily accessed by
> the application developer or cluster administrator via web page for managing
> and debugging.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
