[jira] [Updated] (YARN-7265) Hadoop Server Log Correlation
[ https://issues.apache.org/jira/browse/YARN-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated YARN-7265: --- Description: Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs.. There are also a lot of different ways can be used to expose the logs, build relationship horizontally to correlate the logs or search the logs by keyword. There is a need for a default and yet convenient logging analytics mechanism in Hadoop itself that at least covers all the server logs of Hadoop. This log analytics system can correlate the Hadoop server logs by grouping them by various dimensions including application ID, task ID, job ID or node ID etc. The raw logs with correlation can be easily accessed by the application developer or cluster administrator via web page for managing and debugging. (was: Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs.. There are also a lot of different ways can be used to expose the logs, build relationship horizontally to correlate the logs or search the logs by keyword. There is a need for a default and yet convenient logging analytics mechanism in Hadoop itself that at least covers all the server logs of Hadoop. This log analytics system can correlate the Hadoop server logs by grouping them by various dimensions including task number, job number or node number etc. The raw logs with correlation can be easily accessed by the application developer or cluster administrator via web page for managing and debugging.) > Hadoop Server Log Correlation > --- > > Key: YARN-7265 > URL: https://issues.apache.org/jira/browse/YARN-7265 > Project: Hadoop YARN > Issue Type: Wish > Components: log-aggregation >Reporter: Tanping Wang > > Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs.. > There are also a lot of different ways can be used to expose the logs, build > relationship horizontally to correlate the logs or search the logs by > keyword. There is a need for a default and yet convenient logging analytics > mechanism in Hadoop itself that at least covers all the server logs of > Hadoop. This log analytics system can correlate the Hadoop server logs by > grouping them by various dimensions including application ID, task ID, job > ID or node ID etc. The raw logs with correlation can be easily accessed by > the application developer or cluster administrator via web page for managing > and debugging. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Updated] (YARN-7265) Hadoop Server Log Correlation
[ https://issues.apache.org/jira/browse/YARN-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanping Wang updated YARN-7265: --- Description: Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs.. There are also a lot of different ways can be used to expose the logs, build relationship horizontally to correlate the logs or search the logs by keyword. There is a need for a default and yet convenient logging analytics mechanism in Hadoop itself that at least covers all the server logs of Hadoop. This log analytics system can correlate the Hadoop server logs by grouping them by various dimensions including task number, job number or node number etc. The raw logs with correlation can be easily accessed by the application developer or cluster administrator via web page for managing and debugging. (was: Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs.. There are also a lot of different ways can be used to expose the logs, build relationship horizontally to correlate the logs or search the logs by keyword. There is a need for a default and yet convenient logging analytics mechanism in Hadoop itself that at least covers all the server logs of Hadoop. This log analytics system can correlate the Hadoop server logs by grouping them by various dimensions including task number, job number or node number etc. The raw logs with correlation can be easily accessed by the application developer or cluster administrator.) > Hadoop Server Log Correlation > --- > > Key: YARN-7265 > URL: https://issues.apache.org/jira/browse/YARN-7265 > Project: Hadoop YARN > Issue Type: Wish > Components: log-aggregation >Reporter: Tanping Wang > > Hadoop has many server logs, yarn tasks logs, node manager logs, HDFS logs.. > There are also a lot of different ways can be used to expose the logs, build > relationship horizontally to correlate the logs or search the logs by > keyword. There is a need for a default and yet convenient logging analytics > mechanism in Hadoop itself that at least covers all the server logs of > Hadoop. This log analytics system can correlate the Hadoop server logs by > grouping them by various dimensions including task number, job number or node > number etc. The raw logs with correlation can be easily accessed by the > application developer or cluster administrator via web page for managing and > debugging. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
