[jira] [Commented] (YARN-1899) Capacity Scheduler Usage History
[ https://issues.apache.org/jira/browse/YARN-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14523750#comment-14523750 ] Xuan Gong commented on YARN-1899: - Close this ticket since YARN-415 has been committed. [~yihyoon] Feel free to re-open it if you think that we still need this feature. > Capacity Scheduler Usage History > > > Key: YARN-1899 > URL: https://issues.apache.org/jira/browse/YARN-1899 > Project: Hadoop YARN > Issue Type: Wish > Components: capacityscheduler >Affects Versions: 2.1.0-beta >Reporter: Yih-Yoon Lee > > Currently Resource Manager UI provides a nice overview of Capacity Scheduler > configuration in http://localhost:8088/cluster/scheduler. If we can capture a > history of the data provided in "application queues" section, it would be > helpful for administrator to review each queue usage history and tune > accordingly. Since the data is already being captured to display "real time", > perhaps the data can be kept in Ganglia. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-1899) Capacity Scheduler Usage History
[ https://issues.apache.org/jira/browse/YARN-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991062#comment-13991062 ] Sandy Ryza commented on YARN-1899: -- By "megabyte-seconds" and "vcore-seconds", do you mean the counters that show up for MapReduce jobs? We have this for MapReduce, but don't yet have a generic solution for all YARN apps. > Capacity Scheduler Usage History > > > Key: YARN-1899 > URL: https://issues.apache.org/jira/browse/YARN-1899 > Project: Hadoop YARN > Issue Type: Wish > Components: capacityscheduler >Affects Versions: 2.1.0-beta >Reporter: Yih-Yoon Lee > > Currently Resource Manager UI provides a nice overview of Capacity Scheduler > configuration in http://localhost:8088/cluster/scheduler. If we can capture a > history of the data provided in "application queues" section, it would be > helpful for administrator to review each queue usage history and tune > accordingly. Since the data is already being captured to display "real time", > perhaps the data can be kept in Ganglia. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1899) Capacity Scheduler Usage History
[ https://issues.apache.org/jira/browse/YARN-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990863#comment-13990863 ] Hars Vardhan commented on YARN-1899: +1 for this feature, similar feature can be added to Fair-Share as well. [~sandyr] I see the "megabyte-seconds" and "vcore-seconds" information have been reported after job finishes. Can you please give pointer if we can get Usage history as well? > Capacity Scheduler Usage History > > > Key: YARN-1899 > URL: https://issues.apache.org/jira/browse/YARN-1899 > Project: Hadoop YARN > Issue Type: Wish > Components: capacityscheduler >Affects Versions: 2.1.0-beta >Reporter: Yih-Yoon Lee > > Currently Resource Manager UI provides a nice overview of Capacity Scheduler > configuration in http://localhost:8088/cluster/scheduler. If we can capture a > history of the data provided in "application queues" section, it would be > helpful for administrator to review each queue usage history and tune > accordingly. Since the data is already being captured to display "real time", > perhaps the data can be kept in Ganglia. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (YARN-1899) Capacity Scheduler Usage History
[ https://issues.apache.org/jira/browse/YARN-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13957854#comment-13957854 ] Sandy Ryza commented on YARN-1899: -- This may be a duplicate of, or related to YARN-415, which proposes capturing utilization information for chargeback. > Capacity Scheduler Usage History > > > Key: YARN-1899 > URL: https://issues.apache.org/jira/browse/YARN-1899 > Project: Hadoop YARN > Issue Type: Wish > Components: capacityscheduler >Affects Versions: 2.1.0-beta >Reporter: Yih-Yoon Lee > > Currently Resource Manager UI provides a nice overview of Capacity Scheduler > configuration in http://localhost:8088/cluster/scheduler. If we can capture a > history of the data provided in "application queues" section, it would be > helpful for administrator to review each queue usage history and tune > accordingly. Since the data is already being captured to display "real time", > perhaps the data can be kept in Ganglia. -- This message was sent by Atlassian JIRA (v6.2#6252)
