[jira] [Commented] (YARN-10309) Dump scheduler and queue state information into CapacityScheduler statedump

2020-06-15 Thread Prabhu Joseph (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136275#comment-17136275
 ] 

Prabhu Joseph commented on YARN-10309:
--

Thanks [~gandras] for the patch.

1. Why we need a separate StateDump if most of the metrics are already exposed 
via RMWebService /ws/v1/cluster/scheduler. Sorry, did not think about this when 
raising the Jira. It is unnecessary effort to maintain the metrics at both the 
places.

Most of the useful metrics are already captured in scheduler response, it is 
better to add missing ones into the same instead of rewriting a new one. Thanks.






> Dump scheduler and queue state information into CapacityScheduler statedump 
> 
>
> Key: YARN-10309
> URL: https://issues.apache.org/jira/browse/YARN-10309
> Project: Hadoop YARN
>  Issue Type: Improvement
>  Components: capacityscheduler
>Reporter: Prabhu Joseph
>Assignee: Andras Gyori
>Priority: Major
> Attachments: YARN-10309.001.patch
>
>
> CapacityScheduler dump with Scheduler, FiCaSchedulerNode, FiCaSchedulerApp, 
> ParentQueue, LeafQueue, app and queue level ordering, multi node lookup 
> ordering details will make it ease to debug scheduler related issues instead 
> of correlating Debug Logs with CapacityScheduler code to get values for the 
> above.
> This is similar to FairScheduler statedump YARN-6042.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-10309) Dump scheduler and queue state information into CapacityScheduler statedump

2020-06-15 Thread Andras Gyori (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17135896#comment-17135896
 ] 

Andras Gyori commented on YARN-10309:
-

Uploaded a draft patch of this feature. Waiting for further input to extend it 
with additional informations.

> Dump scheduler and queue state information into CapacityScheduler statedump 
> 
>
> Key: YARN-10309
> URL: https://issues.apache.org/jira/browse/YARN-10309
> Project: Hadoop YARN
>  Issue Type: Improvement
>  Components: capacityscheduler
>Reporter: Prabhu Joseph
>Assignee: Andras Gyori
>Priority: Major
> Attachments: YARN-10309.001.patch
>
>
> CapacityScheduler dump with Scheduler, FiCaSchedulerNode, FiCaSchedulerApp, 
> ParentQueue, LeafQueue, app and queue level ordering, multi node lookup 
> ordering details will make it ease to debug scheduler related issues instead 
> of correlating Debug Logs with CapacityScheduler code to get values for the 
> above.
> This is similar to FairScheduler statedump YARN-6042.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-10309) Dump scheduler and queue state information into CapacityScheduler statedump

2020-06-08 Thread Andras Gyori (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-10309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128263#comment-17128263
 ] 

Andras Gyori commented on YARN-10309:
-

I have started working on COMPX-2753, though its scope is a bit narrower. 
Should I close that one?

> Dump scheduler and queue state information into CapacityScheduler statedump 
> 
>
> Key: YARN-10309
> URL: https://issues.apache.org/jira/browse/YARN-10309
> Project: Hadoop YARN
>  Issue Type: Improvement
>  Components: capacityscheduler
>Reporter: Prabhu Joseph
>Assignee: Prabhu Joseph
>Priority: Major
>
> CapacityScheduler dump with Scheduler, FiCaSchedulerNode, FiCaSchedulerApp, 
> ParentQueue, LeafQueue, app and queue level ordering, multi node lookup 
> ordering details will make it ease to debug scheduler related issues instead 
> of correlating Debug Logs with CapacityScheduler code to get values for the 
> above.
> This is similar to FairScheduler statedump YARN-6042.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org