[
https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16905471#comment-16905471
]
Eric Payne commented on YARN-6492:
----------------------------------
Thanks for the updated patch [[email protected]].
I feel like this JIRA is becoming a little too big and unwieldy. I think there
are 2 major objectives that should be separated into separate JIRAs.
First, I think this JIRA should be focused on adding per-queue/per-partition
metrics to the JMX REST interface ({{/jmx?qry=Hadoop:*}}).
Second, I think separate JIRA(s) should be used / opened for fixing incorrect
metrics when labels are used.
My reason for wanting to split these apart is that the CapacityScheduler
metrics API ({{/ws/v1/cluster/scheduler}}) already has sections for labeled
metrics (in the "...ByPartition" sections). I believe that this JIRA should
focus on making the partition-specific sections in the JMX output consistent
with that in the CS metrics API. Then, once they are consistent, we can focus
on making all of the existing fields accurate through other JIRAs.
Thoughts?
> Generate queue metrics for each partition
> -----------------------------------------
>
> Key: YARN-6492
> URL: https://issues.apache.org/jira/browse/YARN-6492
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: capacity scheduler
> Reporter: Jonathan Hung
> Assignee: Manikandan R
> Priority: Major
> Attachments: PartitionQueueMetrics_default_partition.txt,
> PartitionQueueMetrics_x_partition.txt, PartitionQueueMetrics_y_partition.txt,
> YARN-6492.001.patch, YARN-6492.002.patch, YARN-6492.003.patch,
> YARN-6492.004.patch, YARN-6492.005.WIP.patch, partition_metrics.txt
>
>
> We are interested in having queue metrics for all partitions. Right now each
> queue has one QueueMetrics object which captures metrics either in default
> partition or across all partitions. (After YARN-6467 it will be in default
> partition)
> But having the partition metrics would be very useful.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
