[ https://issues.apache.org/jira/browse/YARN-6546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16175225#comment-16175225 ]
Miklos Szegedi commented on YARN-6546: -------------------------------------- Thank you for the patch [~yufeigu]. If I understand well we trace queues from now on, only, when they get an allocation in {{updateQueueMetrics}}. Could we call {{traceQueueIfNotTraced(queueName);}}, when an application is scheduled into the queue? > SLS is slow while loading 10k queues > ------------------------------------ > > Key: YARN-6546 > URL: https://issues.apache.org/jira/browse/YARN-6546 > Project: Hadoop YARN > Issue Type: Sub-task > Components: scheduler-load-simulator > Affects Versions: 3.0.0-alpha2 > Reporter: Yufei Gu > Assignee: Yufei Gu > Attachments: Desktop.png, YARN-6546.001.patch > > > It takes a long time (more than 10 minutes) to load 10k queues in SLS. The > problem should be in {{com.codahale.metrics.CsvReporter}} based on the result > from profiler. SLS creates 14 .csv files for each leaf queue, and update them > constantly during execution. It is not necessary to log information for > inactive queues. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org