[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298069#comment-17298069 ] Peter Bacsko commented on YARN-9615: +1 I had to commit twice because there are actually two authors.

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298068#comment-17298068 ] Peter Bacsko commented on YARN-9615: Thanks [~zhuqi] patch v11 looks good, committing it soon. > Add

[jira] [Commented] (YARN-10679) Better logging of uncaught exceptions throughout SLS

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298064#comment-17298064 ] Peter Bacsko commented on YARN-10679: - +1 thanks [~snemeth] for the patch and [~shuzirra] for the

[jira] [Commented] (YARN-10679) Better logging of uncaught exceptions throughout SLS

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298062#comment-17298062 ] Peter Bacsko commented on YARN-10679: - Ok, this time the failed test is different, most likely a

[jira] [Commented] (YARN-10679) Better logging of uncaught exceptions throughout SLS

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298057#comment-17298057 ] Peter Bacsko commented on YARN-10679: - Re-triggered build to see what's going on with TestSLSRunner.

[jira] [Commented] (YARN-10681) Fix assertion failure message in BaseSLSRunnerTest

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298041#comment-17298041 ] Peter Bacsko commented on YARN-10681: - +1 thanks [~snemeth] and [~shuzirra] for the patch and review,

[jira] [Commented] (YARN-10677) Logger of SLSFairScheduler is provided with the wrong class

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298031#comment-17298031 ] Peter Bacsko commented on YARN-10677: - +1 LGTM. Thanks [~snemeth] for the patch and [~zhuqi] for the

[jira] [Commented] (YARN-10678) Try blocks without catch blocks in SLS scheduler classes can swallow other exceptions

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298010#comment-17298010 ] Peter Bacsko commented on YARN-10678: - +1 thanks [~snemeth] for the patch and [~shuzirra] for the

[jira] [Commented] (YARN-10677) Logger of SLSFairScheduler is provided with the wrong class

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298007#comment-17298007 ] Peter Bacsko commented on YARN-10677: - [~snemeth] please fix the whitespace and checkstyle, thanks.

[jira] [Commented] (YARN-10675) Consolidate YARN-10672 and YARN-10447

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297998#comment-17297998 ] Peter Bacsko commented on YARN-10675: - +1 LGTM. Thanks [~snemeth] for the patch, committed to trunk.

[jira] [Commented] (YARN-10676) Improve code quality in TestTimelineAuthenticationFilterForV1

2021-03-09 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297996#comment-17297996 ] Peter Bacsko commented on YARN-10676: - +1 thanks [~snemeth] for the patch and [~bteke] / [~zhuqi] /

[jira] [Comment Edited] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297642#comment-17297642 ] Peter Bacsko edited comment on YARN-10178 at 3/8/21, 6:54 PM: -- [~zhuqi] this

[jira] [Commented] (YARN-10178) Global Scheduler async thread crash caused by 'Comparison method violates its general contract'

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297642#comment-17297642 ] Peter Bacsko commented on YARN-10178: - [~zhuqi] this is a tricky patch, I have to understand what's

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297504#comment-17297504 ] Peter Bacsko commented on YARN-9615: Let's wait for the Jenkins results of patch v10. > Add

[jira] [Updated] (YARN-10672) All testcases in TestReservations are flaky

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10672: Fix Version/s: 3.2.3 3.3.1 > All testcases in TestReservations are flaky >

[jira] [Commented] (YARN-10672) All testcases in TestReservations are flaky

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297358#comment-17297358 ] Peter Bacsko commented on YARN-10672: - +1 overall. Committed changes to branch-3.2 too. Thanks

[jira] [Commented] (YARN-10672) All testcases in TestReservations are flaky

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297345#comment-17297345 ] Peter Bacsko commented on YARN-10672: - Ok, test failures seem to be totally unrelated. The change

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Fix Version/s: 3.2.3 > Race condition: AsyncDispatcher can get stuck by the changes introduced in

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297343#comment-17297343 ] Peter Bacsko commented on YARN-10642: - Ok, pushed to branch-3.2 as well. Thanks for the patch

[jira] [Comment Edited] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297343#comment-17297343 ] Peter Bacsko edited comment on YARN-10642 at 3/8/21, 1:24 PM: -- +1 Ok, pushed

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297311#comment-17297311 ] Peter Bacsko commented on YARN-9615: [~zhuqi] could you investigate the failing unit tests? Something

[jira] [Updated] (YARN-10674) fs2cs: should support auto created queue deletion.

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10674: Labels: fs2cs (was: ) > fs2cs: should support auto created queue deletion. >

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297302#comment-17297302 ] Peter Bacsko commented on YARN-10642: - Committed patch to branch-3.3, waiting for Jenkins results

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Fix Version/s: 3.3.1 > Race condition: AsyncDispatcher can get stuck by the changes introduced in

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297298#comment-17297298 ] Peter Bacsko commented on YARN-10642: - Uploaded v2 for branch-3.2, the original patch doesn't compile

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Attachment: YARN-10642-branch-3.2.002.patch > Race condition: AsyncDispatcher can get stuck by the

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Attachment: YARN-10642-branch-3.2.001.patch > Race condition: AsyncDispatcher can get stuck by the

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Attachment: (was: YARN-10642-branch-3.2.001.patch) > Race condition: AsyncDispatcher can get

[jira] [Commented] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17297284#comment-17297284 ] Peter Bacsko commented on YARN-10658: - +1 Thanks [~zhuqi] for the patch. Committed to trunk. >

[jira] [Updated] (YARN-10672) All testcases in TestReservations are flaky

2021-03-08 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10672: Attachment: YARN-10672.branch-3.2.001.patch > All testcases in TestReservations are flaky >

[jira] [Updated] (YARN-10672) All testcases in TestReservations are flaky

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10672: Fix Version/s: 3.4.0 > All testcases in TestReservations are flaky >

[jira] [Commented] (YARN-10672) All testcases in TestReservations are flaky

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296362#comment-17296362 ] Peter Bacsko commented on YARN-10672: - +1 LGTM. Thanks [~snemeth], committed to trunk. You might

[jira] [Commented] (YARN-10658) CapacityScheduler QueueInfo add queue path field to avoid ambiguous QueueName.

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296198#comment-17296198 ] Peter Bacsko commented on YARN-10658: - [~zhuqi] please fix the remaining checkstyle issues, except

[jira] [Resolved] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-8786. Resolution: Fixed > LinuxContainerExecutor fails sporadically in create_local_dirs >

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296067#comment-17296067 ] Peter Bacsko commented on YARN-10640: - Thanks [~zhuqi] for the patch and [~gandras] + [~bteke] for

[jira] [Commented] (YARN-10221) Nodemanager lockups on printEventQueueDetails

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296035#comment-17296035 ] Peter Bacsko commented on YARN-10221: - [~jonbender-stripe] although this ticket was filed first, the

[jira] [Comment Edited] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296034#comment-17296034 ] Peter Bacsko edited comment on YARN-8786 at 3/5/21, 2:14 PM: - [~jlowe]

[jira] [Commented] (YARN-8786) LinuxContainerExecutor fails sporadically in create_local_dirs

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-8786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296034#comment-17296034 ] Peter Bacsko commented on YARN-8786: [~jlowe] [~ebadger] [~jonbender-stripe] do we still need this

[jira] [Resolved] (YARN-10643) Fix the race condition introduced by YARN-8995.

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-10643. - Resolution: Duplicate > Fix the race condition introduced by YARN-8995. >

[jira] [Commented] (YARN-10643) Fix the race condition introduced by YARN-8995.

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296016#comment-17296016 ] Peter Bacsko commented on YARN-10643: - Hi [~zhengchenyu] / [~zhuqi] does this JIRA add anything new

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Fix Version/s: 3.4.0 > Race condition: AsyncDispatcher can get stuck by the changes introduced in

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296006#comment-17296006 ] Peter Bacsko commented on YARN-10642: - +1 Thanks [~zhengchenyu] for the analysis + patch and

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Summary: Race condition: AsyncDispatcher can get stuck by the changes introduced in YARN-8995

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by YARN-8995

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296002#comment-17296002 ] Peter Bacsko commented on YARN-10642: - I'm going to commit this soon. What's the difference between

[jira] [Commented] (YARN-10642) Race condition: AsyncDispatcher can get stuck by YARN-8995

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296001#comment-17296001 ] Peter Bacsko commented on YARN-10642: - I renamed the title a little bit. [~zhengchenyu] [~zhuqi]

[jira] [Updated] (YARN-10642) Race condition: AsyncDispatcher can get stuck by YARN-8995

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10642: Summary: Race condition: AsyncDispatcher can get stuck by YARN-8995 (was: AsyncDispatcher will

[jira] [Commented] (YARN-10639) Queueinfo related capacity, should adjusted to weight mode.

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295999#comment-17295999 ] Peter Bacsko commented on YARN-10639: - +1 Thanks [~zhuqi] for the patch and [~gandras] for the

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295964#comment-17295964 ] Peter Bacsko edited comment on YARN-10652 at 3/5/21, 10:37 AM: --- Hi guys, I

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295964#comment-17295964 ] Peter Bacsko edited comment on YARN-10652 at 3/5/21, 10:34 AM: --- Hi guys, I

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295964#comment-17295964 ] Peter Bacsko commented on YARN-10652: - Hi guys, I think we can reach compromise: let's think about

[jira] [Comment Edited] (YARN-10672) All testcases in TestReservations are flaky

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295881#comment-17295881 ] Peter Bacsko edited comment on YARN-10672 at 3/5/21, 8:56 AM: -- The solution

[jira] [Commented] (YARN-10672) All testcases in TestReservations are flaky

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295881#comment-17295881 ] Peter Bacsko commented on YARN-10672: - The solution is much straightforward than mine in YARN-10447.

[jira] [Commented] (YARN-10672) All testcases in TestReservations are flaky

2021-03-05 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295875#comment-17295875 ] Peter Bacsko commented on YARN-10672: - It's basically the same as YARN-10447. Must have been a good

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-03-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295519#comment-17295519 ] Peter Bacsko commented on YARN-10640: - I think displaying the "Configured weight" in percentage mode

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-03-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295422#comment-17295422 ] Peter Bacsko commented on YARN-10532: - +1 Thanks [~zhuqi] for the patch and [~gandras] and [~bteke]

[jira] [Commented] (YARN-10642) AsyncDispatcher will stuck introduced by YARN-8995.

2021-03-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295281#comment-17295281 ] Peter Bacsko commented on YARN-10642: - Ah sorry. I didn't look at the assignee properly. Yeah, I

[jira] [Commented] (YARN-10642) AsyncDispatcher will stuck introduced by YARN-8995.

2021-03-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295260#comment-17295260 ] Peter Bacsko commented on YARN-10642: - Ok, I found one minor issue: {{dispatcher.stop();}} -->

[jira] [Commented] (YARN-10642) AsyncDispatcher will stuck introduced by YARN-8995.

2021-03-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295246#comment-17295246 ] Peter Bacsko commented on YARN-10642: - I'm reviewing this patch soon. > AsyncDispatcher will stuck

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-03-04 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295221#comment-17295221 ] Peter Bacsko commented on YARN-10623: - +1 [~zhuqi] thanks for the patch. Also thanks [~shuzirra] for

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-03-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294705#comment-17294705 ] Peter Bacsko commented on YARN-9615: Thanks [~zhuqi] for the patch. Minor things left: 1.

[jira] [Commented] (YARN-10655) Limit queue creation depth relative to its first static parent

2021-03-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294653#comment-17294653 ] Peter Bacsko commented on YARN-10655: - Thanks [~gandras] for the patch and [~zhuqi] for the review.

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-03-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17294643#comment-17294643 ] Peter Bacsko commented on YARN-10640: - [~zhuqi] in the latest patch "Configured weight" is always

[jira] [Commented] (YARN-10655) Limit queue creation depth relative to its first static parent

2021-03-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293128#comment-17293128 ] Peter Bacsko commented on YARN-10655: - I can't really comment on the changes because I'm very

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-03-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293122#comment-17293122 ] Peter Bacsko commented on YARN-10623: - [~zhuqi] thanks, I can see one thing: 

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-03-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293113#comment-17293113 ] Peter Bacsko edited comment on YARN-10532 at 3/1/21, 7:16 PM: -- [~zhuqi] 

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-03-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293113#comment-17293113 ] Peter Bacsko commented on YARN-10532: - [~zhuqi] please fix the things that [~bteke] mentioned and I

[jira] [Commented] (YARN-10658) CapacityScheduler QueueInfo getQueueName should change to queue path to avoid ambiguous QueueName.

2021-03-01 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293110#comment-17293110 ] Peter Bacsko commented on YARN-10658: - Thanks [~zhuqi] for the patch. How is this QueueInfo class

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291919#comment-17291919 ] Peter Bacsko commented on YARN-10627: - Thanks for the patch [~bteke] and [~zhuqi] / [~gandras] for

[jira] [Commented] (YARN-10640) Adjust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291894#comment-17291894 ] Peter Bacsko commented on YARN-10640: - [~zhuqi] thanks for the patch, it's useful. There is one

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291889#comment-17291889 ] Peter Bacsko commented on YARN-10532: - [~zhuqi] I think it's very good now. Maybe I'll check another

[jira] [Commented] (YARN-10656) Parsing error in CapacityScheduler.md

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291886#comment-17291886 ] Peter Bacsko commented on YARN-10656: - Thanks [~aajisaka] for noticing this. I should have tried it

[jira] [Comment Edited] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291728#comment-17291728 ] Peter Bacsko edited comment on YARN-10623 at 2/26/21, 4:10 PM: --- Thanks

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291728#comment-17291728 ] Peter Bacsko commented on YARN-10623: - Thanks [~zhuqi] for the update. I missed a couple of things in

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291718#comment-17291718 ] Peter Bacsko commented on YARN-10627: - Thanks for the patch [~bteke], could you take care of those

[jira] [Comment Edited] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291612#comment-17291612 ] Peter Bacsko edited comment on YARN-10652 at 2/26/21, 12:26 PM: [~sahuja]

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291612#comment-17291612 ] Peter Bacsko commented on YARN-10652: - [~sahuja] you're right in saying that it has no direct

[jira] [Commented] (YARN-10652) Capacity Scheduler fails to handle user weights for a user that has a "." (dot) in it

2021-02-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291572#comment-17291572 ] Peter Bacsko commented on YARN-10652: - "Dot" in the username is clearly a problem. In FS, there is

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-02-25 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290963#comment-17290963 ] Peter Bacsko commented on YARN-9615: Thanks for the patch [~zhuqi]. Some comments: 1.  {noformat}

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290237#comment-17290237 ] Peter Bacsko commented on YARN-9615: Thanks [~zhuqi] for the patch. I'll try to review this tomorrow.

[jira] [Comment Edited] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289968#comment-17289968 ] Peter Bacsko edited comment on YARN-10532 at 2/24/21, 8:12 PM: --- FIRST round

[jira] [Commented] (YARN-10623) Capacity scheduler should support refresh queue automatically by a thread policy.

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290235#comment-17290235 ] Peter Bacsko commented on YARN-10623: - I have some minor comments. 1. {{LOG.info("Auto refreshed

[jira] [Updated] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10609: Hadoop Flags: Reviewed > Update the document for YARN-10531(Be able to disable user limit factor

[jira] [Commented] (YARN-10609) Update the document for YARN-10531(Be able to disable user limit factor for CapacityScheduler Leaf Queue)

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290217#comment-17290217 ] Peter Bacsko commented on YARN-10609: - +1 Thanks [~zhuqi] for the patch and [~bteke] for the review.

[jira] [Commented] (YARN-10532) Capacity Scheduler Auto Queue Creation: Allow auto delete queue when queue is not being used

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289968#comment-17289968 ] Peter Bacsko commented on YARN-10532: - FIRST round review. I might post more but these are that

[jira] [Commented] (YARN-10640) Ajust the queue Configured capacity to Configured weight number for weight mode in UI.

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289929#comment-17289929 ] Peter Bacsko commented on YARN-10640: - [~zhuqi] Thanks for your work. I've just started to review

[jira] [Commented] (YARN-10627) Extend logging to give more information about weight mode

2021-02-24 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17289911#comment-17289911 ] Peter Bacsko commented on YARN-10627: - # Still have 4 checkstyle issues, they're not serious, but if

[jira] [Commented] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288346#comment-17288346 ] Peter Bacsko commented on YARN-10513: - +1 Committed to trunk. Thanks [~gandras] for the patch and

[jira] [Comment Edited] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288341#comment-17288341 ] Peter Bacsko edited comment on YARN-10513 at 2/22/21, 12:01 PM: Patch

[jira] [Commented] (YARN-10513) CS Flexible Auto Queue Creation RM UIv2 modifications

2021-02-22 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288341#comment-17288341 ] Peter Bacsko commented on YARN-10513: - Patch LGTM, although I'm nowhere near a Javascript maestro.

[jira] [Comment Edited] (YARN-10636) CS Auto Queue creation should reject submissions with empty path parts

2021-02-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287065#comment-17287065 ] Peter Bacsko edited comment on YARN-10636 at 2/19/21, 1:00 PM: --- Thanks

[jira] [Commented] (YARN-10636) CS Auto Queue creation should reject submissions with empty path parts

2021-02-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287065#comment-17287065 ] Peter Bacsko commented on YARN-10636: - Thanks [~shuzirra] for the patch and

[jira] [Commented] (YARN-10635) CSMapping rule can return paths with empty parts

2021-02-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287005#comment-17287005 ] Peter Bacsko commented on YARN-10635: - +1 Thanks [~shuzirra] for the patch and [~bteke],

[jira] [Updated] (YARN-10631) Document AM preemption related changes (YARN-9537 and YARN-10625)

2021-02-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10631: Summary: Document AM preemption related changes (YARN-9537 and YARN-10625) (was: Document

[jira] [Created] (YARN-10631) Document AM-preemption related changes (YARN-9537 and YARN-10625)

2021-02-17 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10631: --- Summary: Document AM-preemption related changes (YARN-9537 and YARN-10625) Key: YARN-10631 URL: https://issues.apache.org/jira/browse/YARN-10631 Project: Hadoop YARN

[jira] [Commented] (YARN-10625) FairScheduler: add global flag to disable AM-preemption

2021-02-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284749#comment-17284749 ] Peter Bacsko commented on YARN-10625: - [~bteke] / [~snemeth] please review this patch if you have

[jira] [Updated] (YARN-10625) FairScheduler: add global flag to disable AM-preemption

2021-02-15 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10625: Attachment: YARN-10625-001.patch > FairScheduler: add global flag to disable AM-preemption >

[jira] [Created] (YARN-10625) FairScheduler: add global flag to disable AM-preemption

2021-02-12 Thread Peter Bacsko (Jira)
Peter Bacsko created YARN-10625: --- Summary: FairScheduler: add global flag to disable AM-preemption Key: YARN-10625 URL: https://issues.apache.org/jira/browse/YARN-10625 Project: Hadoop YARN

[jira] [Updated] (YARN-10620) fs2cs: parentQueue for certain placement rules are not set during conversion

2021-02-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10620: Description: There are some placement rules in FS which are currently not handled properly by

[jira] [Commented] (YARN-10620) fs2cs: parentQueue for certain placement rules are not set during conversion

2021-02-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282322#comment-17282322 ] Peter Bacsko commented on YARN-10620: - [~gandras] thanks, I modified the code a little bit, used a

[jira] [Updated] (YARN-10620) fs2cs: parentQueue for certain placement rules are not set during conversion

2021-02-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10620: Attachment: YARN-10620-002.patch > fs2cs: parentQueue for certain placement rules are not set

<    1   2   3   4   5   6   7   8   9   10   >