[jira] [Commented] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193754#comment-17193754 ] Hadoop QA commented on YARN-10421: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390.002.patch > LeafQueue: retain user limits cache across assignContainers() calls

[jira] [Created] (YARN-10435) Upgrade ember 2.x to ember 3.20

2020-09-10 Thread Akhil PB (Jira)
Akhil PB created YARN-10435: --- Summary: Upgrade ember 2.x to ember 3.20 Key: YARN-10435 URL: https://issues.apache.org/jira/browse/YARN-10435 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193731#comment-17193731 ] Eric Payne commented on YARN-10390: --- Uploaded patch to kick pre-commit build so we can have a record in

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193762#comment-17193762 ] Hadoop QA commented on YARN-9333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193817#comment-17193817 ] Hadoop QA commented on YARN-10390: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390-branch-3.1.002.patch > LeafQueue: retain user limits cache across

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193841#comment-17193841 ] Eric Payne commented on YARN-10390: --- Uploaded branch-3.2 patch because of merge conflicts in unit

[jira] [Updated] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-10390: -- Attachment: YARN-10390-branch-3.2.002.patch > LeafQueue: retain user limits cache across

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193833#comment-17193833 ] Eric Payne commented on YARN-10390: --- Unit test failure for {{TestFairSchedulerPreemption}} is the same

[jira] [Updated] (YARN-8210) AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs

2020-09-10 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8210: Fix Version/s: 2.10.2 Pushed to branch-2.10. > AMRMClient logging on every heartbeat to track

[jira] [Updated] (YARN-8210) AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs

2020-09-10 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8210: Fix Version/s: (was: 2.10.2) 2.10.1 > AMRMClient logging on every heartbeat

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193963#comment-17193963 ] Hadoop QA commented on YARN-10390: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10393) MR job live lock caused by completed state container leak in heartbeat between node manager and RM

2020-09-10 Thread Yuanbo Liu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated YARN-10393: -- Attachment: YARN-10393.draft.patch > MR job live lock caused by completed state container leak in

[jira] [Commented] (YARN-10393) MR job live lock caused by completed state container leak in heartbeat between node manager and RM

2020-09-10 Thread Yuanbo Liu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193975#comment-17193975 ] Yuanbo Liu commented on YARN-10393: --- Also, we should avoid adding new container to the same heartBeat

[jira] [Commented] (YARN-10390) LeafQueue: retain user limits cache across assignContainers() calls

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193888#comment-17193888 ] Hadoop QA commented on YARN-10390: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

Re: The auxService:mapreduce_shuffle does not exist

2020-09-10 Thread bilwa st
Hi Sitakant, Have you added below configuration in your setup? yarn.nodemanager.aux-services.mapreduce_shuffle.class org.apache.hadoop.mapred.ShuffleHandler You can refer this link

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193545#comment-17193545 ] Hadoop QA commented on YARN-9333: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10421) Create YarnDiagnosticsServlet to serve diagnostic queries

2020-09-10 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10421: - Attachment: YARN-10421.001.patch > Create YarnDiagnosticsServlet to serve diagnostic queries >

[jira] [Created] (YARN-10431) [Umbrella] Job group management

2020-09-10 Thread jialei weng (Jira)
jialei weng created YARN-10431: -- Summary: [Umbrella] Job group management Key: YARN-10431 URL: https://issues.apache.org/jira/browse/YARN-10431 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193456#comment-17193456 ] Peter Bacsko commented on YARN-9333: Ehhh, guess it didn't work :( I'm uploading a debug patch to see

[jira] [Updated] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9333: --- Attachment: YARN-9333-debug1.patch >

[jira] [Commented] (YARN-10368) Log aggregation reset to NOT_START after RM restart.

2020-09-10 Thread Anuj (Jira)
[ https://issues.apache.org/jira/browse/YARN-10368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193663#comment-17193663 ] Anuj commented on YARN-10368: - [~Amithsha] we have modified yarn code to ignore the log aggregation status

[jira] [Updated] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-09-10 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10421: - Description: YarnDiagnosticsServlet should run inside ResourceManager Daemon. The servlet forks

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193646#comment-17193646 ] Hadoop QA commented on YARN-9333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193655#comment-17193655 ] Hadoop QA commented on YARN-9333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9333: --- Attachment: YARN-9333-003.patch >

[jira] [Created] (YARN-10432) Introduce the necessary configuration entries to YARN

2020-09-10 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10432: Summary: Introduce the necessary configuration entries to YARN Key: YARN-10432 URL: https://issues.apache.org/jira/browse/YARN-10432 Project: Hadoop YARN

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193633#comment-17193633 ] Hadoop QA commented on YARN-9333: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-09-10 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10421: - Summary: Create YarnDiagnosticsService to serve diagnostic queries (was: Create

[jira] [Commented] (YARN-9333) TestFairSchedulerPreemption.testRelaxLocalityPreemptionWithNoLessAMInRemainingNodes fails intermittent

2020-09-10 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17193660#comment-17193660 ] Peter Bacsko commented on YARN-9333: OK, from what I understand , {{SchedulerUpdateThread}} sometimes

[jira] [Created] (YARN-10433) Extend the DiagnosticService to initiate the diagnostic bundle collection

2020-09-10 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10433: Summary: Extend the DiagnosticService to initiate the diagnostic bundle collection Key: YARN-10433 URL: https://issues.apache.org/jira/browse/YARN-10433 Project:

[jira] [Created] (YARN-10434) Create extensive unittests under RMWebServices for the diagnostic functionality

2020-09-10 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10434: Summary: Create extensive unittests under RMWebServices for the diagnostic functionality Key: YARN-10434 URL: https://issues.apache.org/jira/browse/YARN-10434