[jira] [Comment Edited] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218198#comment-17218198 ] zhuqi edited comment on YARN-10463 at 10/22/20, 5:50 AM: - Hi [~BilwaST] I have

[jira] [Assigned] (YARN-10178) Global Scheduler asycthread crash caused by 'Comparison method violates its general contract'

2020-10-21 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10178: Assignee: Benjamin Teke > Global Scheduler asycthread crash caused by 'Comparison met

[jira] [Commented] (YARN-10178) Global Scheduler asycthread crash caused by 'Comparison method violates its general contract'

2020-10-21 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218288#comment-17218288 ] Benjamin Teke commented on YARN-10178: -- Thanks [~wangda] for the insights and [~tuyu

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-21 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218227#comment-17218227 ] Hadoop QA commented on YARN-10463: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-21 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218198#comment-17218198 ] zhuqi commented on YARN-10463: -- Hi [~BilwaST] I have fixed your comments in the new patch, but how can we

[jira] [Commented] (YARN-10452) YARN scheduler response returns invalid values for capacity, maxCapacity and absoluteMaxCapacity

2020-10-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217943#comment-17217943 ] Eric Payne commented on YARN-10452: --- Actually, I think this is expected. > YARN scheduler respo

[jira] [Created] (YARN-10468) TestNodeStatusUpdater does not handle early failure in threads

2020-10-20 Thread Ahmed Hussein (Jira)
Ahmed Hussein created YARN-10468: Summary: TestNodeStatusUpdater does not handle early failure in threads Key: YARN-10468 URL: https://issues.apache.org/jira/browse/YARN-10468 Project: Hadoop YARN

[jira] [Commented] (YARN-10453) Add partition resource info to get-node-labels and label-mappings api responses

2020-10-20 Thread Sunil G (Jira)
[ https://issues.apache.org/jira/browse/YARN-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217493#comment-17217493 ] Sunil G commented on YARN-10453: +1. I am committing this shortly if there are no issues. >

[jira] [Commented] (YARN-10453) Add partition resource info to get-node-labels and label-mappings api responses

2020-10-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217488#comment-17217488 ] Hadoop QA commented on YARN-10453: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-20 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217479#comment-17217479 ] Peter Bacsko commented on YARN-10460: - Ok, I can confirm that {{TestFetcher.testCorruptedIFile

[jira] [Assigned] (YARN-10306) Create simple copy log aggregation file controller

2020-10-20 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-10306: - Assignee: Andras Gyori (was: Adam Antal) > Create simple copy log aggregation file control

[jira] [Updated] (YARN-10306) Create simple copy log aggregation file controller

2020-10-20 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10306: Description: Log aggregation file controllers were created (YARN-6875) to effectively wrap

[jira] [Updated] (YARN-10306) Create simple copy log aggregation file controller

2020-10-20 Thread Andras Gyori (Jira)
[ https://issues.apache.org/jira/browse/YARN-10306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Gyori updated YARN-10306: Description: Log aggregation file controllers were created (YARN-6875) to effectively wrap

[jira] [Updated] (YARN-10457) Add a configuration switch to change between legacy and JSON placement rule format

2020-10-20 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10457: -- Summary: Add a configuration switch to change between legacy and JSON placement rule format

[jira] [Comment Edited] (YARN-10422) Create the script responsible for collecting the bundle data

2020-10-20 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17213170#comment-17213170 ] Szilard Nemeth edited comment on YARN-10422 at 10/20/20, 8:10 AM: -- Hi

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2020-10-20 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217413#comment-17217413 ] Hadoop QA commented on YARN-8737: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10453) Add partition resource info to get-node-labels and label-mappings api responses

2020-10-20 Thread Akhil PB (Jira)
[ https://issues.apache.org/jira/browse/YARN-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-10453: Attachment: YARN-10453.003.patch > Add partition resource info to get-node-labels and label-mappings

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217288#comment-17217288 ] Akira Ajisaka commented on YARN-10460: -- Thank you [~pbacsko]! > Upgrading to JUnit 4.13 cau

[jira] [Comment Edited] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217275#comment-17217275 ] Akira Ajisaka edited comment on YARN-10460 at 10/20/20, 5:37 AM: - Hi

[jira] [Comment Edited] (YARN-10178) Global Scheduler asycthread crash caused by 'Comparison method violates its general contract'

2020-10-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217285#comment-17217285 ] Wangda Tan edited comment on YARN-10178 at 10/20/20, 5:33 AM: -- Since

[jira] [Commented] (YARN-10178) Global Scheduler asycthread crash caused by 'Comparison method violates its general contract'

2020-10-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217285#comment-17217285 ] Wangda Tan commented on YARN-10178: --- Since recently we have a customer has the same issue, I spent some

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217284#comment-17217284 ] Peter Bacsko commented on YARN-10460: - [~aajisaka] there is one more test which is potentially

[jira] [Commented] (YARN-10453) Add partition resource info to get-node-labels and label-mappings api responses

2020-10-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217282#comment-17217282 ] Hadoop QA commented on YARN-10453: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-8737) Race condition in ParentQueue when reinitializing and sorting child queues in the meanwhile

2020-10-19 Thread Wangda Tan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217279#comment-17217279 ] Wangda Tan commented on YARN-8737: -- Rekicked Jenkins, after reviewed the case, the fix looks good to me

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217275#comment-17217275 ] Akira Ajisaka commented on YARN-10460: -- Hi [~pbacsko], I have a question. Are there any failing

[jira] [Commented] (YARN-10453) Add partition resource info to get-node-labels and label-mappings api responses

2020-10-19 Thread Sunil G (Jira)
[ https://issues.apache.org/jira/browse/YARN-10453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217221#comment-17217221 ] Sunil G commented on YARN-10453: Kicked jenkins again. > Add partition resource info to get-node-lab

[jira] [Commented] (YARN-10466) Fix NullPointerException in yarn-services Component.java

2020-10-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217118#comment-17217118 ] Hadoop QA commented on YARN-10466: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (YARN-10467) ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers

2020-10-19 Thread Haibo Chen (Jira)
Haibo Chen created YARN-10467: - Summary: ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers Key: YARN-10467 URL: https://issues.apache.org/jira/browse/YARN-10467 Project: Hadoop

[jira] [Commented] (YARN-10465) Support getClusterNodes, getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation

2020-10-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217073#comment-17217073 ] Hadoop QA commented on YARN-10465: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-8173) [Router] Implement missing FederationClientInterceptor#getApplications()

2020-10-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217059#comment-17217059 ] Hadoop QA commented on YARN-8173: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10466) Fix NullPointerException in yarn-services Component.java

2020-10-19 Thread D M Murali Krishna Reddy (Jira)
[ https://issues.apache.org/jira/browse/YARN-10466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] D M Murali Krishna Reddy updated YARN-10466: Attachment: YARN-10466.001.patch > Fix NullPointerException in y

[jira] [Commented] (YARN-8173) [Router] Implement missing FederationClientInterceptor#getApplications()

2020-10-19 Thread D M Murali Krishna Reddy (Jira)
[ https://issues.apache.org/jira/browse/YARN-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17217056#comment-17217056 ] D M Murali Krishna Reddy commented on YARN-8173: [~yiran],  I would like to work

[jira] [Created] (YARN-10466) Fix NullPointerException in yarn-services Component.java

2020-10-19 Thread D M Murali Krishna Reddy (Jira)
D M Murali Krishna Reddy created YARN-10466: --- Summary: Fix NullPointerException in yarn-services Component.java Key: YARN-10466 URL: https://issues.apache.org/jira/browse/YARN-10466 Project

[jira] [Updated] (YARN-10465) Support getClusterNodes, getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation

2020-10-19 Thread D M Murali Krishna Reddy (Jira)
[ https://issues.apache.org/jira/browse/YARN-10465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] D M Murali Krishna Reddy updated YARN-10465: Attachment: YARN-10465.001.patch > Support getClusterNo

[jira] [Created] (YARN-10465) Support getClusterNodes, getNodeToLabels, getLabelsToNodes, getClusterNodeLabels API's for Federation

2020-10-19 Thread D M Murali Krishna Reddy (Jira)
://issues.apache.org/jira/browse/YARN-10465 Project: Hadoop YARN Issue Type: Sub-task Components: federation Reporter: D M Murali Krishna Reddy Assignee: D M Murali Krishna Reddy -- This message was sent by Atlassian Jira (v8.3.4#803005

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-19 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216747#comment-17216747 ] Jim Brennan commented on YARN-10450: Thanks [~ebadger]! > Add cpu and memory utilization per n

[jira] [Commented] (YARN-10442) RM should make sure node label file highly available

2020-10-19 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1721#comment-1721 ] Hadoop QA commented on YARN-10442: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216657#comment-17216657 ] Szilard Nemeth commented on YARN-10460: --- [~pbacsko] OK, thanks. Resolving this jira

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216637#comment-17216637 ] Peter Bacsko commented on YARN-10460: - I think it's OK to have it only on trunk for now

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216635#comment-17216635 ] Szilard Nemeth commented on YARN-10460: --- Hi [~pbacsko], Thanks for this fix. Committed to trunk

[jira] [Updated] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-19 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-10460: -- Fix Version/s: 3.4.0 > Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to f

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-19 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216580#comment-17216580 ] Bilwa S T commented on YARN-10463: -- Hi [~zhuqi] Thanks for patch. I have few comments: # In below code

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-19 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216484#comment-17216484 ] Bilwa S T commented on YARN-10463: -- YARN-10111 has been raised for getQueueInfo() api > For Federat

[jira] [Updated] (YARN-10464) Flink job on YARN with HA enabled crashes all RMs on attempt recovery

2020-10-18 Thread tim yu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tim yu updated YARN-10464: -- Attachment: YARN-10464.1.patch > Flink job on YARN with HA enabled crashes all RMs on attempt recov

[jira] [Updated] (YARN-10464) Flink job on YARN with HA enabled crashes all RMs on attempt recovery

2020-10-18 Thread tim yu (Jira)
[ https://issues.apache.org/jira/browse/YARN-10464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tim yu updated YARN-10464: -- Description: I am trying to make Flink (1.11.1) job on our Hadoop cluster (2.6.0) with HA enabled but when I

[jira] [Created] (YARN-10464) Flink job on YARN with HA enabled crashes all RMs on attempt recovery

2020-10-18 Thread tim yu (Jira)
tim yu created YARN-10464: - Summary: Flink job on YARN with HA enabled crashes all RMs on attempt recovery Key: YARN-10464 URL: https://issues.apache.org/jira/browse/YARN-10464 Project: Hadoop YARN

[jira] [Commented] (YARN-7200) SLS generates a realtimetrack.json file but that file is missing the closing ']'

2020-10-17 Thread Agshin Kazimli (Jira)
[ https://issues.apache.org/jira/browse/YARN-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17216025#comment-17216025 ] Agshin Kazimli commented on YARN-7200: -- I've added a patch involving two changes

[jira] [Updated] (YARN-7200) SLS generates a realtimetrack.json file but that file is missing the closing ']'

2020-10-17 Thread Agshin Kazimli (Jira)
[ https://issues.apache.org/jira/browse/YARN-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Agshin Kazimli updated YARN-7200: - Attachment: YARN-7200-branch-trunk.patch > SLS generates a realtimetrack.json file but that f

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-17 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215911#comment-17215911 ] Hadoop QA commented on YARN-10460: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-17 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10460: Attachment: YARN-10460-002.patch > Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpda

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215621#comment-17215621 ] Hadoop QA commented on YARN-10460: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-16 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10460: Attachment: YARN-10460-001.patch > Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpda

[jira] [Commented] (YARN-10456) RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry

2020-10-16 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-10456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215416#comment-17215416 ] Eric Payne commented on YARN-10456: --- Both {{CSQueueMetrics}} and {{FSQueueMetrics}} are also children

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-16 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215315#comment-17215315 ] Bilwa S T commented on YARN-10463: -- Hi [~zhuqi] # We cannot change return type of API for this {quote

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-16 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215278#comment-17215278 ] Hadoop QA commented on YARN-10463: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10442) RM should make sure node label file highly available

2020-10-16 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/YARN-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated YARN-10442: -- Description: In one of my cluster RM failed transition to Active because node

[jira] [Assigned] (YARN-10144) Federation: Add missing FederationClientInterceptor APIs

2020-10-16 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi reassigned YARN-10144: Assignee: zhuqi > Federation: Add missing FederationClientInterceptor A

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-16 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215259#comment-17215259 ] zhuqi commented on YARN-10463: -- Hi [~BilwaST]  Thanks for your quickly reply and review. I understand

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-16 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215251#comment-17215251 ] Bilwa S T commented on YARN-10463: -- Hi [~zhuqi] It depends on the API. For example getClusterNodes

[jira] [Commented] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-16 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215245#comment-17215245 ] zhuqi commented on YARN-10463: -- cc [~adam.antal] [~Tao Yang]  [~dmmkr] [~BilwaST]   I add

[jira] [Updated] (YARN-10463) For Federation, we should support getApplicationAttemptReport.

2020-10-16 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10463: - Summary: For Federation, we should support getApplicationAttemptReport. (was: For Federation, we should support

[jira] [Updated] (YARN-10463) For Federation, we should support getApplicationAttemptReport。

2020-10-16 Thread zhuqi (Jira)
[ https://issues.apache.org/jira/browse/YARN-10463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhuqi updated YARN-10463: - Parent: YARN-10144 Issue Type: Sub-task (was: Task) > For Federation, we should supp

[jira] [Created] (YARN-10463) For Federation, we should support getApplicationAttemptReport。

2020-10-16 Thread zhuqi (Jira)
zhuqi created YARN-10463: Summary: For Federation, we should support getApplicationAttemptReport。 Key: YARN-10463 URL: https://issues.apache.org/jira/browse/YARN-10463 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-10244) backport YARN-9848 to branch-3.2

2020-10-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215141#comment-17215141 ] Xiaoqiao He commented on YARN-10244: Thanks [~Steven Rand][~aajisaka][~ebadger] for your works

[jira] [Comment Edited] (YARN-10244) backport YARN-9848 to branch-3.2

2020-10-15 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/YARN-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215141#comment-17215141 ] Xiaoqiao He edited comment on YARN-10244 at 10/16/20, 3:21 AM: --- Thanks

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17215116#comment-17215116 ] Akira Ajisaka commented on YARN-10460: -- Thanks [~pbacsko] for your report and detailed analysis. Now

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214990#comment-17214990 ] Eric Badger commented on YARN-10460: Really interesting find. Good job tracking this down. Since

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214973#comment-17214973 ] Hadoop QA commented on YARN-10450: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-7713) Add parallel copying of directories into FSDownload

2020-10-15 Thread Christos Karampeazis-Papadakis (Jira)
[ https://issues.apache.org/jira/browse/YARN-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214970#comment-17214970 ] Christos Karampeazis-Papadakis commented on YARN-7713: -- Good day, [~miklos.szeg

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214939#comment-17214939 ] Jonathan Hung commented on YARN-10450: -- Thanks [~Jim_Brennan] that is fine with me. > Add

[jira] [Commented] (YARN-10244) backport YARN-9848 to branch-3.2

2020-10-15 Thread Steven Rand (Jira)
[ https://issues.apache.org/jira/browse/YARN-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214933#comment-17214933 ] Steven Rand commented on YARN-10244: Thanks [~aajisaka]! > backport YARN-9848 to branch-

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214891#comment-17214891 ] Eric Badger commented on YARN-10450: Thanks, [~Jim_Brennan]. I've committed this to trunk and branch

[jira] [Updated] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-10450: --- Fix Version/s: 3.3.1 3.4.0 > Add cpu and memory utilization per node and clus

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214879#comment-17214879 ] Jim Brennan commented on YARN-10450: Thanks [~ebadger]!  I've attached patches for branches 3.2, 3.1

[jira] [Updated] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-10450: --- Attachment: YARN-10450-branch-3.2.003.patch YARN-10450-branch-3.1.003.patch

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214833#comment-17214833 ] Eric Badger commented on YARN-10450: [~Jim_Brennan], looks good now! +1 committing now > Add

[jira] [Commented] (YARN-9848) revert YARN-4946

2020-10-15 Thread Sunil G (Jira)
[ https://issues.apache.org/jira/browse/YARN-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214812#comment-17214812 ] Sunil G commented on YARN-9848: --- Thanks [~aajisaka], This approach is much better now.  Thank you

[jira] [Comment Edited] (YARN-9848) revert YARN-4946

2020-10-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214806#comment-17214806 ] Akira Ajisaka edited comment on YARN-9848 at 10/15/20, 4:09 PM: Backported

[jira] [Commented] (YARN-4946) RM should not consider an application as COMPLETED when log aggregation is not in a terminal state

2020-10-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214808#comment-17214808 ] Akira Ajisaka commented on YARN-4946: - This issue has been reverted from trunk, branch-3.3, and branch

[jira] [Commented] (YARN-9848) revert YARN-4946

2020-10-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214806#comment-17214806 ] Akira Ajisaka commented on YARN-9848: - Backport the revert into branch-3.2. > revert YARN-4

[jira] [Updated] (YARN-9848) revert YARN-4946

2020-10-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-9848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-9848: Fix Version/s: 3.2.2 > revert YARN-4946 > > > Ke

[jira] [Commented] (YARN-10244) backport YARN-9848 to branch-3.2

2020-10-15 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214795#comment-17214795 ] Eric Badger commented on YARN-10244: Makes sense. Thanks, [~aajisaka] > backport YARN-9848 to bra

[jira] [Commented] (YARN-10244) backport YARN-9848 to branch-3.2

2020-10-15 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214791#comment-17214791 ] Akira Ajisaka commented on YARN-10244: -- Thanks [~ebadger] for your comment. bq. Anyway, like I said

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Jim Brennan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214760#comment-17214760 ] Jim Brennan commented on YARN-10450: patch 003 changes the Cluster page to use *Physical Mem Used

[jira] [Updated] (YARN-10462) Configurable shutdown cleanup slop

2020-10-15 Thread dzcxzl (Jira)
[ https://issues.apache.org/jira/browse/YARN-10462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dzcxzl updated YARN-10462: -- Attachment: YARN-10462.001.patch > Configurable shutdown cleanup s

[jira] [Created] (YARN-10462) Configurable shutdown cleanup slop

2020-10-15 Thread dzcxzl (Jira)
dzcxzl created YARN-10462: - Summary: Configurable shutdown cleanup slop Key: YARN-10462 URL: https://issues.apache.org/jira/browse/YARN-10462 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-10442) RM should make sure node label file highly available

2020-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214316#comment-17214316 ] Hadoop QA commented on YARN-10442: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-10442) RM should make sure node label file highly available

2020-10-14 Thread Surendra Singh Lilhore (Jira)
[ https://issues.apache.org/jira/browse/YARN-10442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated YARN-10442: -- Attachment: YARN-10442.002.patch > RM should make sure node label file hig

[jira] [Commented] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-10-14 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214128#comment-17214128 ] Hadoop QA commented on YARN-10421: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-10244) backport YARN-9848 to branch-3.2

2020-10-14 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214050#comment-17214050 ] Eric Badger commented on YARN-10244: I'm pretty confused with all of the JIRAs on this. In the future

[jira] [Assigned] (YARN-10461) Update the ResourceManagerRest.md with the introduced endpoints

2020-10-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke reassigned YARN-10461: Assignee: Benjamin Teke > Update the ResourceManagerRest.md with the introduced endpoi

[jira] [Created] (YARN-10461) Update the ResourceManagerRest.md with the introduced endpoints

2020-10-14 Thread Benjamin Teke (Jira)
Benjamin Teke created YARN-10461: Summary: Update the ResourceManagerRest.md with the introduced endpoints Key: YARN-10461 URL: https://issues.apache.org/jira/browse/YARN-10461 Project: Hadoop YARN

[jira] [Resolved] (YARN-10433) Extend the DiagnosticService to initiate the diagnostic bundle collection

2020-10-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke resolved YARN-10433. -- Resolution: Abandoned Migrated to YARN-10421   > Extend the DiagnosticService to initi

[jira] [Commented] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-10-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214005#comment-17214005 ] Benjamin Teke commented on YARN-10421: -- Hi [~snemeth],   Thanks for the insights! 1-2-7-9-11-12

[jira] [Updated] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-10-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10421: - Description: YarnDiagnosticsServlet should run inside ResourceManager Daemon. The servlet forks

[jira] [Updated] (YARN-10421) Create YarnDiagnosticsService to serve diagnostic queries

2020-10-14 Thread Benjamin Teke (Jira)
[ https://issues.apache.org/jira/browse/YARN-10421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benjamin Teke updated YARN-10421: - Attachment: YARN-10421.004.patch > Create YarnDiagnosticsService to serve diagnostic quer

[jira] [Updated] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10460: Attachment: YARN-10460-POC.patch > Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpda

[jira] [Updated] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10460: Attachment: YARN-10460-POC.patch > Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpda

[jira] [Updated] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-10460: Attachment: (was: YARN-10460-POC.patch) > Upgrading to JUnit 4.13 causes te

[jira] [Commented] (YARN-10460) Upgrading to JUnit 4.13 causes tests in TestNodeStatusUpdater to fail

2020-10-14 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-10460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17213830#comment-17213830 ] Peter Bacsko commented on YARN-10460: - cc [~Jim_Brennan] [~ebadger] [~weichiu] [~aajisaka] what do

  1   2   3   4   5   6   7   8   9   10   >