[jira] [Commented] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-09-03 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921334#comment-16921334 ] Bibin A Chundatt commented on YARN-9738: [~sunilg] Could please you take a look > Remove lock on

[jira] [Updated] (YARN-9785) Fix DominantResourceCalculator when one resource is zero

2019-09-03 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9785: Attachment: YARN-9785-branch-3.1.001.patch > Fix DominantResourceCalculator when one resource is zero >

[jira] [Updated] (YARN-9761) Allow overriding application submissions based on server side configs

2019-09-03 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/YARN-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pralabhkumar updated YARN-9761: --- Attachment: YARN-9761.04.patch > Allow overriding application submissions based on server side

[jira] [Updated] (YARN-9733) Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0 when subprocess of container dead

2019-09-03 Thread qian han (Jira)
[ https://issues.apache.org/jira/browse/YARN-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian han updated YARN-9733: --- Attachment: (was: YARN-9733.001.patch) > Method getCpuUsagePercent in Class ProcfsBasedProcessTree return

[jira] [Commented] (YARN-9797) LeafQueue#activateApplications should use resourceCalculator#fitsIn

2019-09-03 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921190#comment-16921190 ] Bibin A Chundatt commented on YARN-9797: Thank you [~sunilg] and [~tangzhankun] for review Will

[jira] [Assigned] (YARN-9808) Zero length files in container log output haven't got a header

2019-09-03 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9808: Assignee: Adam Antal > Zero length files in container log output haven't got a header >

[jira] [Updated] (YARN-9785) Fix DominantResourceCalculator when one resource is zero

2019-09-03 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9785: --- Fix Version/s: 3.2.1 3.3.0 > Fix DominantResourceCalculator when one resource is

[jira] [Commented] (YARN-9785) Fix DominantResourceCalculator when one resource is zero

2019-09-03 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921207#comment-16921207 ] Zhankun Tang commented on YARN-9785: [~bibinchundatt], this has been committed to trunk and

[jira] [Commented] (YARN-8743) capacity scheduler doesn't set node label to reserved container

2019-09-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921250#comment-16921250 ] Hadoop QA commented on YARN-8743: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9797) LeafQueue#activateApplications should use resourceCalculator#fitsIn

2019-09-03 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921257#comment-16921257 ] Hudson commented on YARN-9797: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17222 (See

[jira] [Commented] (YARN-9785) Fix DominantResourceCalculator when one resource is zero

2019-09-03 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921258#comment-16921258 ] Hudson commented on YARN-9785: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17222 (See

[jira] [Updated] (YARN-9733) Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0 when subprocess of container dead

2019-09-03 Thread qian han (Jira)
[ https://issues.apache.org/jira/browse/YARN-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian han updated YARN-9733: --- Attachment: (was: YARN-9733-1.patch) > Method getCpuUsagePercent in Class ProcfsBasedProcessTree return 0

[jira] [Commented] (YARN-9477) Implement VE discovery using libudev

2019-09-03 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921218#comment-16921218 ] Peter Bacsko commented on YARN-9477: [~jojochuang] thanks for informing me about this and following-up

[jira] [Commented] (YARN-9804) Update ATSv2 document for latest feature supports

2019-09-03 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921488#comment-16921488 ] Rohith Sharma K S commented on YARN-9804: - [~vrushalic] Would you like to take a look at the doc?

[jira] [Commented] (YARN-9761) Allow overriding application submissions based on server side configs

2019-09-03 Thread pralabhkumar (Jira)
[ https://issues.apache.org/jira/browse/YARN-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921507#comment-16921507 ] pralabhkumar commented on YARN-9761: [~adam.antal] Thx for reviewing the Patch . I have done the

[jira] [Commented] (YARN-6715) Fix documentation about NodeHealthScriptRunner

2019-09-03 Thread Miklos Szegedi (Jira)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921596#comment-16921596 ] Miklos Szegedi commented on YARN-6715: -- [~pbacsko] Is a week ETA okay for the review? > Fix

[jira] [Comment Edited] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-09-03 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921639#comment-16921639 ] Eric Yang edited comment on YARN-9728 at 9/3/19 6:28 PM: - [~Prabhu Joseph] thank

[jira] [Commented] (YARN-9782) Avoid DNS resolution while running SLS.

2019-09-03 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921588#comment-16921588 ] Íñigo Goiri commented on YARN-9782: --- Can we add a unit test that for exmaple checks the system property

[jira] [Commented] (YARN-9761) Allow overriding application submissions based on server side configs

2019-09-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921602#comment-16921602 ] Jonathan Hung commented on YARN-9761: - Thanks for the patch [~pralabhkumar], I have a few more

[jira] [Commented] (YARN-9806) TestNMSimulator#testNMSimulator fails in branch-2

2019-09-03 Thread Haibo Chen (Jira)
[ https://issues.apache.org/jira/browse/YARN-9806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921616#comment-16921616 ] Haibo Chen commented on YARN-9806: -- +1 on the patch. Thanks for the fix, [~jhung]! >

[jira] [Commented] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-09-03 Thread Thomas (Jira)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921654#comment-16921654 ] Thomas commented on YARN-9728: -- [~Prabhu Joseph], [~eyang], Thanks you for the patch and for the review.  

[jira] [Commented] (YARN-9561) Add C changes for the new RuncContainerRuntime

2019-09-03 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921670#comment-16921670 ] Eric Yang commented on YARN-9561: - [~ebadger] {quote} I don't think this should be added in the code that

[jira] [Commented] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-09-03 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921689#comment-16921689 ] Eric Yang commented on YARN-9728: - [~tde] {quote}Why we do no replace de illegal char by \uFFFd witch is

[jira] [Created] (YARN-9810) Add queue capacity/maxcapacity percentage metrics

2019-09-03 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-9810: --- Summary: Add queue capacity/maxcapacity percentage metrics Key: YARN-9810 URL: https://issues.apache.org/jira/browse/YARN-9810 Project: Hadoop YARN Issue

[jira] [Comment Edited] (YARN-9761) Allow overriding application submissions based on server side configs

2019-09-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921602#comment-16921602 ] Jonathan Hung edited comment on YARN-9761 at 9/3/19 5:45 PM: - Thanks for the

[jira] [Commented] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-09-03 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921639#comment-16921639 ] Eric Yang commented on YARN-9728: - [~Prabhu Joseph] thank you for the patch. Is this patch missing

[jira] [Updated] (YARN-9810) Add queue capacity/maxcapacity percentage metrics

2019-09-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9810: Environment: (was: Similar to YARN-9085, it'd be good to have queue (absolute) capacity /

[jira] [Updated] (YARN-9810) Add queue capacity/maxcapacity percentage metrics

2019-09-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9810: Description: Similar to YARN-9085, it'd be good to have queue (absolute) capacity / (absolute) max

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2019-09-03 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921751#comment-16921751 ] Eric Yang commented on YARN-9809: - [~ebadger] It is unlikely to determine unhealthy status until at least

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2019-09-03 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921754#comment-16921754 ] Eric Badger commented on YARN-9809: --- bq. It is unlikely to determine unhealthy status until at least one

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2019-09-03 Thread Eric Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921761#comment-16921761 ] Eric Yang commented on YARN-9809: - [~ebadger] LocalDirsHandlerService checkDir is a timer task. It is low

[jira] [Commented] (YARN-9809) NMs should supply a health status when registering with RM

2019-09-03 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-9809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921741#comment-16921741 ] Eric Badger commented on YARN-9809: --- I propose adding a health status field to the NM-RM registration

[jira] [Created] (YARN-9809) NMs should supply a health status when registering with RM

2019-09-03 Thread Eric Badger (Jira)
Eric Badger created YARN-9809: - Summary: NMs should supply a health status when registering with RM Key: YARN-9809 URL: https://issues.apache.org/jira/browse/YARN-9809 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9807) ContainerAllocator re-creates RMContainer instance when allocate for ReservedContainer

2019-09-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921925#comment-16921925 ] Hadoop QA commented on YARN-9807: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9804) Update ATSv2 document for latest feature supports

2019-09-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921942#comment-16921942 ] Hadoop QA commented on YARN-9804: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

2019-09-03 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921891#comment-16921891 ] Hadoop QA commented on YARN-8995: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||