[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749632#comment-16749632 ] Zhankun Tang commented on YARN-9205: [~cheersyang], [~sunilg] . Thanks for the review. The 3.1/3.2

[jira] [Commented] (YARN-9223) NPE happens in NM while loading recovery fails

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749612#comment-16749612 ] Hadoop QA commented on YARN-9223: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9205: --- Attachment: YARN-9205-branch-3.1.001.patch > When using custom resource type, application will fail

[jira] [Updated] (YARN-9223) NPE happens in NM while loading recovery fails

2019-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-9223: Attachment: hadoop-hd-nodemanager-slave1.log > NPE happens in NM while loading recovery fails >

[jira] [Commented] (YARN-9215) RM throws NPE and shutdown when trying to stop a service

2019-01-22 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749596#comment-16749596 ] Akhil PB commented on YARN-9215: This is duplicate of YARN-6695. Closing it as duplicate > RM throws NPE

[jira] [Resolved] (YARN-9215) RM throws NPE and shutdown when trying to stop a service

2019-01-22 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB resolved YARN-9215. Resolution: Duplicate > RM throws NPE and shutdown when trying to stop a service >

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9205: --- Attachment: YARN-9205-branch-3.2.001.patch > When using custom resource type, application will fail

[jira] [Updated] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-6616: Attachment: 0006-YARN-6616.patch > YARN AHS shows submitTime for jobs same as startTime >

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749576#comment-16749576 ] Prabhu Joseph commented on YARN-6616: - Thanks [~eepayne]. Have attached v6 patch which has added 2

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749571#comment-16749571 ] Hudson commented on YARN-9205: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15807 (See

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749566#comment-16749566 ] Weiwei Yang commented on YARN-9205: --- Just committed to trunk, but the patch doesn't apply to branch-3.2

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-22 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749560#comment-16749560 ] Rohith Sharma K S commented on YARN-6695: - Yes this is corner case and need to handle it. We can

[jira] [Commented] (YARN-7746) Fix PlacementProcessor to support app priority

2019-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749563#comment-16749563 ] Arun Suresh commented on YARN-7746: --- Apologize for the long delay.. The patch looks good

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749559#comment-16749559 ] Weiwei Yang commented on YARN-9205: --- v9 patch looks good, the failed UT looks like a flaky one, see 

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749546#comment-16749546 ] Sunil Govindan commented on YARN-9205: -- Yes. This seems good now.  [~cheersyang] cud you please

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749540#comment-16749540 ] Zhankun Tang commented on YARN-9205: [~sunilg], [~cheersyang] . The v09 patch seems ok now.  > When

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749522#comment-16749522 ] Zac Zhou commented on YARN-9161: [~sunilg] , Thanks a lot for your comments. Checked with [~tangzhankun]

[jira] [Commented] (YARN-9223) NPE happens in NM while loading recovery fails

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749501#comment-16749501 ] Hadoop QA commented on YARN-9223: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749511#comment-16749511 ] Hadoop QA commented on YARN-9205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749507#comment-16749507 ] Sunil Govindan commented on YARN-9206: -- Thanks [~kshukla] I am kind of more leaning towards v2 patch

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749506#comment-16749506 ] Sunil Govindan commented on YARN-6695: -- [~rohithsharma] I think we need to check on documentation as

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749505#comment-16749505 ] Sunil Govindan commented on YARN-9205: -- [~tangzhankun] I can see a lot of failure for v8 patch

[jira] [Commented] (YARN-6695) Race condition in RM for publishing container events vs appFinished events causes NPE

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749497#comment-16749497 ] Zac Zhou commented on YARN-6695: I checked the logic for TimelineServiceV2Publisher. If 

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749502#comment-16749502 ] Sunil Govindan commented on YARN-9161: -- Hi [~yuan_zac], post YARN-9205, will there be any impacts for

[jira] [Commented] (YARN-9161) Absolute resources of capacity scheduler doesn't support GPU and FPGA

2019-01-22 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749498#comment-16749498 ] Zac Zhou commented on YARN-9161: [~sunilg], [~leftnoteasy], [~tangzhankun]  welcome to add some comments

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749483#comment-16749483 ] Hadoop QA commented on YARN-9206: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749485#comment-16749485 ] Hadoop QA commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9210: -- Fix Version/s: 2.9.3 > RM nodes web page can not display node info >

[jira] [Updated] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-9210: -- Fix Version/s: 2.10.0 > RM nodes web page can not display node info >

[jira] [Commented] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749462#comment-16749462 ] Jonathan Hung commented on YARN-9210: - Thanks for fixing this, +1 LGTM > RM nodes web page can not

[jira] [Commented] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749455#comment-16749455 ] Weiwei Yang commented on YARN-9210: --- Looks good. The asf license warnings should not be related to this

[jira] [Created] (YARN-9223) NPE happens in NM while loading recovery fails

2019-01-22 Thread lujie (JIRA)
lujie created YARN-9223: --- Summary: NPE happens in NM while loading recovery fails Key: YARN-9223 URL: https://issues.apache.org/jira/browse/YARN-9223 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-9222) Change startTime semantics for RMApp

2019-01-22 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9222: --- Summary: Change startTime semantics for RMApp Key: YARN-9222 URL: https://issues.apache.org/jira/browse/YARN-9222 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9205: --- Attachment: YARN-9205-trunk.009.patch > When using custom resource type, application will fail to run

[jira] [Updated] (YARN-8821) GPU hierarchy/topology scheduling support

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8821: --- Summary: GPU hierarchy/topology scheduling support (was: GPU hierarchy scheduling support) > GPU

[jira] [Commented] (YARN-9202) RM does not track nodes that are in the include list and never register

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749362#comment-16749362 ] Kuhu Shukla commented on YARN-9202: --- [~eepayne], Thank you so much for the review! {quote} I do not see

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749361#comment-16749361 ] Kuhu Shukla commented on YARN-9206: --- Thank you [~sunilg] for the review. I was not super happy with it

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749358#comment-16749358 ] Sunil Govindan commented on YARN-9206: -- Hi [~kshukla] Thanks for the patch. I think we could think

[jira] [Comment Edited] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749333#comment-16749333 ] Kuhu Shukla edited comment on YARN-9206 at 1/23/19 12:37 AM: - Complexity is a

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749333#comment-16749333 ] Kuhu Shukla commented on YARN-9206: --- Complexity is a bit worse but I tried not to add another boolean.

[jira] [Updated] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-9206: -- Attachment: YARN-9206.003.patch > RMServerUtils does not count SHUTDOWN as an accepted state >

[jira] [Commented] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749293#comment-16749293 ] Hudson commented on YARN-9146: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15804 (See

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-22 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749296#comment-16749296 ] Chandni Singh commented on YARN-9074: - [~uranus] Thanks for the patch. The change looks good. Failure

[jira] [Created] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-22 Thread Eric Yang (JIRA)
Eric Yang created YARN-9221: --- Summary: Add a flag to enable dynamic auxiliary service feature Key: YARN-9221 URL: https://issues.apache.org/jira/browse/YARN-9221 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-9221) Add a flag to enable dynamic auxiliary service feature

2019-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9221: --- Assignee: Billie Rinaldi > Add a flag to enable dynamic auxiliary service feature >

[jira] [Commented] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749278#comment-16749278 ] Eric Yang commented on YARN-9146: - +1 for patch 03. Committing to trunk. > REST API to trigger storing

[jira] [Commented] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749230#comment-16749230 ] Hadoop QA commented on YARN-9116: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2019-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.014.patch > Application Catalog for YARN applications >

[jira] [Commented] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749150#comment-16749150 ] Hadoop QA commented on YARN-9146: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749140#comment-16749140 ] Kuhu Shukla commented on YARN-9206: --- I see! Will update patch shortly. > RMServerUtils does not count

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749132#comment-16749132 ] Jim Brennan commented on YARN-9206: --- {quote}{quote}I think you need to iterate the acceptedStates() and

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749097#comment-16749097 ] Hadoop QA commented on YARN-6616: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-22 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749056#comment-16749056 ] Aihua Xu commented on YARN-9116: patch-4: to address the comments from [~cheersyang]. I didn't try to

[jira] [Updated] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-6616: - Attachment: ApplicationReport.poc > YARN AHS shows submitTime for jobs same as startTime >

[jira] [Updated] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-22 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated YARN-9116: --- Attachment: YARN-9116.4.patch > Capacity Scheduler: implements queue level maximum-allocation inheritance >

[jira] [Commented] (YARN-6616) YARN AHS shows submitTime for jobs same as startTime

2019-01-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749051#comment-16749051 ] Eric Payne commented on YARN-6616: -- [~Prabhu Joseph], thank you for updating the new patch.

[jira] [Commented] (YARN-9074) Docker container rm command should be executed after stop

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749036#comment-16749036 ] Hadoop QA commented on YARN-9074: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749021#comment-16749021 ] Kuhu Shukla commented on YARN-9206: --- Thank you [~Jim_Brennan] for the review! bq. I think you need to

[jira] [Commented] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749001#comment-16749001 ] Billie Rinaldi commented on YARN-9146: -- Fixed site formatting issue in patch 3. > REST API to

[jira] [Updated] (YARN-9146) REST API to trigger storing auxiliary manifest file and publish to NMs

2019-01-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-9146: - Attachment: YARN-9146.03.patch > REST API to trigger storing auxiliary manifest file and publish

[jira] [Commented] (YARN-8619) Automate docker network configuration through YARN API

2019-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748963#comment-16748963 ] Eric Yang commented on YARN-8619: - Close this as information provided. [Comment

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748961#comment-16748961 ] Hadoop QA commented on YARN-9205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-8619) Automate docker network configuration through YARN API

2019-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-8619. - Resolution: Information Provided > Automate docker network configuration through YARN API >

[jira] [Commented] (YARN-8783) Improve the documentation for the docker.trusted.registries configuration

2019-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748959#comment-16748959 ] Eric Yang commented on YARN-8783: - [~simonprewo] Any progress? > Improve the documentation for the

[jira] [Commented] (YARN-9116) Capacity Scheduler: implements queue level maximum-allocation inheritance

2019-01-22 Thread Aihua Xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748929#comment-16748929 ] Aihua Xu commented on YARN-9116: [~cheersyang] Thanks for the feedback. Those make sense. I will upload a

[jira] [Commented] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748936#comment-16748936 ] Hadoop QA commented on YARN-9210: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748910#comment-16748910 ] Hadoop QA commented on YARN-9205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748891#comment-16748891 ] Tarun Parimi commented on YARN-9209: Hi [~cheersyang], {quote}What if we set it to

[jira] [Commented] (YARN-9206) RMServerUtils does not count SHUTDOWN as an accepted state

2019-01-22 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748895#comment-16748895 ] Jim Brennan commented on YARN-9206: --- [~kshukla], thanks for the patch!  I think it would be cleaner if

[jira] [Created] (YARN-9220) Add more UT coverage for RM nodes web page

2019-01-22 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-9220: - Summary: Add more UT coverage for RM nodes web page Key: YARN-9220 URL: https://issues.apache.org/jira/browse/YARN-9220 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748839#comment-16748839 ] Zhankun Tang commented on YARN-9205: [~sunilg], [~leftnoteasy] , The v08.patch is the latest patch

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748837#comment-16748837 ] Weiwei Yang commented on YARN-9209: --- Hi [~tarunparimi] What if we set it to \{{RMNodeLabelManager.ANY}}

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748833#comment-16748833 ] Weiwei Yang commented on YARN-9205: --- Yes, thanks [~tangzhankun], even v5 patch TestContainerAllocation

[jira] [Comment Edited] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748833#comment-16748833 ] Weiwei Yang edited comment on YARN-9205 at 1/22/19 3:28 PM: Yes, thanks

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9205: --- Attachment: YARN-9205-trunk.008.patch > When using custom resource type, application will fail to run

[jira] [Commented] (YARN-8101) Add UT to verify node-attributes in RM nodes rest API

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748794#comment-16748794 ] Hadoop QA commented on YARN-8101: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9205: --- Attachment: YARN-9205-trunk.007.patch > When using custom resource type, application will fail to run

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748738#comment-16748738 ] Zhankun Tang commented on YARN-9205: [~sunilg] , Even we use the prior version of changes, the added

[jira] [Updated] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9209: --- Description: When application sets a placement constraint without specifying a nodePartition, the

[jira] [Commented] (YARN-9209) When nodePartition is not set in Placement Constraints, containers are allocated only in default partition

2019-01-22 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748714#comment-16748714 ] Tarun Parimi commented on YARN-9209: Thanks [~cheersyang] . I tried relaxing the check by patching the

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748683#comment-16748683 ] Sunil Govindan commented on YARN-9205: -- Hi [~cheersyang] [~tangzhankun] This latest change caused

[jira] [Created] (YARN-9219) Unable to Invoke MapReduce from Yarn REST API

2019-01-22 Thread Namit (JIRA)
Namit created YARN-9219: --- Summary: Unable to Invoke MapReduce from Yarn REST API Key: YARN-9219 URL: https://issues.apache.org/jira/browse/YARN-9219 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8498) Yarn NodeManager OOM Listener Fails Compilation on Ubuntu 18.04

2019-01-22 Thread Ayush Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748635#comment-16748635 ] Ayush Saxena commented on YARN-8498: [~vinayrpet] [~sunilg] Mind giving a check > Yarn

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-01-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748628#comment-16748628 ] Hadoop QA commented on YARN-9205: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8101) Add UT to verify node-attributes in RM nodes rest API

2019-01-22 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8101: Attachment: 0001-YARN-8101.patch > Add UT to verify node-attributes in RM nodes rest API >

[jira] [Commented] (YARN-8101) Add UT to verify node-attributes in RM nodes rest API

2019-01-22 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748606#comment-16748606 ] Prabhu Joseph commented on YARN-8101: - Thanks [~cheersyang]. > Add UT to verify node-attributes in RM

[jira] [Updated] (YARN-9218) When register to MockRM, MockNM spend 30s on InetAddress.getByName(name).getHostAddress();

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9218: --- Description: In a test case, reproduce the issue with below code. And you'll see that this three

[jira] [Updated] (YARN-9218) When register to MockRM, MockNM spend 30s on InetAddress.getByName(name).getHostAddress();

2019-01-22 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9218: --- Priority: Major (was: Minor) > When register to MockRM, MockNM spend 30s on >

[jira] [Created] (YARN-9218) When register to MockRM, MockNM spend 30s on InetAddress.getByName(name).getHostAddress();

2019-01-22 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-9218: -- Summary: When register to MockRM, MockNM spend 30s on InetAddress.getByName(name).getHostAddress(); Key: YARN-9218 URL: https://issues.apache.org/jira/browse/YARN-9218

[jira] [Created] (YARN-9217) Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing

2019-01-22 Thread JIRA
Antal Bálint Steinbach created YARN-9217: Summary: Nodemanager will fail to start if GPU is misconfigured on the node or GPU drivers missing Key: YARN-9217 URL:

[jira] [Reopened] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-9210: --- > RM nodes web page can not display node info > --- > >

[jira] [Commented] (YARN-9210) RM nodes web page can not display node info

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748578#comment-16748578 ] Weiwei Yang commented on YARN-9210: --- Thanks [~yangjiandan], reopen to trigger jenkins job. > RM nodes

[jira] [Commented] (YARN-8101) Add UT to verify node-attributes in RM nodes rest API

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748561#comment-16748561 ] Weiwei Yang commented on YARN-8101: --- Sure, appreciate that. Assigned to you, thanks [~Prabhu Joseph]. >

[jira] [Assigned] (YARN-8101) Add UT to verify node-attributes in RM nodes rest API

2019-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8101: - Assignee: Prabhu Joseph (was: Weiwei Yang) > Add UT to verify node-attributes in RM nodes rest

[jira] [Commented] (YARN-8101) Add UT to verify node-attributes in RM nodes rest API

2019-01-22 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748511#comment-16748511 ] Prabhu Joseph commented on YARN-8101: - Hi [~cheersyang], If you are okay, i will work on this. > Add

[jira] [Updated] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-22 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-9216: --- Description: Precondition: 1. ResourceManager HA is enable; 2. ResourceManager and Timeline Server are not on

[jira] [Updated] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-22 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-9216: --- Description: Precondition: 1. ResourceManager HA is enable; 2. ResourceManager and Timeline Server are not on

[jira] [Updated] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-22 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-9216: --- Attachment: screenshot-1.png > The user and queue link address in the Timeline Server webapp are unknown >

[jira] [Updated] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-22 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-9216: --- Description: Precondition: 1. ResourceManager HA is enable; 2. ResourceManager and Timeline Server are not on

[jira] [Created] (YARN-9216) The user and queue link address in the Timeline Server webapp are unknown

2019-01-22 Thread Sen Zhao (JIRA)
Sen Zhao created YARN-9216: -- Summary: The user and queue link address in the Timeline Server webapp are unknown Key: YARN-9216 URL: https://issues.apache.org/jira/browse/YARN-9216 Project: Hadoop YARN

  1   2   >