[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701607#comment-16701607 ] Hadoop QA commented on YARN-9041: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701758#comment-16701758 ] Hadoop QA commented on YARN-8934: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701664#comment-16701664 ] Wanqiang Ji commented on YARN-9041: --- Not sure why Jenkins gives -1 even all UTs have passed, I have seen

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

2018-11-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701600#comment-16701600 ] Tao Yang commented on YARN-9050: cc: [~cheersyang], [~leftnoteasy], [~sunil.g]. I would be interested in

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701519#comment-16701519 ] Bibin A Chundatt commented on YARN-8948: Thanks [~suma.shivaprasad] for review

[jira] [Comment Edited] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701664#comment-16701664 ] Wanqiang Ji edited comment on YARN-9041 at 11/28/18 10:30 AM: -- Not sure why

[jira] [Commented] (YARN-9044) LogsCLI should contact ATSv2 for "-am" option

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701578#comment-16701578 ] Hudson commented on YARN-9044: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15515 (See

[jira] [Commented] (YARN-7481) Gpu locality support for Better AI scheduling

2018-11-28 Thread chen qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701619#comment-16701619 ] chen qingcha commented on YARN-7481: The 3.1 is use the resource module which is very different with

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-11-28 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701624#comment-16701624 ] Akhil PB commented on YARN-8914: Hi [~eyang] Build failed in Apache Hadoop Common project with following

[jira] [Commented] (YARN-7481) Gpu locality support for Better AI scheduling

2018-11-28 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701614#comment-16701614 ] Charo Zhang commented on YARN-7481: --- [~qinc...@microsoft.com] Do you have plan to upload patch for 3.1+

[jira] [Commented] (YARN-9034) ApplicationCLI should have option to take clusterId

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701577#comment-16701577 ] Hudson commented on YARN-9034: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #15515 (See

[jira] [Updated] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-11-28 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-8934: Attachment: (was: YARN-8934-YARN-7402.v5.patch) > [GPG] Add JvmMetricsInfo and pause monitor >

[jira] [Updated] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-11-28 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-8934: Attachment: YARN-8934-YARN-7402.v5.patch > [GPG] Add JvmMetricsInfo and pause monitor >

[jira] [Commented] (YARN-9047) FairScheduler: default resource calculator is not resource type aware

2018-11-28 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701661#comment-16701661 ] Szilard Nemeth commented on YARN-9047: -- Looking at the cause of the test failures. > FairScheduler:

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702616#comment-16702616 ] Hudson commented on YARN-9067: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15523 (See

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702681#comment-16702681 ] Wanqiang Ji commented on YARN-9041: --- Thanks for [~Steven Rand] review and help. > Optimize

[jira] [Commented] (YARN-8885) Phase 1 - Support NM APIs to query device resource allocation

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702742#comment-16702742 ] Hadoop QA commented on YARN-8885: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9069) Handle SchedulerInfo#getSchedulerType for customized schedulers

2018-11-28 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9069: Attachment: YARN-9069-001.patch > Handle SchedulerInfo#getSchedulerType for customized schedulers >

[jira] [Commented] (YARN-9069) Handle SchedulerInfo#getSchedulerType for customized schedulers

2018-11-28 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702779#comment-16702779 ] Bilwa S T commented on YARN-9069: - [~bibinchundatt] [~botong] please review > Handle

[jira] [Commented] (YARN-9049) Add application submit data to state store

2018-11-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702763#comment-16702763 ] Bibin A Chundatt commented on YARN-9049: [~botong] {quote}ApplicationSubmissionContext is wrapped

[jira] [Assigned] (YARN-9069) Handle SchedulerInfo#getSchedulerType for customized schedulers

2018-11-28 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-9069: --- Assignee: Bilwa S T > Handle SchedulerInfo#getSchedulerType for customized schedulers >

[jira] [Commented] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2018-11-28 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702623#comment-16702623 ] Charo Zhang commented on YARN-9053: --- [~eyang] I got it, thanks. Global environment consistency is

[jira] [Updated] (YARN-8885) Phase 1 - Support NM APIs to query device resource allocation

2018-11-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8885: --- Attachment: YARN-8885-trunk.003.patch > Phase 1 - Support NM APIs to query device resource allocation

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702621#comment-16702621 ] Zhankun Tang commented on YARN-7277: [~leftnoteasy], so if we change any A project changes, then when

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702591#comment-16702591 ] Hadoop QA commented on YARN-9067: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8885) Phase 1 - Support NM APIs to query device resource allocation

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702688#comment-16702688 ] Hadoop QA commented on YARN-8885: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702605#comment-16702605 ] Weiwei Yang commented on YARN-9067: --- Hi [~eyang] I committed the patch to trunk. The patch has some

[jira] [Updated] (YARN-9015) Phase 1 - Add an interface for device plugin to provide customized scheduler

2018-11-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9015: --- Attachment: YARN-9015-trunk.001.patch > Phase 1 - Add an interface for device plugin to provide

[jira] [Commented] (YARN-9030) Log aggregation changes to handle filesystems which do not support setting permissions

2018-11-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702678#comment-16702678 ] Suma Shivaprasad commented on YARN-9030: Thanks [~leftnoteasy] > Log aggregation changes to

[jira] [Commented] (YARN-9015) Phase 1 - Add an interface for device plugin to provide customized scheduler

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702725#comment-16702725 ] Hadoop QA commented on YARN-9015: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702584#comment-16702584 ] Hadoop QA commented on YARN-8867: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702595#comment-16702595 ] Weiwei Yang commented on YARN-9067: --- Thanks for fixing this, change LGTM. Committing soon. > YARN

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-28 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702626#comment-16702626 ] Xun Liu commented on YARN-5168: --- [~eyang], Thank you for your tips, I will finish this work. > Add port

[jira] [Updated] (YARN-8885) Phase 1 - Support NM APIs to query device resource allocation

2018-11-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8885: --- Attachment: YARN-8885-trunk.002.patch > Phase 1 - Support NM APIs to query device resource allocation

[jira] [Updated] (YARN-9015) Phase 1 - Add an interface for device plugin to provide customized scheduler

2018-11-28 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9015: --- Attachment: YARN-9015-trunk.002.patch > Phase 1 - Add an interface for device plugin to provide

[jira] [Created] (YARN-9069) Handle SchedulerInfo#getSchedulerType for customized schedulers

2018-11-28 Thread Bilwa S T (JIRA)
Bilwa S T created YARN-9069: --- Summary: Handle SchedulerInfo#getSchedulerType for customized schedulers Key: YARN-9069 URL: https://issues.apache.org/jira/browse/YARN-9069 Project: Hadoop YARN

[jira] [Commented] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2018-11-28 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701974#comment-16701974 ] Jim Brennan commented on YARN-9053: --- The launch_script.sh is run inside the docker container, so any

[jira] [Commented] (YARN-8812) Containers fail during creating a symlink which started with hyphen for a resource file

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701988#comment-16701988 ] Hudson commented on YARN-8812: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15516 (See

[jira] [Commented] (YARN-7018) Interface for adding extra behavior to node heartbeats

2018-11-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702036#comment-16702036 ] Jason Lowe commented on YARN-7018: -- Thanks for updating the patch! Overall looks OK for a POC. Would be

[jira] [Commented] (YARN-7086) Release all containers aynchronously

2018-11-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702010#comment-16702010 ] Jason Lowe commented on YARN-7086: -- Sorry for the long delay. It's good to see the performance number

[jira] [Commented] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2018-11-28 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702066#comment-16702066 ] Charo Zhang commented on YARN-9053: --- [~Jim_Brennan] [~eyang] it's true that variables are defined in

[jira] [Comment Edited] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702059#comment-16702059 ] Suma Shivaprasad edited comment on YARN-9039 at 11/28/18 3:57 PM: -- Thanks

[jira] [Commented] (YARN-8812) Containers fail during creating a symlink which started with hyphen for a resource file

2018-11-28 Thread Oleksandr Shevchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701978#comment-16701978 ] Oleksandr Shevchenko commented on YARN-8812: Thank you [~jlowe] for the review and committing

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702059#comment-16702059 ] Suma Shivaprasad commented on YARN-9039: Thanks [~bibinchundatt] for your suggestions.

[jira] [Updated] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-9039: --- Summary: App ACLs are not validated when serving logs from LogWebService (was: App ACLs are

[jira] [Commented] (YARN-8812) Containers fail during creating a symlink which started with hyphen for a resource file

2018-11-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701959#comment-16701959 ] Jason Lowe commented on YARN-8812: -- Thanks for the patch! +1 lgtm. Committing this. > Containers fail

[jira] [Updated] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-28 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-9039: --- Description: App Acls are not being validated while serving logs through REST and UI2 via Log

[jira] [Comment Edited] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702196#comment-16702196 ] Manikandan R edited comment on YARN-6523 at 11/28/18 5:51 PM: -- Thanks for

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6523: --- Attachment: YARN-6523.008.patch > Newly retrieved security Tokens are sent as part of each heartbeat

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702308#comment-16702308 ] Yufei Gu commented on YARN-9041: There is an error in test build which isn't related to your patch. I'll

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702196#comment-16702196 ] Manikandan R commented on YARN-6523: Thanks for very informative comments. {quote}All we need to do

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702223#comment-16702223 ] Jitendra Nath Pandey commented on YARN-9067: {quote}Base on the screenshot, there is 183

[jira] [Updated] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9067: Affects Version/s: 3.2.0 3.1.0 3.1.1 Target Version/s:

[jira] [Commented] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702429#comment-16702429 ] Wangda Tan commented on YARN-8882: -- Thanks [~tangzhankun], existing code looks good, committing .. >

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702421#comment-16702421 ] Hadoop QA commented on YARN-9067: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702413#comment-16702413 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702424#comment-16702424 ] Wangda Tan commented on YARN-8714: -- Thanks [~tangzhankun] for working on the patch, several comments:

[jira] [Commented] (YARN-9049) Add application submit data to state store

2018-11-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702430#comment-16702430 ] Botong Huang commented on YARN-9049: Thanks [~bibinchundatt] for the patch! I just have one question: 

[jira] [Commented] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702209#comment-16702209 ] Eric Yang commented on YARN-9053: - [~Charo Zhang] When non-entrypoint mode is enabled, launch_script.sh is

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702244#comment-16702244 ] Eric Yang commented on YARN-8914: - [~akhilpb] it sounds like development environment does not have cmake

[jira] [Created] (YARN-9068) Enhance ACL to set a list of users to access container shell

2018-11-28 Thread Eric Yang (JIRA)
Eric Yang created YARN-9068: --- Summary: Enhance ACL to set a list of users to access container shell Key: YARN-9068 URL: https://issues.apache.org/jira/browse/YARN-9068 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8867) Retrieve the status of resource localization

2018-11-28 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8867: Attachment: YARN-8867.006.patch > Retrieve the status of resource localization >

[jira] [Updated] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9067: Attachment: YARN-9067.002.patch > YARN Resource Manager is running OOM because of leak of Configuration

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702378#comment-16702378 ] Eric Yang commented on YARN-9067: - When YARN service throws exception during service operations,

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-28 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702326#comment-16702326 ] Chandni Singh commented on YARN-8867: - Uploaded patch 6 to address the javadoc error. cc [~eyang] >

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702438#comment-16702438 ] Wangda Tan commented on YARN-9060: -- [~tangzhankun], just want to understand some high level

[jira] [Comment Edited] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702438#comment-16702438 ] Wangda Tan edited comment on YARN-9060 at 11/28/18 10:26 PM: - [~tangzhankun],

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702450#comment-16702450 ] Wangda Tan commented on YARN-7277: -- [~tangzhankun], typically what you can do is add a new line or empty

[jira] [Comment Edited] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702450#comment-16702450 ] Wangda Tan edited comment on YARN-7277 at 11/28/18 10:30 PM: - [~tangzhankun],

[jira] [Commented] (YARN-9061) Improve the GPU/FPGA module log message of container-executor

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702451#comment-16702451 ] Wangda Tan commented on YARN-9061: -- +1, thanks [~tangzhankun], committing. > Improve the GPU/FPGA module

[jira] [Updated] (YARN-8882) [YARN-8851] Add a shared device mapping manager (scheduler) for device plugins

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8882: - Summary: [YARN-8851] Add a shared device mapping manager (scheduler) for device plugins (was: Phase 1 -

[jira] [Commented] (YARN-8934) [GPG] Add JvmMetricsInfo and pause monitor

2018-11-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702496#comment-16702496 ] Botong Huang commented on YARN-8934: Thanks [~BilwaST] for the patch. Committing to YARN-7402.  >

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702501#comment-16702501 ] Eric Yang commented on YARN-8867: - [~csingh] Thank you for the update. Patch 006 doesn't show PENDING for

[jira] [Comment Edited] (YARN-8867) Retrieve the status of resource localization

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702501#comment-16702501 ] Eric Yang edited comment on YARN-8867 at 11/28/18 11:24 PM: [~csingh] Thank

[jira] [Resolved] (YARN-8975) [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8975. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0 Committed to trunk, thanks

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-28 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702523#comment-16702523 ] Jonathan Hung commented on YARN-9036: - {color:#33}[~oliverhuh...@gmail.com], it seems commons-lang

[jira] [Commented] (YARN-8882) [YARN-8851] Add a shared device mapping manager (scheduler) for device plugins

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702507#comment-16702507 ] Hudson commented on YARN-8882: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-28 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702526#comment-16702526 ] Chandni Singh commented on YARN-8867: - [~eyang] With Yarn Service, currently we request for resources

[jira] [Commented] (YARN-3890) FairScheduler should show the scheduler health metrics similar to ones added in CapacityScheduler

2018-11-28 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702453#comment-16702453 ] Zoltan Siegl commented on YARN-3890: Unit test failures seem unrelated. > FairScheduler should show

[jira] [Commented] (YARN-8989) Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer

2018-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702480#comment-16702480 ] Wangda Tan commented on YARN-8989: -- LGTM, thanks [~tangzhankun], committing. > Move DockerCommandPlugin

[jira] [Commented] (YARN-9030) Log aggregation changes to handle filesystems which do not support setting permissions

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702506#comment-16702506 ] Hudson commented on YARN-9030: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-8851) [Umbrella] A pluggable device plugin framework to ease vendor plugin development

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702508#comment-16702508 ] Hudson commented on YARN-8851: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-8989) Move DockerCommandPlugin volume related APIs' invocation from DockerLinuxContainerRuntime#prepareContainer to #launchContainer

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702512#comment-16702512 ] Hudson commented on YARN-8989: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-8975) [Submarine] Use predefined Charset object StandardCharsets.UTF_8 instead of String "UTF-8"

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702511#comment-16702511 ] Hudson commented on YARN-8975: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-9061) Improve the GPU/FPGA module log message of container-executor

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702509#comment-16702509 ] Hudson commented on YARN-9061: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-8974) Improve the assertion message in TestGPUResourceHandler

2018-11-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702510#comment-16702510 ] Hudson commented on YARN-8974: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15522 (See

[jira] [Commented] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702536#comment-16702536 ] Hadoop QA commented on YARN-9010: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-28 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702538#comment-16702538 ] Steven Rand commented on YARN-9041: --- bq. If we not allowed relax locality, it will executes three

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702543#comment-16702543 ] Eric Yang commented on YARN-9067: - Patch 003 fixed unit test and white space errors. > YARN Resource

[jira] [Updated] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9067: Attachment: YARN-9067.003.patch > YARN Resource Manager is running OOM because of leak of Configuration

[jira] [Commented] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-11-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702561#comment-16702561 ] Eric Yang commented on YARN-5168: - [~akhilpb] [~liuxun323] It would be possible to make ajax call to YARN