[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-04-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.port-gpu.patch) > Gpu locality support for Better AI scheduling >

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-04-10 Thread can_he (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432034#comment-16432034 ] can_he commented on YARN-6629: -- [~Tao Yang] Thank you so much for your rapidly reply! One more question, does

[jira] [Created] (YARN-8139) Skip node hostname resolution when running SLS.

2018-04-10 Thread Abhishek Modi (JIRA)
Abhishek Modi created YARN-8139: --- Summary: Skip node hostname resolution when running SLS. Key: YARN-8139 URL: https://issues.apache.org/jira/browse/YARN-8139 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7804) Refresh action on Grid view page should not be redirected to graph view

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432057#comment-16432057 ] Hudson commented on YARN-7804: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13952 (See

[jira] [Updated] (YARN-7930) Add configuration to initialize RM with configured labels.

2018-04-10 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-7930: Attachment: YARN-7930.005.patch > Add configuration to initialize RM with configured labels. >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-04-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.port-gpu.patch > Gpu locality support for Better AI scheduling >

[jira] [Updated] (YARN-8134) Support specifying node resources in SLS

2018-04-10 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8134: Attachment: YARN-8134.002.patch > Support specifying node resources in SLS >

[jira] [Commented] (YARN-7930) Add configuration to initialize RM with configured labels.

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432045#comment-16432045 ] genericqa commented on YARN-7930: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7830) If attempt has selected grid view, attempt info page should be opened with grid view

2018-04-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7830: Attachment: YARN-7830.001.patch > If attempt has selected grid view, attempt info page should be

[jira] [Commented] (YARN-7825) Maintain constant horizontal application info bar for all pages

2018-04-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432068#comment-16432068 ] Gergely Novák commented on YARN-7825: - [~yeshavora] Could you please attach a screenshot? > Maintain

[jira] [Commented] (YARN-8134) Support specifying node resources in SLS

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432086#comment-16432086 ] genericqa commented on YARN-8134: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7830) If attempt has selected grid view, attempt info page should be opened with grid view

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432143#comment-16432143 ] genericqa commented on YARN-7830: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7984: - Description: The service records written to the registry are removed by ServiceClient on a

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.021.patch > Add security check for privileged docker container >

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432393#comment-16432393 ] Eric Yang commented on YARN-7221: - Patch 21 Remove checkstyle error, and also removed group-add for

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-04-10 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432474#comment-16432474 ] Manikandan R commented on YARN-4606: [~leftnoteasy] [~sunilg] Can you please share your views? >

[jira] [Commented] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432328#comment-16432328 ] genericqa commented on YARN-8104: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8134) Support specifying node resources in SLS

2018-04-10 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8134: Attachment: YARN-8134.003.patch > Support specifying node resources in SLS >

[jira] [Assigned] (YARN-8125) YARNUIV2 does not failover from standby to active endpoint like previous YARN UI

2018-04-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-8125: - Assignee: Sunil G > YARNUIV2 does not failover from standby to active endpoint like previous YARN > UI >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.001.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432214#comment-16432214 ] Tao Yang commented on YARN-8127: Thanks [~cheersyang]. Some additional details: This problem is most often

[jira] [Updated] (YARN-8125) YARNUIV2 does not failover from standby to active endpoint like previous YARN UI

2018-04-10 Thread Phil Zampino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phil Zampino updated YARN-8125: --- Description: If the YARN UI is accessed via the standby resource manager endpoint, it automatically

[jira] [Commented] (YARN-8057) Inadequate information for handling catch clauses

2018-04-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432420#comment-16432420 ] ASF GitHub Bot commented on YARN-8057: -- GitHub user lzh3636 opened a pull request:

[jira] [Updated] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7984: - Description: The service records written to the registry are removed by ServiceClient on a

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432433#comment-16432433 ] genericqa commented on YARN-7221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-04-10 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432477#comment-16432477 ] Manikandan R commented on YARN-7159: [~sunilg] Can you please take this forward? Thanks. > Normalize

[jira] [Commented] (YARN-7931) [atsv2 read acls] Include domain table creation as part of schema creator

2018-04-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432688#comment-16432688 ] Vrushali C commented on YARN-7931: -- Hi [~haibochen] That's a good question. Let me check what it does,

[jira] [Commented] (YARN-8134) Support specifying node resources in SLS

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432542#comment-16432542 ] genericqa commented on YARN-8134: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432589#comment-16432589 ] Shane Kumpf commented on YARN-2674: --- [~chenchun] - Thanks for the patch here. We are seeing this when

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432629#comment-16432629 ] genericqa commented on YARN-8127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

2018-04-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432502#comment-16432502 ] Wei Yan commented on YARN-8135: --- {quote}Think this should be renamed to YARN-Submarine though. I'm not sure

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-04-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432601#comment-16432601 ] Xuan Gong commented on YARN-7598: - Thanks for the review. [~djp] Uploaded a new patch to address all your

[jira] [Updated] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-04-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7598: Attachment: YARN-7598.4.patch > Document how to use classpath isolation for aux-services in YARN >

[jira] [Commented] (YARN-8073) TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration

2018-04-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432710#comment-16432710 ] Vrushali C commented on YARN-8073: -- Hi [~rohithsharma] Yes, please go ahead with cherry pick, the

[jira] [Updated] (YARN-7825) Maintain constant horizontal application info bar for all pages

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7825: - Attachment: Screen Shot 2018-04-10 at 11.06.40 AM.png Screen Shot 2018-04-10 at 11.07.29

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432732#comment-16432732 ] genericqa commented on YARN-7598: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-04-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432723#comment-16432723 ] Vrushali C commented on YARN-8130: -- Yes, I agree, we need a configurable delay like the

[jira] [Commented] (YARN-8135) Hadoop {Submarine} Project: Simple and scalable deployment of deep learning training / serving jobs on Hadoop

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432492#comment-16432492 ] Wangda Tan commented on YARN-8135: -- [~oliverhuh...@gmail.com],  There's no technical issues to make TF

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-04-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433067#comment-16433067 ] Jonathan Hung commented on YARN-7974: - Thanks for the comments, For 1 I think this is possible,

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433071#comment-16433071 ] Eric Yang commented on YARN-7530: - [~leftnoteasy] YARN service have dependency setup backward because

[jira] [Comment Edited] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433081#comment-16433081 ] Shane Kumpf edited comment on YARN-8141 at 4/10/18 10:19 PM: - Thanks for

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433162#comment-16433162 ] Eric Yang commented on YARN-7221: - TestContainerSchedulerQueuing unit test failure is not related to

[jira] [Updated] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7984: Fix Version/s: 3.2.0 > Delete registry entries from ZK on ServiceClient stop and clean up > stop/destroy

[jira] [Assigned] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-8142: Assignee: Billie Rinaldi > yarn service application stops when AM is killed with SIGTERM >

[jira] [Commented] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433062#comment-16433062 ] Hudson commented on YARN-7984: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13959 (See

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

2018-04-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433090#comment-16433090 ] Eric Payne commented on YARN-4781: -- bq. Hence in case we use sizeBasedWeight, we are considering pending

[jira] [Updated] (YARN-8142) yarn service application stops when AM is killed

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8142: - Description: Steps: 1) Launch sleeper job ( non-docker yarn service) {code} RUNNING:

[jira] [Created] (YARN-8142) yarn service application stops when AM is killed

2018-04-10 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8142: Summary: yarn service application stops when AM is killed Key: YARN-8142 URL: https://issues.apache.org/jira/browse/YARN-8142 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7189) Container-executor doesn't remove Docker containers that error out early

2018-04-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433137#comment-16433137 ] Eric Badger commented on YARN-7189: --- Attaching first patch to fix this issue. There is a race in the

[jira] [Updated] (YARN-7189) Container-executor doesn't remove Docker containers that error out early

2018-04-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7189: -- Attachment: YARN-7189-b3.0.001.patch > Container-executor doesn't remove Docker containers that error

[jira] [Updated] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7973: Fix Version/s: 3.2.0 > Support ContainerRelaunch for Docker containers >

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-04-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433185#comment-16433185 ] Jian He commented on YARN-7781: --- sure, go ahead. thanks > Update YARN-Services-Examples.md to be in sync

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433080#comment-16433080 ] genericqa commented on YARN-7221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433081#comment-16433081 ] Shane Kumpf commented on YARN-8141: --- Thanks for reporting this, [~leftnoteasy] -

[jira] [Commented] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433083#comment-16433083 ] Eric Yang commented on YARN-8140: - [~yeshavora] This is because the application has not been destroyed.

[jira] [Commented] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433093#comment-16433093 ] Yesha Vora commented on YARN-8140: -- yes [~eyang] this message sounds good. > Improve log message when

[jira] [Updated] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8142: - Summary: yarn service application stops when AM is killed with SIGTERM (was: yarn service application

[jira] [Commented] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-04-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433188#comment-16433188 ] Hudson commented on YARN-7973: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13962 (See

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432922#comment-16432922 ] Wangda Tan commented on YARN-7974: -- [~jhung], Thanks for working on the feature, I can see it's values. 

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432970#comment-16432970 ] Wangda Tan commented on YARN-7494: -- Thanks [~sunilg],  In general change looks good. Could u check UT

[jira] [Resolved] (YARN-7968) Reset the queue name in submission context while recovering an application

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-7968. Resolution: Won't Fix > Reset the queue name in submission context while recovering an application >

[jira] [Assigned] (YARN-7948) Enable refreshing maximum allocation for multiple resource types

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7948: -- Assignee: Szilard Nemeth (was: Yufei Gu) > Enable refreshing maximum allocation for multiple resource

[jira] [Assigned] (YARN-6324) The log4j.properties in sample-conf doesn't work well for SLS

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6324: -- Assignee: (was: Yufei Gu) > The log4j.properties in sample-conf doesn't work well for SLS >

[jira] [Assigned] (YARN-5824) Verify app starvation under custom preemption thresholds and timeouts

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-5824: -- Assignee: (was: Yufei Gu) > Verify app starvation under custom preemption thresholds and timeouts >

[jira] [Created] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-04-10 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8141: Summary: YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec Key: YARN-8141 URL: https://issues.apache.org/jira/browse/YARN-8141

[jira] [Assigned] (YARN-3797) NodeManager not blacklisting the disk (shuffle) with errors

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-3797: -- Assignee: (was: Yufei Gu) > NodeManager not blacklisting the disk (shuffle) with errors >

[jira] [Assigned] (YARN-6941) Allow Queue placement policies to be ordered by attribute

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6941: -- Assignee: (was: Yufei Gu) > Allow Queue placement policies to be ordered by attribute >

[jira] [Assigned] (YARN-6971) Clean up different ways to create resources

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6971: -- Assignee: (was: Yufei Gu) > Clean up different ways to create resources >

[jira] [Assigned] (YARN-6925) FSSchedulerNode could be simplified extracting preemption fields into a class

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6925: -- Assignee: (was: Yufei Gu) > FSSchedulerNode could be simplified extracting preemption fields into a

[jira] [Commented] (YARN-7984) Delete registry entries from ZK on ServiceClient stop and clean up stop/destroy behavior

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433038#comment-16433038 ] Eric Yang commented on YARN-7984: - [~billie.rinaldi] +1 to commit. Patch 2 looks good to me. Stop and

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.022.patch > Add security check for privileged docker container >

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432936#comment-16432936 ] Eric Yang commented on YARN-7221: - Patch 22 rebased to current trunk. > Add security check for privileged

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432934#comment-16432934 ] Wangda Tan commented on YARN-7530: -- [~eyang], thanks for sharing ur thoughts. To me, for currently scope

[jira] [Assigned] (YARN-8061) An application may preempt itself in case of minshare preemption

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-8061: -- Assignee: (was: Yufei Gu) > An application may preempt itself in case of minshare preemption >

[jira] [Assigned] (YARN-7347) Fixe the bug in Fair scheduler to handle a queue named "root.root"

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7347: -- Assignee: Gergo Repas (was: Yufei Gu) > Fixe the bug in Fair scheduler to handle a queue named

[jira] [Created] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8140: Summary: Improve log message when launch cmd is ran for stopped yarn service Key: YARN-8140 URL: https://issues.apache.org/jira/browse/YARN-8140 Project: Hadoop YARN

[jira] [Commented] (YARN-8037) CGroupsResourceCalculator logs excessive warnings on container relaunch

2018-04-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433049#comment-16433049 ] Shane Kumpf commented on YARN-8037: --- Thanks [~miklos.szeg...@cloudera.com] - For most applications I only 

[jira] [Updated] (YARN-8140) Improve log message when launch cmd is ran for stopped yarn service

2018-04-10 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8140: - Description: Steps:  1) Launch sleeper app {code} RUNNING: /usr/hdp/current/hadoop-yarn-client/bin/yarn

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-04-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432900#comment-16432900 ] Jonathan Hung commented on YARN-7974: - Hi [~wangda] - this is the tracking url change I mentioned

[jira] [Commented] (YARN-8116) Nodemanager fails with NumberFormatException: For input string: ""

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16432938#comment-16432938 ] Wangda Tan commented on YARN-8116: -- +1, thanks [~csingh], will commit shortly. > Nodemanager fails with

[jira] [Assigned] (YARN-6527) Provide a better out-of-the-box experience for SLS

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-6527: -- Assignee: (was: Yufei Gu) > Provide a better out-of-the-box experience for SLS >

[jira] [Assigned] (YARN-7263) Check host name resolution performance when resource manager starts up

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-7263: -- Assignee: (was: Yufei Gu) > Check host name resolution performance when resource manager starts up

[jira] [Assigned] (YARN-3890) FairScheduler should show the scheduler health metrics similar to ones added in CapacityScheduler

2018-04-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-3890: -- Assignee: Gergo Repas (was: Yufei Gu) > FairScheduler should show the scheduler health metrics similar

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431932#comment-16431932 ] genericqa commented on YARN-7088: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: (was: YARN-8127.003.patch) > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: (was: YARN-8127.003.patch) > Resource leak when async scheduling is enabled >

[jira] [Updated] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8127: --- Attachment: YARN-8127.003.patch > Resource leak when async scheduling is enabled >

[jira] [Commented] (YARN-7402) Federation V2: Global Optimizations

2018-04-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433404#comment-16433404 ] Wangda Tan commented on YARN-7402: -- [~curino] / [~subru], thanks for working on this improvement, is there

[jira] [Commented] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433405#comment-16433405 ] Eric Yang commented on YARN-8142: - [~cheersyang] If AM is hanging, then it is unlikely to gracefully

[jira] [Commented] (YARN-8127) Resource leak when async scheduling is enabled

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433441#comment-16433441 ] genericqa commented on YARN-8127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8104: --- Attachment: YARN-8104-YARN-3409.002.patch > Add API to fetch node to attribute mapping >

[jira] [Updated] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8104: --- Attachment: YARN-8104-YARN-3409.003.patch > Add API to fetch node to attribute mapping >

[jira] [Commented] (YARN-8104) Add API to fetch node to attribute mapping

2018-04-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431863#comment-16431863 ] Bibin A Chundatt commented on YARN-8104: Thank you [~Naganarasimha] for review Attached rebased

[jira] [Commented] (YARN-7930) Add configuration to initialize RM with configured labels.

2018-04-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431794#comment-16431794 ] genericqa commented on YARN-7930: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-04-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431808#comment-16431808 ] Rohith Sharma K S commented on YARN-8130: - This appears due to delay in dispatcher thread. Below is

[jira] [Commented] (YARN-7941) Transitive dependencies for component are not resolved

2018-04-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431811#comment-16431811 ] Rohith Sharma K S commented on YARN-7941: - +lgtm, verified the patch in cluster. {code} 2018-04-10

[jira] [Created] (YARN-8138) No containers pre-empted from another queue when using node labels

2018-04-10 Thread Charan Hebri (JIRA)
Charan Hebri created YARN-8138: -- Summary: No containers pre-empted from another queue when using node labels Key: YARN-8138 URL: https://issues.apache.org/jira/browse/YARN-8138 Project: Hadoop YARN

[jira] [Assigned] (YARN-8138) No containers pre-empted from another queue when using node labels

2018-04-10 Thread Charan Hebri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charan Hebri reassigned YARN-8138: -- Assignee: Zian Chen > No containers pre-empted from another queue when using node labels >

[jira] [Commented] (YARN-8142) yarn service application stops when AM is killed with SIGTERM

2018-04-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433210#comment-16433210 ] Eric Yang commented on YARN-8142: - In Unix terms, SIGTERM is used for terminating application. My

  1   2   >