[jira] [Updated] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8649: Attachment: YARN-8649_3.patch > Similar as YARN-4355:NPE while processing localizer heartbeat >

[jira] [Commented] (YARN-8685) Add containers query support for nodes/node REST API in RMWebServices

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588371#comment-16588371 ] Tao Yang commented on YARN-8685: [~cheersyang], Thanks for your suggestions. Make sense to

[jira] [Commented] (YARN-8698) Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588372#comment-16588372 ] genericqa commented on YARN-8698: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588356#comment-16588356 ] genericqa commented on YARN-8649: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread potato (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588326#comment-16588326 ] potato edited comment on YARN-8649 at 8/22/18 3:20 AM: --- Shutting dow

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread potato (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588326#comment-16588326 ] potato commented on YARN-8649: -- Gracefully shutting down many nodes can cause massive NPEs, t

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588306#comment-16588306 ] lujie commented on YARN-8649: - Hi [~jlowe]: # In the new patch, I let the "getPathForLocaliza

[jira] [Updated] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8649: Attachment: YARN-8649_2.patch > Similar as YARN-4355:NPE while processing localizer heartbeat >

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588279#comment-16588279 ] Weiwei Yang commented on YARN-8015: --- Hi [~sunilg], thanks {quote}I think we can commit t

[jira] [Commented] (YARN-8015) Complete placement constraint support for Capacity Scheduler

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588274#comment-16588274 ] Sunil Govindan commented on YARN-8015: -- Thanks [~cheersyang]. Looks fine to me. Comm

[jira] [Updated] (YARN-8698) Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-21 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8698: --- Description: When a standalone submarine tf job is submitted, the following error is got : INFO:tensorflow:im

[jira] [Updated] (YARN-8698) Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-21 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8698: --- Description: when a standalone submarine tf job is submitted, the following error is got : INFO:tensorflow:im

[jira] [Created] (YARN-8698) Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-21 Thread Zac Zhou (JIRA)
Zac Zhou created YARN-8698: -- Summary: Failed to add hadoop dependencies in docker container when submitting a submarine job Key: YARN-8698 URL: https://issues.apache.org/jira/browse/YARN-8698 Project: Hadoop

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-08-21 Thread Chen Yufei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588238#comment-16588238 ] Chen Yufei commented on YARN-8513: -- [~leftnoteasy] My original config did not have the tw

[jira] [Commented] (YARN-8696) FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588205#comment-16588205 ] genericqa commented on YARN-8696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8697) LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource

2018-08-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8697: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > LocalityMulticastAMRMProxyPolicy should

[jira] [Created] (YARN-8697) LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource

2018-08-21 Thread Botong Huang (JIRA)
Botong Huang created YARN-8697: -- Summary: LocalityMulticastAMRMProxyPolicy should fallback to random sub-cluster when cannot resolve resource Key: YARN-8697 URL: https://issues.apache.org/jira/browse/YARN-8697

[jira] [Commented] (YARN-8298) Yarn Service Upgrade: Support express upgrade of a service

2018-08-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588184#comment-16588184 ] Chandni Singh commented on YARN-8298: - Thanks [~eyang]  > Yarn Service Upgrade: Suppo

[jira] [Commented] (YARN-8298) Yarn Service Upgrade: Support express upgrade of a service

2018-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588181#comment-16588181 ] Hudson commented on YARN-8298: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #148

[jira] [Commented] (YARN-8298) Yarn Service Upgrade: Support express upgrade of a service

2018-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588169#comment-16588169 ] Eric Yang commented on YARN-8298: - +1 Patch 6 looks good to me. > Yarn Service Upgrade: S

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588153#comment-16588153 ] genericqa commented on YARN-8509: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-8298) Yarn Service Upgrade: Support express upgrade of a service

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588152#comment-16588152 ] genericqa commented on YARN-8298: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-08-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-8672: --- Assignee: Chandni Singh > TestContainerManager#testLocalingResourceWhileContainerRunning occa

[jira] [Commented] (YARN-7644) NM gets backed up deleting docker containers

2018-08-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588083#comment-16588083 ] Chandni Singh commented on YARN-7644: - [~ebadger] I would like to work on this issue.

[jira] [Updated] (YARN-7644) NM gets backed up deleting docker containers

2018-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7644: Parent Issue: YARN-8472 (was: YARN-3611) > NM gets backed up deleting docker containers > -

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8675: Labels: Docker (was: ) > Setting hostname of docker container breaks with "host" networking mode for > App

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588066#comment-16588066 ] genericqa commented on YARN-7863: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8696) FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-08-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: YARN-8696.v1.patch > FederationInterceptor upgrade: home sub-cluster heartbeat async > ---

[jira] [Created] (YARN-8696) FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-08-21 Thread Botong Huang (JIRA)
Botong Huang created YARN-8696: -- Summary: FederationInterceptor upgrade: home sub-cluster heartbeat async Key: YARN-8696 URL: https://issues.apache.org/jira/browse/YARN-8696 Project: Hadoop YARN

[jira] [Updated] (YARN-8696) FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-08-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Issue Type: Sub-task (was: Task) Parent: YARN-5597 > FederationInterceptor upgrade: home sub-

[jira] [Commented] (YARN-8298) Yarn Service Upgrade: Support express upgrade of a service

2018-08-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588018#comment-16588018 ] Chandni Singh commented on YARN-8298: - [~eyang] patch 6 includes the change for upgrad

[jira] [Updated] (YARN-8298) Yarn Service Upgrade: Support express upgrade of a service

2018-08-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8298: Attachment: YARN-8298.006.patch > Yarn Service Upgrade: Support express upgrade of a service > -

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-21 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588010#comment-16588010 ] Zian Chen commented on YARN-8509: - Fix failed UTs and re-upload the patch > Total pending

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-21 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.005.patch > Total pending resource calculation in preemption should use user-limit fac

[jira] [Commented] (YARN-8581) [AMRMProxy] Add sub-cluster timeout in LocalityMulticastAMRMProxyPolicy

2018-08-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588006#comment-16588006 ] Botong Huang commented on YARN-8581: Thanks [~giovanni.fumarola] for the review! > [

[jira] [Commented] (YARN-8673) [AMRMProxy] More robust responseId resync after an YarnRM master slave switch

2018-08-21 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16588003#comment-16588003 ] Botong Huang commented on YARN-8673: Thanks [~giovanni.fumarola]! > [AMRMProxy] More

[jira] [Commented] (YARN-8673) [AMRMProxy] More robust responseId resync after an YarnRM master slave switch

2018-08-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587946#comment-16587946 ] Giovanni Matteo Fumarola commented on YARN-8673: Committed to branch-2 as

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587944#comment-16587944 ] Jason Lowe commented on YARN-8649: -- Thanks for the analysis and patch, [~xiaoheipangzi]!

[jira] [Comment Edited] (YARN-8581) [AMRMProxy] Add sub-cluster timeout in LocalityMulticastAMRMProxyPolicy

2018-08-21 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586549#comment-16586549 ] Giovanni Matteo Fumarola edited comment on YARN-8581 at 8/21/18 8:07 PM: ---

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587903#comment-16587903 ] genericqa commented on YARN-8468: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587873#comment-16587873 ] Eric Yang commented on YARN-8675: - Docker only prevents --hostname and --net=host flag to

[jira] [Updated] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7863: - Attachment: YARN-7863-YARN-3409.008.patch > Modify placement constraints to support node attribute

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587849#comment-16587849 ] Sunil Govindan commented on YARN-7863: -- Updated v8 patch. cc [~cheersyang] [~Naganar

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8675: - Reporter: Yesha Vora (was: Suma Shivaprasad) > Setting hostname of docker container breaks with "host" ne

[jira] [Assigned] (YARN-8572) YarnClient getContainers API should support filtering by container status

2018-08-21 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8572: --- Assignee: Abhishek Modi > YarnClient getContainers API should support filtering by container

[jira] [Assigned] (YARN-8663) Opportunistic Container property "mapreduce.job.num-opportunistic-maps-percent" is throwing wrong exception at wrong sequence

2018-08-21 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8663: --- Assignee: Abhishek Modi > Opportunistic Container property > "mapreduce.job.num-opportunisti

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587715#comment-16587715 ] genericqa commented on YARN-8649: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.005.patch > Limit container sizes per queue in FairScheduler

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-08-21 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587681#comment-16587681 ] Eric Badger commented on YARN-8648: --- IMO I like the idea of actually dealing with this p

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587634#comment-16587634 ] genericqa commented on YARN-7863: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie reassigned YARN-8649: --- Assignee: lujie Attachment: YARN-8649.patch Hi [~jlowe], [~pradeepambati],[~$iddhe$h] I have restudied

[jira] [Comment Edited] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-21 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587597#comment-16587597 ] lujie edited comment on YARN-8649 at 8/21/18 3:35 PM: -- Hi [~jlowe], [

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587591#comment-16587591 ] Hudson commented on YARN-7494: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #148

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587564#comment-16587564 ] Weiwei Yang commented on YARN-7494: --- I just pushed the patch to trunk, thanks for all th

[jira] [Updated] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7863: -- Fix Version/s: (was: 3.2.0) > Modify placement constraints to support node attributes >

[jira] [Issue Comment Deleted] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7863: -- Comment: was deleted (was: I just pushed this to trunk. Thanks for getting it done [~sunilg]! And thank

[jira] [Reopened] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reopened YARN-7863: --- > Modify placement constraints to support node attributes > --

[jira] [Commented] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587535#comment-16587535 ] Weiwei Yang commented on YARN-7494: --- LGTM, +1 to v20 patch. I will commit this to trunk

[jira] [Updated] (YARN-7494) Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decision

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7494: -- Summary: Add muti-node lookup mechanism and pluggable nodes sorting policies to optimize placement decis

[jira] [Assigned] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-21 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Condit reassigned YARN-8642: -- Assignee: Craig Condit > Add support for tmpfs mounts with the Docker runtime > ---

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-21 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587489#comment-16587489 ] Craig Condit commented on YARN-8642: [~shaneku...@gmail.com], I'd like to work on this

[jira] [Assigned] (YARN-7680) ContainerMetrics is registered even if yarn.nodemanager.container-metrics.enable is set to false

2018-08-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-7680: Assignee: Zoltan Siegl > ContainerMetrics is registered even if > yarn.nodemanager.container-metri

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587425#comment-16587425 ] genericqa commented on YARN-8468: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587422#comment-16587422 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~wilfreds], Currently, r

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587389#comment-16587389 ] Sunil Govindan commented on YARN-7494: -- [~cheersyang] Fixed checkstyles which are pos

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587386#comment-16587386 ] genericqa commented on YARN-7494: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (YARN-8695) ERROR: Container complete event for unknown container id

2018-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8695: - Priority: Minor (was: Major) Downgrading the priority since this has no impact on functionality. Does "c

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587371#comment-16587371 ] Sunil Govindan commented on YARN-7863: -- Thanks [~cheersyang] [~Naganarasimha] *TestC

[jira] [Updated] (YARN-7863) Modify placement constraints to support node attributes

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7863: - Attachment: YARN-7863-YARN-3409.007.patch > Modify placement constraints to support node attribute

[jira] [Created] (YARN-8695) ERROR: Container complete event for unknown container id

2018-08-21 Thread sivasankar (JIRA)
sivasankar created YARN-8695: Summary: ERROR: Container complete event for unknown container id Key: YARN-8695 URL: https://issues.apache.org/jira/browse/YARN-8695 Project: Hadoop YARN Issue Type

[jira] [Updated] (YARN-8694) app flex with relative changes does not work

2018-08-21 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-8694: --- Attachment: YARN-8694.001.patch > app flex with relative changes does not work > -

[jira] [Commented] (YARN-8685) Add containers query support for nodes/node REST API in RMWebServices

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587317#comment-16587317 ] Weiwei Yang commented on YARN-8685: --- Hi [~Tao Yang] Can we add a new endpoint in RM som

[jira] [Commented] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587312#comment-16587312 ] Hudson commented on YARN-8683: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #148

[jira] [Commented] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587300#comment-16587300 ] Tao Yang commented on YARN-8683: Thanks [~cheersyang].  > Support to display pending sche

[jira] [Commented] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587295#comment-16587295 ] Weiwei Yang commented on YARN-8683: --- Thanks [~Tao Yang] for the contribution, I have com

[jira] [Updated] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Issue Type: Improvement (was: Bug) > Support to display pending scheduling requests in RM app attempt p

[jira] [Updated] (YARN-8683) Support to display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Summary: Support to display pending scheduling requests in RM app attempt page (was: Display pending s

[jira] [Created] (YARN-8694) app flex with relative changes does not work

2018-08-21 Thread kyungwan nam (JIRA)
kyungwan nam created YARN-8694: -- Summary: app flex with relative changes does not work Key: YARN-8694 URL: https://issues.apache.org/jira/browse/YARN-8694 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-8683) Display pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Summary: Display pending scheduling requests in RM app attempt page (was: Display outstanding pending

[jira] [Updated] (YARN-8683) Display outstanding pending scheduling requests in RM app attempt page

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8683: -- Summary: Display outstanding pending scheduling requests in RM app attempt page (was: Support scheduli

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587287#comment-16587287 ] Weiwei Yang commented on YARN-8683: --- +1, committing now > Support scheduling request fo

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.004.patch > Limit container sizes per queue in FairScheduler

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-08-21 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7494: - Attachment: YARN-7494.20.patch > Add muti node lookup support for better placement > -

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: (was: YARN-8468.005.patch) > Limit container sizes per queue in Fa

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.005.patch > Limit container sizes per queue in FairScheduler

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587266#comment-16587266 ] genericqa commented on YARN-8683: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Created] (YARN-8693) Add signalToContainer REST API for RMWebServices

2018-08-21 Thread Tao Yang (JIRA)
Tao Yang created YARN-8693: -- Summary: Add signalToContainer REST API for RMWebServices Key: YARN-8693 URL: https://issues.apache.org/jira/browse/YARN-8693 Project: Hadoop YARN Issue Type: Improvemen

[jira] [Updated] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8692: --- Description: The distribution of node utilization is an important healthy factor for the YARN cluster, relate

[jira] [Updated] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8692: --- Attachment: (was: image-2018-08-21-18-03-59-665.png) > Support node utilization metrics for SLS >

[jira] [Updated] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8692: --- Description: The distribution of node utilization is an important healthy factor for the YARN cluster, relate

[jira] [Updated] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8692: --- Attachment: image-2018-08-21-18-04-22-749.png > Support node utilization metrics for SLS > ---

[jira] [Updated] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8692: --- Attachment: image-2018-08-21-18-03-59-665.png > Support node utilization metrics for SLS > ---

[jira] [Updated] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8692: --- Attachment: (was: image-2018-08-21-17-50-04-011.png) > Support node utilization metrics for SLS >

[jira] [Created] (YARN-8692) Support node utilization metrics for SLS

2018-08-21 Thread Tao Yang (JIRA)
Tao Yang created YARN-8692: -- Summary: Support node utilization metrics for SLS Key: YARN-8692 URL: https://issues.apache.org/jira/browse/YARN-8692 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-21 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587157#comment-16587157 ] genericqa commented on YARN-7494: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8683: --- Attachment: YARN-8683.004.patch > Support scheduling request for outstanding requests info in RMAppAttemptBloc

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587146#comment-16587146 ] Tao Yang commented on YARN-8683: Thanks [~cheersyang] for your suggestion! Attached v4 t

[jira] [Commented] (YARN-4931) Preempted resources go back to the same application

2018-08-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587141#comment-16587141 ] Haibo Chen commented on YARN-4931: -- This should have been fixed by YARN-6432, which is in

[jira] [Commented] (YARN-8681) Wrong error message in RM placement constraints check

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587140#comment-16587140 ] Weiwei Yang commented on YARN-8681: --- Hi [~snemeth] lets close it as won't fix as this co

[jira] [Commented] (YARN-8683) Support scheduling request for outstanding requests info in RMAppAttemptBlock

2018-08-21 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16587137#comment-16587137 ] Weiwei Yang commented on YARN-8683: --- Hi [~Tao Yang], yep, that looks better, could you p

  1   2   >