[jira] [Updated] (YARN-8421) when moving app, activeUsers is increased, even though app does not have outstanding request

2018-07-11 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-8421: --- Attachment: YARN-8421.003.patch > when moving app, activeUsers is increased, even though app does not

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539649#comment-16539649 ] Hudson commented on YARN-8512: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14555 (See

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180711.patch) > Gpu locality support for Better

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180711.patch > Gpu locality support for Better AI schedul

[jira] [Commented] (YARN-8421) when moving app, activeUsers is increased, even though app does not have outstanding request

2018-07-11 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539625#comment-16539625 ] kyungwan nam commented on YARN-8421: [~eepayne], Thank you for your review. I've attached a new patch

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180711.patch > Gpu locality support for Better AI schedul

[jira] [Commented] (YARN-8504) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page and application history server webpage

2018-07-11 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539783#comment-16539783 ] tianjuan commented on YARN-8504: this is caused by YARN-7088 which adds a new column. there are some else

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180710.patch) > Gpu locality support for Better AI

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180710_old.patch) > Gpu locality support for Better AI

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180711.patch) > Gpu locality support for Better

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539748#comment-16539748 ] Szilard Nemeth commented on YARN-8468: -- Hey [~bsteinbach]! Thanks for the updated patch. LGTM, +1

[jira] [Updated] (YARN-8491) Fix TestServiceCLI#testEnableFastLaunch fail when umask is 077

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8491: --- Summary: Fix TestServiceCLI#testEnableFastLaunch fail when umask is 077 (was: UT failure in

[jira] [Updated] (YARN-8491) TestServiceCLI#testEnableFastLaunch fail when umask is 077

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8491: --- Summary: TestServiceCLI#testEnableFastLaunch fail when umask is 077 (was: Fix

[jira] [Commented] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539774#comment-16539774 ] genericqa commented on YARN-8511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8421) when moving app, activeUsers is increased, even though app does not have outstanding request

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539734#comment-16539734 ] genericqa commented on YARN-8421: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-7031) Support distributed node attributes

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt resolved YARN-7031. Resolution: Implemented Fix Version/s: YARN-3409 Closing this since its already

[jira] [Updated] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8434: --- Summary: Update federation documentation of Nodemanager configurations (was: Nodemanager not

[jira] [Updated] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8434: --- Priority: Minor (was: Blocker) > Update federation documentation of Nodemanager

[jira] [Updated] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8434: --- Attachment: YARN-8434.003.patch > Update federation documentation of Nodemanager

[jira] [Commented] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540162#comment-16540162 ] Bibin A Chundatt commented on YARN-8434: Updated jira description and patch added removing

[jira] [Commented] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540236#comment-16540236 ] genericqa commented on YARN-8434: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Attachment: YARN-8501.001.patch > Reduce complexity of RMWebServices' getApps method >

[jira] [Commented] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540428#comment-16540428 ] Subru Krishnan commented on YARN-8434: -- Thanks [~bibinchundatt] for understanding/verifying! +1 from

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540485#comment-16540485 ] genericqa commented on YARN-8501: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8517: - Description: Looking at the documentation here:

[jira] [Updated] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8517: - Description: Looking at the documentation here:

[jira] [Created] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8517: Summary: getContainer and getContainers ResourceManager REST API methods are not documented Key: YARN-8517 URL: https://issues.apache.org/jira/browse/YARN-8517

[jira] [Updated] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8517: - Description: Looking at the documentation here:

[jira] [Commented] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Wangda Tan (JIRA)
ajor > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180711.patch, hadoop-2.7.2.gpu-port.patch, > hadoop-2.9.0.gpu-port.patch, hadoop_2.9.0.patch > > Original Estimate: 1,344h > Remaining Estimate: 1,344h

[jira] [Commented] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540506#comment-16540506 ] Íñigo Goiri commented on YARN-8434: --- The parts that were hard to figure out were: * How to setup the

[jira] [Assigned] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach reassigned YARN-8517: Assignee: Antal Bálint Steinbach > getContainer and getContainers

[jira] [Commented] (YARN-8491) TestServiceCLI#testEnableFastLaunch fail when umask is 077

2018-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539925#comment-16539925 ] Hudson commented on YARN-8491: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14556 (See

[jira] [Commented] (YARN-8504) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page and application history server webpage

2018-07-11 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540342#comment-16540342 ] Íñigo Goiri commented on YARN-8504: --- Yes, same thing for NodesPage very easy to break. Ideally, we

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Attachment: YARN-8501.002.patch > Reduce complexity of RMWebServices' getApps method >

[jira] [Updated] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-07-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7639: --- Attachment: YARN-7639.1.patch > Queue Management scheduling edit policy class needs to be

[jira] [Created] (YARN-8518) test-container-executor test_is_empty() is broken

2018-07-11 Thread Jim Brennan (JIRA)
Jim Brennan created YARN-8518: - Summary: test-container-executor test_is_empty() is broken Key: YARN-8518 URL: https://issues.apache.org/jira/browse/YARN-8518 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8518) test-container-executor test_is_empty() is broken

2018-07-11 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540597#comment-16540597 ] Jim Brennan commented on YARN-8518: --- [~rkanter], [~szegedim], let me know if you would like me to put up

[jira] [Created] (YARN-8519) Yarn UI2 : Changes to depict Auto Created leaf Queues/Managed Queues differently from other queues

2018-07-11 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8519: -- Summary: Yarn UI2 : Changes to depict Auto Created leaf Queues/Managed Queues differently from other queues Key: YARN-8519 URL:

[jira] [Commented] (YARN-8518) test-container-executor test_is_empty() is broken

2018-07-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540604#comment-16540604 ] Robert Kanter commented on YARN-8518: - That would be great [~Jim_Brennan], thanks! >

[jira] [Commented] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540965#comment-16540965 ] Vrushali C commented on YARN-8270: -- Hi [~haibochen] Gentle ping for any further thoughts on Sushil's

[jira] [Resolved] (YARN-4192) Add YARN metric logging periodically to a seperate file

2018-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-4192. --- Resolution: Won't Fix I am closing this now, like [~aw] mentioned, this should be already handled by

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541155#comment-16541155 ] Wangda Tan commented on YARN-8505: -- [~bibinchundatt]  / [~Tao Yang] / [~cheersyang],  I would prefer to

[jira] [Commented] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540973#comment-16540973 ] genericqa commented on YARN-7639: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541039#comment-16541039 ] Weiwei Yang commented on YARN-8480: --- Hi [~templedf]/[~snemeth] Could you please elaborate the use case

[jira] [Commented] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541083#comment-16541083 ] Weiwei Yang commented on YARN-8511: --- [~leftnoteasy], [~asuresh], [~kkaranasos], could you please help to

[jira] [Comment Edited] (YARN-7064) Use cgroup to get container resource utilization

2018-07-11 Thread yewei.huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541092#comment-16541092 ] yewei.huang edited comment on YARN-7064 at 7/12/18 3:56 AM: {{Thanks

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-07-11 Thread yewei.huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541092#comment-16541092 ] yewei.huang commented on YARN-7064: --- {{Thanks [~miklos.szeg...@cloudera.com] for such nice feature!!!}}

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541157#comment-16541157 ] Bibin A Chundatt commented on YARN-8505: [~leftnoteasy] +1 for adding a new configuration

[jira] [Resolved] (YARN-8241) MRAppMaster fails when using UID:GID pair within docker container

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-8241. --- Resolution: Won't Fix We do not plan to support running containers in which a user lookup cannot be

[jira] [Resolved] (YARN-6576) Improve Diagonstic by moving Error stack trace from NM to slider AM

2018-07-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-6576. - Resolution: Duplicate Assignee: Eric Yang This is duplicate of YARN-8403. > Improve Diagonstic by

[jira] [Commented] (YARN-7974) Allow updating application tracking url after registration

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540879#comment-16540879 ] Wangda Tan commented on YARN-7974: -- [~oliverhuh...@gmail.com], [~jhung],   Thanks for updating the

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540895#comment-16540895 ] Wangda Tan commented on YARN-8480: -- [~templedf],  If this only changes Fair Scheduler, I'm fine with

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540963#comment-16540963 ] genericqa commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540967#comment-16540967 ] Vrushali C commented on YARN-8270: -- A couple of more questions: - perhaps a bit dumb, but what is the 10

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-11 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541078#comment-16541078 ] Tao Yang commented on YARN-8505: [~bibinchundatt], Thanks for your replay. Yes, this issue will change the

[jira] [Commented] (YARN-4104) dryrun of schedule for diagnostic and tenant's complain

2018-07-11 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541087#comment-16541087 ] Weiwei Yang commented on YARN-4104: --- I like this idea too, but seems this one gets to obsolete :(   >

[jira] [Commented] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541153#comment-16541153 ] Wangda Tan commented on YARN-8511: -- [~cheersyang],  Thanks for reporting and working on this issue, this

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541156#comment-16541156 ] Wangda Tan commented on YARN-8480: -- [~cheersyang],  What [~templedf] / [~snemeth] proposed is make the

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2018-07-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.005.patch > Application Catalog for YARN applications >

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540897#comment-16540897 ] Wangda Tan commented on YARN-8480: -- btw, [~templedf], I knew you found some troubles of support node

[jira] [Created] (YARN-8520) Document best practice for user management

2018-07-11 Thread Eric Yang (JIRA)
Eric Yang created YARN-8520: --- Summary: Document best practice for user management Key: YARN-8520 URL: https://issues.apache.org/jira/browse/YARN-8520 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5670) Add support for Docker image clean up

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5670: -- Parent: YARN-8472 (was: YARN-3611) > Add support for Docker image clean up >

[jira] [Updated] (YARN-6495) check docker container's exit code when writing to cgroup task files

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6495: -- Parent: YARN-8472 (was: YARN-3611) > check docker container's exit code when writing to cgroup task

[jira] [Updated] (YARN-8376) Separate white list for docker.trusted.registries and docker.privileged-container.registries

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8376: -- Parent: YARN-8472 (was: YARN-3611) > Separate white list for docker.trusted.registries and >

[jira] [Updated] (YARN-3854) Add localization support for docker images

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-3854: -- Parent: YARN-8472 (was: YARN-3611) > Add localization support for docker images >

[jira] [Updated] (YARN-8287) Update documentation and yarn-default related to the Docker runtime

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8287: -- Parent: YARN-8472 (was: YARN-3611) > Update documentation and yarn-default related to the Docker

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6456: -- Parent: YARN-8472 (was: YARN-3611) > Allow administrators to set a single ContainerRuntime for all

[jira] [Updated] (YARN-7848) Force removal of docker containers that do not get removed on first try

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7848: -- Parent: YARN-8472 (was: YARN-3611) > Force removal of docker containers that do not get removed on

[jira] [Updated] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8263: -- Parent: YARN-8472 (was: YARN-3611) > DockerClient still touches hadoop.tmp.dir >

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540716#comment-16540716 ] genericqa commented on YARN-8501: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8403) Nodemanager logs failed to download file with INFO level

2018-07-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8403: Issue Type: Sub-task (was: Improvement) Parent: YARN-8472 > Nodemanager logs failed to download

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540759#comment-16540759 ] Suma Shivaprasad commented on YARN-8501: [~snemeth] Patch LGTM,. Can you add some UTs for testing

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540810#comment-16540810 ] Wangda Tan commented on YARN-8480: -- [~snemeth]/[~templedf]. To me we should move this to node

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Wangda Tan (JIRA)
Reporter: Chen Qingcha >Priority: Major > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180711.patch, hadoop-2.7.2.gpu-port.patch, > hadoop-2.9.0.gpu-port.patch, hadoop_2.9.0.patch > > Original Estimate: 1,3

[jira] [Assigned] (YARN-8518) test-container-executor test_is_empty() is broken

2018-07-11 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-8518: - Assignee: Jim Brennan > test-container-executor test_is_empty() is broken >

[jira] [Commented] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2018-07-11 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540749#comment-16540749 ] Shane Kumpf commented on YARN-3611: --- +1000 :) Great effort everyone. I'm excited for what has been

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540885#comment-16540885 ] Daniel Templeton commented on YARN-8480: I don't disagree that in terms of general use cases

[jira] [Commented] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-11 Thread Chen Qingcha (JIRA)
Major > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180711.patch, hadoop-2.7.2.gpu-port.patch, > hadoop-2.9.0.gpu-port.patch, hadoop_2.9.0.patch > > Original Estimate: 1,344h > Remaining Estimate: 1,344h > > We enh

[jira] [Updated] (YARN-7904) Privileged, trusted containers need all of their bind-mounted directories to be read-only

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-7904: -- Parent Issue: YARN-8472 (was: YARN-3611) > Privileged, trusted containers need all of their

[jira] [Resolved] (YARN-7197) Add support for a volume blacklist for docker containers

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-7197. --- Resolution: Won't Fix There are currently no plans to attempt to implement this feature. Feel free to

[jira] [Commented] (YARN-6495) check docker container's exit code when writing to cgroup task files

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540722#comment-16540722 ] genericqa commented on YARN-6495: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5168) Add port mapping handling when docker container use bridge network

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5168: -- Parent Issue: YARN-8472 (was: YARN-3611) > Add port mapping handling when docker container use bridge

[jira] [Resolved] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger resolved YARN-3611. --- Resolution: Fixed We have closed out Phase 1 of Docker container support and are now moving onto

[jira] [Commented] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-07-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540867#comment-16540867 ] Suma Shivaprasad commented on YARN-7639: Fixed UT failure > Queue Management scheduling edit

[jira] [Updated] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-07-11 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7639: --- Attachment: YARN-7639.2.patch > Queue Management scheduling edit policy class needs to be

[jira] [Commented] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-07-11 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540717#comment-16540717 ] genericqa commented on YARN-7639: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8472) YARN Container Phase 2

2018-07-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8472: -- Description: In YARN-3611, we have implemented basic Docker container support for YARN.  This story is

[jira] [Commented] (YARN-3611) Support Docker Containers In LinuxContainerExecutor

2018-07-11 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540740#comment-16540740 ] Eric Yang commented on YARN-3611: - We have completed 88 out of 105 tasks in the first milestone, and moved