[jira] [Commented] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243535#comment-16243535 ] Bibin A Chundatt commented on YARN-7454: +1 LGTM > RMAppAttemptMetrics#getAggregateResourceUsage

[jira] [Comment Edited] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243535#comment-16243535 ] Bibin A Chundatt edited comment on YARN-7454 at 11/8/17 8:47 AM: - +1 LGTM.

[jira] [Updated] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-08 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7119: --- Attachment: YARN-7119.004.patch > yarn rmadmin -updateNodeResource should be updated for resource

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-08 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.016.patch > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-08 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243363#comment-16243363 ] Ted Yu commented on YARN-7346: -- I am not sure a different folder helps. As long as mapreduce.tar.gz,

[jira] [Created] (YARN-7463) Using getLocalPathForWrite for Container related debug information

2017-11-08 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-7463: --- Summary: Using getLocalPathForWrite for Container related debug information Key: YARN-7463 URL: https://issues.apache.org/jira/browse/YARN-7463 Project: Hadoop YARN

[jira] [Updated] (YARN-7464) Allow fiters on Nodes page

2017-11-08 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasudevan Skm updated YARN-7464: Attachment: YARN-7464.001.patch Screen Shot 2017-11-08 at 4.56.04 PM.png

[jira] [Created] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-08 Thread Tao Yang (JIRA)
Tao Yang created YARN-7461: -- Summary: DominantResourceCalculator#ratio calculation problem when right resource contains zero value Key: YARN-7461 URL: https://issues.apache.org/jira/browse/YARN-7461

[jira] [Updated] (YARN-7453) RM fail to switch to active after first successful start

2017-11-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7453: -- Attachment: YARN-7453.001.patch Reverted YARN-6840's ResourceManager and ZKRMStateStore changes. This solves

[jira] [Commented] (YARN-7454) RMAppAttemptMetrics#getAggregateResourceUsage can NPE due to double lookup

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243820#comment-16243820 ] Hadoop QA commented on YARN-7454: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-08 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243700#comment-16243700 ] Akira Ajisaka commented on YARN-7406: - LGTM, +1 > Moving logging APIs over to slf4j in hadoop-yarn-api

[jira] [Updated] (YARN-7462) Render outstanding resource requests on application details page

2017-11-08 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasudevan Skm updated YARN-7462: Attachment: YARN-7462.002.patch Fixes the typo in the previous patch [~sunil.gov...@gmail.com] >

[jira] [Commented] (YARN-7462) Render outstanding resource requests on application details page

2017-11-08 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243638#comment-16243638 ] Vasudevan Skm commented on YARN-7462: - [~sunil.gov...@gmail.com][~wangda] > Render outstanding

[jira] [Updated] (YARN-7462) Render outstanding resource requests on application details page

2017-11-08 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasudevan Skm updated YARN-7462: Attachment: YARN-7462.001.patch > Render outstanding resource requests on application details page >

[jira] [Updated] (YARN-7462) Render outstanding resource requests on application details page

2017-11-08 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasudevan Skm updated YARN-7462: Attachment: Screen Shot 2017-11-08 at 3.24.30 PM.png > Render outstanding resource requests on

[jira] [Updated] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-08 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7461: --- Attachment: YARN-7461.001.patch > DominantResourceCalculator#ratio calculation problem when right resource >

[jira] [Created] (YARN-7462) Render outstanding resource requests on application details page

2017-11-08 Thread Vasudevan Skm (JIRA)
Vasudevan Skm created YARN-7462: --- Summary: Render outstanding resource requests on application details page Key: YARN-7462 URL: https://issues.apache.org/jira/browse/YARN-7462 Project: Hadoop YARN

[jira] [Updated] (YARN-7462) Render outstanding resource requests on application details page

2017-11-08 Thread Vasudevan Skm (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasudevan Skm updated YARN-7462: Attachment: Screen Shot 2017-11-08 at 3.38.48 PM.png > Render outstanding resource requests on

[jira] [Created] (YARN-7464) Allow fiters on Nodes page

2017-11-08 Thread Vasudevan Skm (JIRA)
Vasudevan Skm created YARN-7464: --- Summary: Allow fiters on Nodes page Key: YARN-7464 URL: https://issues.apache.org/jira/browse/YARN-7464 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7464) Allow fiters on Nodes page

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243798#comment-16243798 ] Hadoop QA commented on YARN-7464: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243982#comment-16243982 ] Shane Kumpf commented on YARN-7430: --- {quote} This is not true, see the following examples: {quote} I

[jira] [Assigned] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7453: - Assignee: Rohith Sharma K S (was: Arun Suresh) > Fix issue where RM fails to switch to active

[jira] [Commented] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244251#comment-16244251 ] Hudson commented on YARN-7453: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13203 (See

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244226#comment-16244226 ] Jason Lowe commented on YARN-7458: -- Thanks for the patch! If the container never completes then the

[jira] [Updated] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7343: -- Fix Version/s: (was: 2.9.0) > Add a junit test for ContainerScheduler recovery >

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243986#comment-16243986 ] Hadoop QA commented on YARN-7453: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244182#comment-16244182 ] Haibo Chen commented on YARN-7346: -- Please help me understand this. The mapreduce.tar.gz is shipped for

[jira] [Updated] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7453: -- Summary: Fix issue where RM fails to switch to active after first successful start (was: RM fail to

[jira] [Assigned] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7453: - Assignee: Arun Suresh > Fix issue where RM fails to switch to active after first successful start

[jira] [Commented] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2017-11-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244191#comment-16244191 ] Jason Lowe commented on YARN-3091: -- bq. I'm looking at reverting the read/write lock changes within the

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244205#comment-16244205 ] Arun Suresh commented on YARN-7453: --- +1 for the patch. I ran the failed and timeout tests locally - it

[jira] [Updated] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7343: -- Fix Version/s: 3.1.0 2.9.0 > Add a junit test for ContainerScheduler recovery >

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-11-08 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v7.patch > Add support for AMRMProxy HA > > >

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244498#comment-16244498 ] Shane Kumpf commented on YARN-7430: --- I still believe there will be an issue if we do not specify --user.

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244426#comment-16244426 ] Daniel Templeton commented on YARN-7457: I have a long to-do list. :) We'll see who gets there

[jira] [Comment Edited] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1623#comment-1623 ] Eric Yang edited comment on YARN-7430 at 11/8/17 6:07 PM: -- [~shaneku...@gmail.com]

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244289#comment-16244289 ] Sunil G commented on YARN-7330: --- cc/ [~skmvasu] > Add support to show GPU on UI/metrics >

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244338#comment-16244338 ] Daniel Templeton commented on YARN-7461: Thanks for the patch. Couple of comments: # Missing a

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244381#comment-16244381 ] Haibo Chen commented on YARN-7388: -- Thanks [~rkanter] for the review! killContainer() is solely called in

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1623#comment-1623 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] . Thank you for explaining your point of view.

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244360#comment-16244360 ] Daniel Templeton commented on YARN-7457: I think it makes good sense to abstract that out as a

[jira] [Commented] (YARN-7457) Delay scheduling should be an individual policy instead of part of scheduler implementation

2017-11-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244474#comment-16244474 ] Wangda Tan commented on YARN-7457: -- Sounds good :) > Delay scheduling should be an individual policy

[jira] [Commented] (YARN-3091) [Umbrella] Improve and fix locks of RM scheduler

2017-11-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244511#comment-16244511 ] Wangda Tan commented on YARN-3091: -- [~templedf]/[~jlowe], The RW locks are introduced to solve multiple

[jira] [Assigned] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-7461: -- Assignee: Tao Yang (was: Daniel Templeton) > DominantResourceCalculator#ratio

[jira] [Assigned] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-7461: -- Assignee: Daniel Templeton > DominantResourceCalculator#ratio calculation problem when

[jira] [Updated] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7388: - Attachment: YARN-7388.01.patch > TestAMRestart should be scheduler agnostic >

[jira] [Updated] (YARN-7453) RM fail to switch to active after first successful start

2017-11-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7453: Attachment: YARN-7453.001.patch Previous patch contains a little bit additional

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16243862#comment-16243862 ] Hadoop QA commented on YARN-7453: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-08 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244810#comment-16244810 ] Chandni Singh commented on YARN-7440: - When a ServiceRecord doesn't exist for multiple containers

[jira] [Comment Edited] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244825#comment-16244825 ] Shane Kumpf edited comment on YARN-7430 at 11/8/17 10:14 PM: - {quote} User foo

[jira] [Updated] (YARN-7399) Yarn services metadata storage improvement

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7399: Attachment: YARN-7399.png See the attached diagram for the current implementation and proposed refinement.

[jira] [Comment Edited] (YARN-7166) Container REST endpoints should report resource types

2017-11-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244860#comment-16244860 ] Yufei Gu edited comment on YARN-7166 at 11/8/17 10:32 PM: -- Look good to me

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244787#comment-16244787 ] Eric Yang commented on YARN-7430: - [~shaneku...@gmail.com] . {quote} I still believe there will be an issue

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244811#comment-16244811 ] Eric Badger commented on YARN-7430: --- I don't see how running the container as root will work with log

[jira] [Commented] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244822#comment-16244822 ] Billie Rinaldi commented on YARN-7440: -- Sounds good. Thanks, [~csingh]! > Optimization to AM recovery

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244825#comment-16244825 ] Shane Kumpf commented on YARN-7430: --- {quote} User foo should not allow to execute script owned by skumpf,

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244832#comment-16244832 ] Hadoop QA commented on YARN-7388: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7399) Yarn services metadata storage improvement

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7399: --- Assignee: Eric Yang > Yarn services metadata storage improvement >

[jira] [Commented] (YARN-7166) Container REST endpoints should report resource types

2017-11-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244860#comment-16244860 ] Yufei Gu commented on YARN-7166: Look good to me generally. How about marking {{allocatedMB}} and

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244668#comment-16244668 ] Hadoop QA commented on YARN-6128: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-08 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244669#comment-16244669 ] Chandni Singh commented on YARN-7440: - Seems like the test is failing because the previous container

[jira] [Created] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-08 Thread Sean Mackrory (JIRA)
Sean Mackrory created YARN-7465: --- Summary: start-yarn.sh fails to start ResourceManager unless running as root Key: YARN-7465 URL: https://issues.apache.org/jira/browse/YARN-7465 Project: Hadoop YARN

[jira] [Updated] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated YARN-7465: Attachment: YARN-7465.001.patch > start-yarn.sh fails to start ResourceManager unless running as

[jira] [Commented] (YARN-7166) Container REST endpoints should report resource types

2017-11-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244911#comment-16244911 ] Yufei Gu commented on YARN-7166: +1. Pending for Jenkins. > Container REST endpoints should report

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244910#comment-16244910 ] Eric Badger commented on YARN-7430: --- {quote} For users on LDAP, there is no good way to populate

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245019#comment-16245019 ] Hadoop QA commented on YARN-7143: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7166) Container REST endpoints should report resource types

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244892#comment-16244892 ] Daniel Templeton commented on YARN-7166: I don't think that's needed. CPU and memory are accessed

[jira] [Updated] (YARN-7166) Container REST endpoints should report resource types

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7166: --- Attachment: YARN-7166.003.patch > Container REST endpoints should report resource types >

[jira] [Commented] (YARN-7166) Container REST endpoints should report resource types

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244955#comment-16244955 ] Hadoop QA commented on YARN-7166: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244970#comment-16244970 ] Eric Yang commented on YARN-7430: - [~ebadger] They are two separate problems. A lot of conversation here

[jira] [Created] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-08 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-7466: --- Summary: ResourceRequest has a different default for allocationRequestId than Container Key: YARN-7466 URL: https://issues.apache.org/jira/browse/YARN-7466 Project:

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-08 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245000#comment-16245000 ] Konstantinos Karanasos commented on YARN-7437: -- Thanks, [~leftnoteasy]! Looks good, will

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: YARN-7143.003.patch Good point. > FileNotFound handling in ResourceUtils is

[jira] [Commented] (YARN-7399) Yarn services metadata storage improvement

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244883#comment-16244883 ] Eric Yang commented on YARN-7399: - The purpose of metadata storage API is to provide a low latency, simple

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-08 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244896#comment-16244896 ] Sean Mackrory commented on YARN-7465: - I suspect Yetus will complain that there are no tests - but this

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244901#comment-16244901 ] Daniel Templeton commented on YARN-7458: Couple more issues to fix while you're in there: #

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244948#comment-16244948 ] Eric Yang commented on YARN-7430: - [~ebadger] In a unix box, when a user run sudo commands, all logs are

[jira] [Comment Edited] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244970#comment-16244970 ] Eric Yang edited comment on YARN-7430 at 11/9/17 12:13 AM: --- [~ebadger] They are

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245016#comment-16245016 ] Shane Kumpf commented on YARN-7430: --- IMO, I think this issue can be closed as invalid. Most of this does

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-11-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245027#comment-16245027 ] Robert Kanter commented on YARN-7386: - The patch looks good to me. The Jenkins is too old and the

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244915#comment-16244915 ] Eric Badger commented on YARN-7430: --- Also, this conversation seems to have morphed into a dup of

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244926#comment-16244926 ] Yufei Gu commented on YARN-7143: Looks good to me generally. Only one thing, the new {{initializedResources

[jira] [Updated] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7458: Attachment: YARN-7458.002.patch Thanks for the reviews. That all makes sense. Uploading 002 patch:

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244988#comment-16244988 ] Jian He commented on YARN-7466: --- [~leftnoteasy], [~subru], opinion on this ? we should make it consistent ?

[jira] [Commented] (YARN-7465) start-yarn.sh fails to start ResourceManager unless running as root

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245012#comment-16245012 ] Hadoop QA commented on YARN-7465: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245021#comment-16245021 ] Daniel Templeton commented on YARN-7458: That's a lot of info level logging! Do we need that

[jira] [Commented] (YARN-7455) add_mounts can overrun temporary buffer

2017-11-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244579#comment-16244579 ] Eric Yang commented on YARN-7455: - There is a max size check in add_mounts to prevent buffer overflow. The

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244605#comment-16244605 ] Hadoop QA commented on YARN-7388: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7419) Implement Auto Queue Creation with modifications to queue mapping flow

2017-11-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244601#comment-16244601 ] Wangda Tan commented on YARN-7419: -- Thanks [~suma.shivaprasad] for updating the patch, more comments: 1)

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16244622#comment-16244622 ] Haibo Chen commented on YARN-7388: -- I believe the OOM-led test failures are unrelated, let me retrigger

[jira] [Resolved] (YARN-7425) Failed to renew delegation token when RM user's TGT is expired

2017-11-08 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie resolved YARN-7425. --- Resolution: Won't Fix > Failed to renew delegation token when RM user's TGT is expired >

[jira] [Commented] (YARN-7406) Moving logging APIs over to slf4j in hadoop-yarn-api

2017-11-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245217#comment-16245217 ] Bibin A Chundatt commented on YARN-7406: [~Cyl] Thank you for confirming .Still wondering how did i

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: YARN-7143.003.patch > FileNotFound handling in ResourceUtils is inconsistent >

[jira] [Updated] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-08 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7143: --- Attachment: (was: YARN-7143.003.patch) > FileNotFound handling in ResourceUtils is

[jira] [Updated] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-08 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7437: - Attachment: YARN-7437.005.patch Fixed some checkstyle issues before committing.

[jira] [Updated] (YARN-7413) Support resource type in SLS

2017-11-08 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7413: --- Attachment: YARN-7413.003.patch Uploaded patch v3 for the style issues and whitespace issues. > Support

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-11-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245042#comment-16245042 ] Haibo Chen commented on YARN-7388: -- The unit test failure is unrelated, tracked at YARN-5684 >

[jira] [Updated] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7458: Attachment: YARN-7458.003.patch It wasn't too spammy on my computer, but I guess it could be on

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-11-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245085#comment-16245085 ] Hadoop QA commented on YARN-7143: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7458) TestContainerManagerSecurity is still flakey

2017-11-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16245106#comment-16245106 ] Hudson commented on YARN-7458: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13206 (See

  1   2   >