[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-25 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099801#comment-16099801 ] Rohith Sharma K S commented on YARN-6733: - committing shortly > Add table for storing

[jira] [Commented] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099731#comment-16099731 ] Hudson commented on YARN-6150: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12052 (See

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.013.patch updating patch. > Improve performance of resource profile branch >

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099745#comment-16099745 ] Varun Saxena commented on YARN-6734: [~rohithsharma], can we add a test to verify write into

[jira] [Updated] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-07-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6133: --- Summary: [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

[jira] [Commented] (YARN-6850) Ensure that supplemented timestamp is stored only for flow run metrics

2017-07-25 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099810#comment-16099810 ] Varun Saxena commented on YARN-6850: Thanks [~vrushalic] for review and commit. Thanks [~jrottinghuis]

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-25 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099872#comment-16099872 ] Rohith Sharma K S commented on YARN-6734: - bq. Can we refactor store*ToSubApplicationTable methods.

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-25 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100062#comment-16100062 ] Shane Kumpf commented on YARN-6726: --- Thanks for the review, [~wangda]. I will add additional validation

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-25 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6802: -- Attachment: YARN-6802.002.patch > Support view leaf queue am resource usage in RM web ui >

[jira] [Created] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Muhammad Samir Khan (JIRA)
Muhammad Samir Khan created YARN-6867: - Summary: AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime Key: YARN-6867 URL:

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100276#comment-16100276 ] Muhammad Samir Khan commented on YARN-6867: --- Sorry, it looks like the problem was solved in trunk

[jira] [Assigned] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts reassigned YARN-6867: Assignee: Nathan Roberts > AbstractYarnScheduler reports the configured maximum resources,

[jira] [Updated] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-6867: -- Attachment: YARN-6867.001.patch Added a new unit test in TestRM to demonstrate how an

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100208#comment-16100208 ] Muhammad Samir Khan commented on YARN-6867: --- Requesting [~rkanter] and [~kasha] for comments. >

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100280#comment-16100280 ] Muhammad Samir Khan commented on YARN-6867: --- The patch in YARN-4719 solves the problem. >

[jira] [Updated] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-25 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-4161: -- Attachment: YARN-4161.006.patch Good catch, [~sunilg]. Update a new patch to include that check. > Capacity

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-07-25 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100396#comment-16100396 ] Ray Chiang commented on YARN-6868: -- [~haibo.chen] or [~sjlee0], can you let me know if the above is also

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-07-25 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100391#comment-16100391 ] Ray Chiang commented on YARN-6868: -- Oddly, I also see this entry as being unnecessary or at least I can't

[jira] [Commented] (YARN-6867) AbstractYarnScheduler reports the configured maximum resources, instead of the actual, even after the configured waittime

2017-07-25 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100193#comment-16100193 ] Muhammad Samir Khan commented on YARN-6867: --- If the application gets submitted before the wait

[jira] [Created] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-07-25 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-6868: Summary: Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml Key: YARN-6868 URL: https://issues.apache.org/jira/browse/YARN-6868 Project: Hadoop

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100167#comment-16100167 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] for the review. {quote} In ActiveUsersManager, could

[jira] [Updated] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-07-25 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6868: - Attachment: YARN-6868.001.patch > Add test scope to certain entries in hadoop-yarn-server-resourcemanager

[jira] [Created] (YARN-6869) Resources.lessThan() et al should not use ResourceCalculator.compare()

2017-07-25 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6869: -- Summary: Resources.lessThan() et al should not use ResourceCalculator.compare() Key: YARN-6869 URL: https://issues.apache.org/jira/browse/YARN-6869 Project:

[jira] [Commented] (YARN-6869) Resources.lessThan() et al should not use ResourceCalculator.compare()

2017-07-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100548#comment-16100548 ] Daniel Templeton commented on YARN-6869: The other thing I'm seeing here is that many of the uses

[jira] [Commented] (YARN-6869) Resources.lessThan() et al should not use ResourceCalculator.compare()

2017-07-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100526#comment-16100526 ] Sunil G commented on YARN-6869: --- Thanks [~templedf] While doing preemption, we ran into this issue. But I was

[jira] [Assigned] (YARN-6869) Resources.lessThan() et al should not use ResourceCalculator.compare()

2017-07-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6869: -- Assignee: Daniel Templeton > Resources.lessThan() et al should not use

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-25 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100427#comment-16100427 ] Konstantinos Karanasos commented on YARN-3409: -- Thanks for the answers, [~sunilg] and

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100865#comment-16100865 ] Jian He commented on YARN-6130: --- yeah, I think we can compare the token. bq. this is used to handle race

[jira] [Commented] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100957#comment-16100957 ] Hadoop QA commented on YARN-6866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-07-25 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100967#comment-16100967 ] Ray Chiang commented on YARN-6868: -- Unit test failure looks to be the same as YARN-5548. > Add test scope

[jira] [Resolved] (YARN-6468) Add Max AM Resource and AM Resource Usage to FairScheduler WebUI

2017-07-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-6468. Resolution: Duplicate > Add Max AM Resource and AM Resource Usage to FairScheduler WebUI >

[jira] [Updated] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-25 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-6593: - Attachment: YARN-6593.005.patch Uploading new version of the patch. I addressed

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100660#comment-16100660 ] Hadoop QA commented on YARN-6868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100684#comment-16100684 ] Hadoop QA commented on YARN-6734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-07-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100587#comment-16100587 ] Daniel Templeton commented on YARN-6610: Yeah, the TreeSet was just there until YARN-6788 gets in.

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100594#comment-16100594 ] Hudson commented on YARN-6804: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12053 (See

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100652#comment-16100652 ] Hadoop QA commented on YARN-6802: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100718#comment-16100718 ] Wangda Tan commented on YARN-3409: -- [~kkaranasos]/[~naganarasimha...@apache.org]. bq. For point 3 re:

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100661#comment-16100661 ] Hadoop QA commented on YARN-4161: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100725#comment-16100725 ] Jian He commented on YARN-6804: --- The trunk patch is committed, thanks Billie ! > Allow custom hostname for

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100732#comment-16100732 ] Hudson commented on YARN-6307: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12054 (See

[jira] [Updated] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6866: - Attachment: YARN-6866-YARN-2915.v4.patch Fixing the test failure. > Minor clean-up and fixes in

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101062#comment-16101062 ] Hadoop QA commented on YARN-6802: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-25 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101064#comment-16101064 ] Rohith Sharma K S commented on YARN-6130: - Yes, it is implemented in YARN-5638. Compare code is

[jira] [Updated] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2017-07-25 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-3931: --- Attachment: YARN-3931.002.patch Sorry, I missed this issue for long time. I attached a patch including

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101086#comment-16101086 ] Akira Ajisaka commented on YARN-6712: - No, I don't mind. you can split it by yourself. Thanks. >

[jira] [Commented] (YARN-6871) Add a new REST API GetAppReport call lighter and faster than the current one

2017-07-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101091#comment-16101091 ] Sunil G commented on YARN-6871: --- Yes [~subru]. You could use "deSelects=resourceRequest" for getApps/getApp

[jira] [Assigned] (YARN-6862) Nodemanager resource usage metrics sometimes are negative

2017-07-25 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou reassigned YARN-6862: - Assignee: YunFan Zhou > Nodemanager resource usage metrics sometimes are negative >

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101095#comment-16101095 ] Sunil G commented on YARN-6788: --- Findbugs is unrelated and it is from branch compilation. After this patch,

[jira] [Commented] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101110#comment-16101110 ] Hadoop QA commented on YARN-6866: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6866) Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk

2017-07-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6866: - Summary: Minor clean-up and fixes in anticipation of YARN-2915 merge with trunk (was: Minor

[jira] [Comment Edited] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100749#comment-16100749 ] Jian He edited comment on YARN-6413 at 7/25/17 8:44 PM: bq. Right now

[jira] [Commented] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100760#comment-16100760 ] Wangda Tan commented on YARN-6855: -- Thanks [~naganarasimha...@apache.org] for working on the patch,

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100778#comment-16100778 ] Hadoop QA commented on YARN-6593: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100791#comment-16100791 ] Arun Suresh commented on YARN-6870: --- Thanks for raising this [~brookz]. Agreed, this can be a problem..

[jira] [Updated] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6870: -- Target Version/s: 2.9.0, 3.0.0-beta1 > ResourceUtilization/ContainersMonitorImpl is calculating CPU

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-07-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100795#comment-16100795 ] Yufei Gu commented on YARN-6505: Thanks [~GergelyNovak] for working on this. Looks good to me generally.

[jira] [Commented] (YARN-6413) Decouple Yarn Registry API from ZK

2017-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100749#comment-16100749 ] Jian He commented on YARN-6413: --- bq. Right now yarn-native-services doesn't compile for me with a pom.xml

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100748#comment-16100748 ] Wangda Tan commented on YARN-6726: -- Thanks for explanations [~shaneku...@gmail.com], I still not fully

[jira] [Commented] (YARN-6031) Application recovery has failed when node label feature is turned off during RM recovery

2017-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100766#comment-16100766 ] Jian He commented on YARN-6031: --- bq. In RMAppManager#createAndPopulateNewRMApp, app is just created whether

[jira] [Created] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-25 Thread Brook Zhou (JIRA)
Brook Zhou created YARN-6870: Summary: ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise Key: YARN-6870 URL: https://issues.apache.org/jira/browse/YARN-6870

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100861#comment-16100861 ] Wangda Tan commented on YARN-6033: -- While doing compilation with the patch, I found it breaks build for

[jira] [Updated] (YARN-6852) [YARN-6223] Native code changes to support isolate GPU devices by using CGroups

2017-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6852: - Attachment: YARN-6852.002.patch Removed docker-related logics from the patch. (ver. 002). This patch

[jira] [Updated] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6866: --- Attachment: YARN-6866-YARN-2915.v1.patch > Minor clean-up and fixes in anticipation of merge with

[jira] [Created] (YARN-6871) Add a new REST API GetAppReport call lighter and faster than the current one

2017-07-25 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6871: -- Summary: Add a new REST API GetAppReport call lighter and faster than the current one Key: YARN-6871 URL: https://issues.apache.org/jira/browse/YARN-6871

[jira] [Commented] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100911#comment-16100911 ] Hadoop QA commented on YARN-6866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6871) Add a new REST API GetAppReport call lighter and faster than the current one

2017-07-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100910#comment-16100910 ] Subru Krishnan commented on YARN-6871: -- [~giovanni.fumarola], +1 on the proposal. Can we use the

[jira] [Comment Edited] (YARN-6871) Add a new REST API GetAppReport call lighter and faster than the current one

2017-07-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100910#comment-16100910 ] Subru Krishnan edited comment on YARN-6871 at 7/25/17 10:53 PM:

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100912#comment-16100912 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100916#comment-16100916 ] Wangda Tan commented on YARN-6788: -- [~sunilg], not sure if findbugs is a real issue, could you check that?

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100928#comment-16100928 ] Hadoop QA commented on YARN-5548: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6866: --- Attachment: YARN-6866-YARN-2915.v2.patch > Minor clean-up and fixes in anticipation of merge with

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101119#comment-16101119 ] Jian He commented on YARN-6130: --- oh, saw it. > [ATSv2 Security] Generate a delegation token for AM when app

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101122#comment-16101122 ] Hadoop QA commented on YARN-3931: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099549#comment-16099549 ] Hadoop QA commented on YARN-6864: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6150: Component/s: (was: yarn) test > TestContainerManagerSecurity tests for Yarn

[jira] [Updated] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-07-25 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6678: --- Attachment: YARN-6678.branch-2.005.patch Attached branch-2 patch for cleanly applying. Thanks [~sunilg] and

[jira] [Resolved] (YARN-6822) TestContainerManagerSecurity tests fail on trunk

2017-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka resolved YARN-6822. - Resolution: Duplicate Fixed by YARN-6150. Please feel free to reopen this if the error is not

[jira] [Commented] (YARN-4522) Queue acl can be checked at app submission

2017-07-25 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099555#comment-16099555 ] Bibin A Chundatt commented on YARN-4522: [~jianhe] One clarification regarding this change . If

[jira] [Comment Edited] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-07-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057150#comment-16057150 ] Akira Ajisaka edited comment on YARN-6150 at 7/25/17 6:20 AM: -- If the hostname

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-25 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0017.patch > Use MockRMMemoryStateStore to reduce test failures >

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099571#comment-16099571 ] Hadoop QA commented on YARN-6307: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099573#comment-16099573 ] Hadoop QA commented on YARN-6804: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-07-25 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099580#comment-16099580 ] Rohith Sharma K S commented on YARN-6102: - thanks [~sunilg] [~jianhe] [~Naganarasimha]

[jira] [Commented] (YARN-6031) Application recovery has failed when node label feature is turned off during RM recovery

2017-07-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099594#comment-16099594 ] Sunil G commented on YARN-6031: --- Hi [~jianhe] Few doubts here, bq.1. Below code catches

[jira] [Commented] (YARN-6240) TestCapacityScheduler.testRefreshQueuesWithQueueDelete fails randomly

2017-07-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099615#comment-16099615 ] Naganarasimha G R commented on YARN-6240: - Hi [~rohithsharma], As discussed offline, it requires

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-25 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6802: -- Attachment: YARN-6802.002.patch > Support view leaf queue am resource usage in RM web ui >

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-25 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6802: -- Attachment: (was: YARN-6802.002.patch) > Support view leaf queue am resource usage in RM web ui >

[jira] [Commented] (YARN-6855) CLI Proto Modifications to support Node Attributes

2017-07-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101017#comment-16101017 ] Naganarasimha G R commented on YARN-6855: - thanks for the quick review [~wangda], # agree # would

[jira] [Commented] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101046#comment-16101046 ] Hadoop QA commented on YARN-6866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6866: - Attachment: YARN-6866-YARN-2915.v3.patch Rebasing patch after branch force push > Minor clean-up

[jira] [Commented] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100995#comment-16100995 ] Carlo Curino commented on YARN-6866: Patches looks good to me. I will check that YARN-5412 doesn't have

[jira] [Commented] (YARN-3409) Support Node Attribute functionality

2017-07-25 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16100991#comment-16100991 ] Naganarasimha G R commented on YARN-3409: - bq. node1:java=8\[string\],ssd=false\[boolean\] thanks

[jira] [Commented] (YARN-6712) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-07-25 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101023#comment-16101023 ] Yeliang Cang commented on YARN-6712: Hi, [~ajisakaa], would you mind me taking this over? I am

[jira] [Commented] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16101039#comment-16101039 ] Hadoop QA commented on YARN-6866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||