[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6736: Attachment: YARN-6736.001.patch The patch looks approach looks good to me! It also

[jira] [Updated] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7738: -- Attachment: YARN-7738.003.patch attaching patch for jenkins. > CapacityScheduler: Support refresh maximum

[jira] [Updated] (YARN-7727) Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7727: -- Summary: Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector (was: Logging issues

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323791#comment-16323791 ] genericqa commented on YARN-6736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7727) Incorrect log levels in few logs with QueuePriorityContainerCandidateSelector

2018-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323803#comment-16323803 ] Hudson commented on YARN-7727: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13484 (See

[jira] [Comment Edited] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323755#comment-16323755 ] Rohith Sharma K S edited comment on YARN-6736 at 1/12/18 10:30 AM: --- The

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323745#comment-16323745 ] Sunil G commented on YARN-7624: --- [~maniraj...@gmail.com], could u pls share a patch based on your analysis. I

[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6736: Target Version/s: 3.1.0, 3.0.1 Description: When the cluster is being upgraded from

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323787#comment-16323787 ] Sunil G commented on YARN-6736: --- Thanks [~agresch] and [~rohithsharma]. This makes sense to have it can where

[jira] [Commented] (YARN-7672) hadoop-sls can not simulate huge scale of YARN

2018-01-12 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323728#comment-16323728 ] stefanlee commented on YARN-7672: - [~zsl2007] thanks for this jira. i have merged this patch to my hadoop

[jira] [Comment Edited] (YARN-7672) hadoop-sls can not simulate huge scale of YARN

2018-01-12 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323728#comment-16323728 ] stefanlee edited comment on YARN-7672 at 1/12/18 9:18 AM: -- [~zsl2007] thanks for

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323743#comment-16323743 ] Sunil G commented on YARN-7738: --- Thanks [~leftnoteasy]. Fix seems fine to me Few comments: #

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-12 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323865#comment-16323865 ] Gergo Repas commented on YARN-7451: --- Thanks [~snemeth] for the patch. A couple of comments: # You

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323832#comment-16323832 ] Sunil G commented on YARN-7159: --- bq.Here, value has been configured as 10 with "" units, but

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323837#comment-16323837 ] Sunil G commented on YARN-7728: --- Thanks [~eepayne], this will be really helpful when preemption happens. I

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323888#comment-16323888 ] genericqa commented on YARN-7738: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7742) [UI2] Duplicated containers are rendered per attempt

2018-01-12 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-7742: --- Summary: [UI2] Duplicated containers are rendered per attempt Key: YARN-7742 URL: https://issues.apache.org/jira/browse/YARN-7742 Project: Hadoop YARN

[jira] [Assigned] (YARN-7742) [UI2] Duplicated containers are rendered per attempt

2018-01-12 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7742: - Assignee: Vasudevan Skm > [UI2] Duplicated containers are rendered per attempt >

[jira] [Commented] (YARN-7739) Revisit scheduler resource normalization behavior for max allocation

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324014#comment-16324014 ] Jason Lowe commented on YARN-7739: -- I'm not a fan of silently capping the app's request. If the app says

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324185#comment-16324185 ] Szilard Nemeth commented on YARN-7451: -- Unfortunately, I got an unfavorable response for the legal

[jira] [Comment Edited] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324185#comment-16324185 ] Szilard Nemeth edited comment on YARN-7451 at 1/12/18 4:21 PM: ---

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324140#comment-16324140 ] Jason Lowe commented on YARN-3895: -- I think Application ACLs could work fine for the straightforward case

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324221#comment-16324221 ] Haibo Chen commented on YARN-7064: -- bq. I think the logging inside isAvailable should be enough. I am not

[jira] [Updated] (YARN-7729) Add support for setting the PID namespace mode

2018-01-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7729: - Attachment: YARN-7729.001.patch Attaching first draft. This patch adds a yarn-site.xml property

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

2018-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324165#comment-16324165 ] Eric Payne commented on YARN-7728: -- Thanks a lot for the comments, [~sunilg]. bq. n 3.0, we support

[jira] [Commented] (YARN-7724) yarn application status should support application name

2018-01-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324156#comment-16324156 ] Billie Rinaldi commented on YARN-7724: -- The changes to ApplicationCLI look good. The changes to

[jira] [Commented] (YARN-7739) Revisit scheduler resource normalization behavior for max allocation

2018-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324431#comment-16324431 ] Wangda Tan commented on YARN-7739: -- Thanks [~jlowe] for the comment, I agree with all your points.

[jira] [Updated] (YARN-7743) UI component placement overlaps on Safari

2018-01-12 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7743: - Attachment: Screen Shot 2018-01-11 at 5.20.48 PM.png Screen Shot 2018-01-11 at 5.17.18

[jira] [Created] (YARN-7743) UI component placement overlaps on Safari

2018-01-12 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7743: Summary: UI component placement overlaps on Safari Key: YARN-7743 URL: https://issues.apache.org/jira/browse/YARN-7743 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3660: --- Summary: [GPG] Federation Global Policy Generator (service hook only) (was: [GPG] Federation Global

[jira] [Commented] (YARN-7731) RegistryDNS should handle upstream DNS returning CNAME

2018-01-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324378#comment-16324378 ] Eric Yang commented on YARN-7731: - [~billie.rinaldi] Thanks Billie. > RegistryDNS should handle upstream

[jira] [Updated] (YARN-7724) yarn application status should support application name

2018-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7724: -- Attachment: YARN-7724.04.patch Thanks Billie for review, uploaded a new patch > yarn application status should

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324414#comment-16324414 ] genericqa commented on YARN-7738: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7739) Revisit scheduler resource normalization behavior for max allocation

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324511#comment-16324511 ] Jason Lowe commented on YARN-7739: -- I'm OK with getting rid of implicitly shrinking containers since I

[jira] [Commented] (YARN-7731) RegistryDNS should handle upstream DNS returning CNAME

2018-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324343#comment-16324343 ] Hudson commented on YARN-7731: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13486 (See

[jira] [Commented] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324362#comment-16324362 ] Carlo Curino commented on YARN-3660: [~botong] the patch seems generally ok but please: # Address

[jira] [Assigned] (YARN-7654) Support ENTRY_POINT for docker container

2018-01-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7654: --- Assignee: Shane Kumpf > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-01-12 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324413#comment-16324413 ] Shane Kumpf commented on YARN-7654: --- I can work on this as a follow on to the recovery and clean up

[jira] [Updated] (YARN-7671) Improve Diagonstic message for stop yarn native service

2018-01-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7671: Attachment: YARN-7671.002.patch > Improve Diagonstic message for stop yarn native service >

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-01-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324453#comment-16324453 ] Eric Yang commented on YARN-7221: - Can someone review this patch? Thanks > Add security check for

[jira] [Updated] (YARN-7671) Improve Diagonstic message for stop yarn native service

2018-01-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7671: Attachment: YARN-7671.001.patch Patch 1 includes the suggested fix > Improve Diagonstic message for

[jira] [Updated] (YARN-7671) Improve Diagonstic message for stop yarn native service

2018-01-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7671: Attachment: (was: YARN-7671.002.patch) > Improve Diagonstic message for stop yarn native service

[jira] [Updated] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

2018-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7728: - Attachment: YARN-7728.002.patch > Expose and expand container preemptions in Capacity Scheduler queue

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324484#comment-16324484 ] Eric Badger commented on YARN-7516: --- [~eyang], thanks for the patch. {noformat} +// Disable set

[jira] [Commented] (YARN-6648) [GPG] Add FederationStateStore interfaces for Global Policy Generator

2018-01-12 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324373#comment-16324373 ] Carlo Curino commented on YARN-6648: [~botong] the changes in this JIRA seem fine/harmless. However,

[jira] [Updated] (YARN-7671) Improve Diagonstic message for stop yarn native service

2018-01-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7671: Attachment: YARN-7671.002.patch Implemented changes as per [~jianhe] feedback > Improve Diagonstic

[jira] [Assigned] (YARN-7741) Eliminate extra log statement from yarn app -destroy cli

2018-01-12 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-7741: --- Assignee: Chandni Singh > Eliminate extra log statement from yarn app -destroy cli >

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324489#comment-16324489 ] Eric Badger commented on YARN-7516: --- Also, going back to the registry parsing, what about the case where

[jira] [Commented] (YARN-7731) RegistryDNS should handle upstream DNS returning CNAME

2018-01-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324258#comment-16324258 ] Billie Rinaldi commented on YARN-7731: -- +1 for patch 003. I will commit this with whitespace=fix. >

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324269#comment-16324269 ] Miklos Szegedi commented on YARN-7064: -- The asflicense and unit test issues are unrelated. bq. Under

[jira] [Commented] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2018-01-12 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324274#comment-16324274 ] Yufei Gu commented on YARN-6486: I'm not a fan of how RM_SCHEDULER_INCREMENT_ALLOCATION_* and the defaults

[jira] [Commented] (YARN-7729) Add support for setting the PID namespace mode

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324320#comment-16324320 ] genericqa commented on YARN-7729: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5366) Improve handling of the Docker container life cycle

2018-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324398#comment-16324398 ] Hudson commented on YARN-5366: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13487 (See

[jira] [Updated] (YARN-7729) Add support for setting the PID namespace mode

2018-01-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7729: - Attachment: YARN-7729.002.patch > Add support for setting the PID namespace mode >

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-12 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324450#comment-16324450 ] Vrushali C commented on YARN-3895: -- Thanks [~jlowe] , I will think over this and get back. > Support ACLs

[jira] [Assigned] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-7740: - Assignee: Jian He > Fix logging for destroy yarn service cli when app does not exist >

[jira] [Updated] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7740: -- Attachment: YARN-7740.1.patch > Fix logging for destroy yarn service cli when app does not exist >

[jira] [Updated] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7740: -- Attachment: YARN-7740.2.patch > Fix logging for destroy yarn service cli when app does not exist >

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-01-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324496#comment-16324496 ] Eric Badger commented on YARN-7221: --- Hi, [~eyang], I will review this when I get a chance. Probably early

[jira] [Commented] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324529#comment-16324529 ] genericqa commented on YARN-7740: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324544#comment-16324544 ] genericqa commented on YARN-7740: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324568#comment-16324568 ] Eric Yang commented on YARN-7516: - [~ebadger] Thanks for the review. {quote} To be consistent with the

[jira] [Commented] (YARN-7724) yarn application status should support application name

2018-01-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324571#comment-16324571 ] Billie Rinaldi commented on YARN-7724: -- I'll rebuild the precommit build; it doesn't seem like that

[jira] [Assigned] (YARN-7737) prelaunch.err file not found exception on container failure

2018-01-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reassigned YARN-7737: --- Assignee: Keqiu Hu (was: Jonathan Hung) > prelaunch.err file not found exception on container

[jira] [Commented] (YARN-7728) Expose and expand container preemptions in Capacity Scheduler queue metrics

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324624#comment-16324624 ] genericqa commented on YARN-7728: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324639#comment-16324639 ] genericqa commented on YARN-7740: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7743) UI component placement overlaps on Safari

2018-01-12 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7743: - Component/s: yarn-ui-v2 > UI component placement overlaps on Safari >

[jira] [Updated] (YARN-7696) Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases

2018-01-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7696: -- Attachment: YARN-7696-YARN-6592.004.patch Updating patch based on comments from [~leftnoteasy]. Keeping

[jira] [Commented] (YARN-7724) yarn application status should support application name

2018-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324759#comment-16324759 ] Hudson commented on YARN-7724: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13490 (See

[jira] [Commented] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324892#comment-16324892 ] Hudson commented on YARN-7705: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13493 (See

[jira] [Commented] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324978#comment-16324978 ] genericqa commented on YARN-3660: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6599) Support rich placement constraints in scheduler

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325008#comment-16325008 ] genericqa commented on YARN-6599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325013#comment-16325013 ] genericqa commented on YARN-6736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6599) Support rich placement constraints in scheduler

2018-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6599: - Attachment: YARN-6599-YARN-6592.009.patch Attached ver.9 patch (wip), which added the new

[jira] [Commented] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324884#comment-16324884 ] Miklos Szegedi commented on YARN-7705: -- +1. > Create the container log directory with correct sticky

[jira] [Updated] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7705: - Fix Version/s: 2.10.0 > Create the container log directory with correct sticky bit in C code >

[jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324906#comment-16324906 ] Miklos Szegedi commented on YARN-7712: -- Thank you, [~chris.douglas] for the reply. Here are my

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2018-01-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.009.patch - Clean up how trusted image is checked. - Disable ability to

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324955#comment-16324955 ] genericqa commented on YARN-7516: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7729) Add support for setting the PID namespace mode

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324818#comment-16324818 ] genericqa commented on YARN-7729: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7696) Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324936#comment-16324936 ] genericqa commented on YARN-7696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-12 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5473: - Attachment: YARN-5473-YARN-1011.prelim.patch Attaching a preliminary patch for initial Jenkins report. >

[jira] [Updated] (YARN-7705) Create the container log directory with correct sticky bit in C code

2018-01-12 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7705: - Fix Version/s: 3.0.1 > Create the container log directory with correct sticky bit in C code >

[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2018-01-12 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6736: Attachment: YARN-6736.002.patch [~agresch] would you please confirm all your original

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16325003#comment-16325003 ] genericqa commented on YARN-5473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324545#comment-16324545 ] Jason Lowe commented on YARN-2185: -- Thanks for updating the patch! bq. I was wondering, if it should be

[jira] [Commented] (YARN-7671) Improve Diagonstic message for stop yarn native service

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324533#comment-16324533 ] genericqa commented on YARN-7671: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7671) Improve Diagonstic message for stop yarn native service

2018-01-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324661#comment-16324661 ] Hudson commented on YARN-7671: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13488 (See

[jira] [Commented] (YARN-7696) Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases

2018-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324695#comment-16324695 ] Wangda Tan commented on YARN-7696: -- Latest patch looks good, thanks [~asuresh] for updating the patch. +1

[jira] [Updated] (YARN-7740) Fix logging for destroy yarn service cli when app does not exist

2018-01-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7740: -- Attachment: YARN-7740.3.patch > Fix logging for destroy yarn service cli when app does not exist >

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324578#comment-16324578 ] genericqa commented on YARN-7738: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324644#comment-16324644 ] Botong Huang commented on YARN-3660: Thanks [~curino] for the quick review! v2 patch uploaded > [GPG]

[jira] [Commented] (YARN-7479) TestContainerManagerSecurity.testContainerManager[Simple] flaky in trunk

2018-01-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324667#comment-16324667 ] Robert Kanter commented on YARN-7479: - Oops, ya, that should have been x 1000 :) Would it also make

[jira] [Updated] (YARN-3660) [GPG] Federation Global Policy Generator (service hook only)

2018-01-12 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-3660: --- Attachment: YARN-3660-YARN-7402.v2.patch > [GPG] Federation Global Policy Generator (service hook

[jira] [Created] (YARN-7744) Fix Get status rest api response when application is destroyed

2018-01-12 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7744: Summary: Fix Get status rest api response when application is destroyed Key: YARN-7744 URL: https://issues.apache.org/jira/browse/YARN-7744 Project: Hadoop YARN

[jira] [Commented] (YARN-7724) yarn application status should support application name

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324531#comment-16324531 ] genericqa commented on YARN-7724: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7712) Add ability to ignore timestamps in localized files

2018-01-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324620#comment-16324620 ] Chris Douglas commented on YARN-7712: - Got it. The purpose of the timestamp is not security, but

[jira] [Commented] (YARN-7729) Add support for setting the PID namespace mode

2018-01-12 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324627#comment-16324627 ] genericqa commented on YARN-7729: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7739) Revisit scheduler resource normalization behavior for max allocation

2018-01-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16324699#comment-16324699 ] Wangda Tan commented on YARN-7739: -- Thanks [~jlowe], to me it is also a bug :). I think we should get rid

[jira] [Created] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-12 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7745: - Summary: Allow DistributedShell to take a placement specification for containers it wants to launch Key: YARN-7745 URL: https://issues.apache.org/jira/browse/YARN-7745

  1   2   >