[jira] [Updated] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7734: --- Attachment: YARN-7734.001.patch > YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess >

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416921#comment-16416921 ] Sunil G commented on YARN-6257: --- Thanks [~Tao Yang] {{the health metrics of capacity scheduler. This object

[jira] [Assigned] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7734: -- Assignee: Tao Yang (was: Xuan Gong) > YARN-5418 breaks

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416971#comment-16416971 ] genericqa commented on YARN-6257: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416898#comment-16416898 ] Tao Yang commented on YARN-7734: This UT failure is still there. Attached patch which adds  

[jira] [Updated] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7734: -- Affects Version/s: 3.0.1 3.1.0 > YARN-5418 breaks

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417105#comment-16417105 ] Tao Yang commented on YARN-7734: Thanks [~cheersyang] for review and committing. > YARN-5418 breaks

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-03-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417175#comment-16417175 ] Shane Kumpf commented on YARN-7935: --- {quote}Docker embedded DNS will use /etc/resolv.conf from host, and

[jira] [Updated] (YARN-8048) Support auto-spawning of admin configured services during bootstrap of rm/apiserver

2018-03-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8048: Attachment: YARN-8048.005.patch > Support auto-spawning of admin configured services during

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6257: --- Attachment: YARN-6257.004.patch > CapacityScheduler REST API produces incorrect JSON - JSON object >

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417197#comment-16417197 ] Bibin A Chundatt commented on YARN-7988: [~sunilg] Attaching patch after handling review comments.

[jira] [Commented] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417208#comment-16417208 ] Rohith Sharma K S commented on YARN-7946: - Overall looks good. Does below change make sense?

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417027#comment-16417027 ] genericqa commented on YARN-7734: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417091#comment-16417091 ] Weiwei Yang commented on YARN-7734: --- +1, will commit this shortly > YARN-5418 breaks

[jira] [Commented] (YARN-7734) YARN-5418 breaks TestContainerLogsPage.testContainerLogPageAccess

2018-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417126#comment-16417126 ] Hudson commented on YARN-7734: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13891 (See

[jira] [Comment Edited] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-03-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417175#comment-16417175 ] Shane Kumpf edited comment on YARN-7935 at 3/28/18 11:10 AM: - {quote}Docker

[jira] [Comment Edited] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-03-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417175#comment-16417175 ] Shane Kumpf edited comment on YARN-7935 at 3/28/18 11:10 AM: - {quote}Docker

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417016#comment-16417016 ] Weiwei Yang commented on YARN-6257: --- Hi [~Tao Yang] Can you please fix the checkstyle and findbugs

[jira] [Commented] (YARN-8048) Support auto-spawning of admin configured services during bootstrap of rm/apiserver

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417304#comment-16417304 ] genericqa commented on YARN-8048: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7946: - Attachment: YARN-7946.01.patch > Update TimelineServerV2 doc as per YARN-7919 >

[jira] [Updated] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7988: --- Attachment: YARN-7988-YARN-3409.007.patch > Refactor FSNodeLabelStore code for attributes

[jira] [Commented] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417319#comment-16417319 ] Haibo Chen commented on YARN-7946: -- Let me make that change in a new patch. > Update TimelineServerV2 doc

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417247#comment-16417247 ] genericqa commented on YARN-6257: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2018-03-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.012.patch > Add security check for privileged docker container >

[jira] [Commented] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2018-03-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417819#comment-16417819 ] Xuan Gong commented on YARN-1151: - [~rkanter]   Could you review the latest patch, please? > Ability to

[jira] [Updated] (YARN-8080) YARN native service should support component restart policy

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8080: - Attachment: (was: YARN-8080.004.patch) > YARN native service should support component restart policy >

[jira] [Updated] (YARN-8080) YARN native service should support component restart policy

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8080: - Attachment: YARN-8080.005.patch > YARN native service should support component restart policy >

[jira] [Commented] (YARN-8010) Add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417927#comment-16417927 ] Hudson commented on YARN-8010: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13894 (See

[jira] [Commented] (YARN-7623) Fix the CapacityScheduler Queue configuration documentation

2018-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417928#comment-16417928 ] Hudson commented on YARN-7623: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13894 (See

[jira] [Commented] (YARN-6936) [Atsv2] Retrospect storing entities into sub application table from client perspective

2018-03-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417766#comment-16417766 ] Rohith Sharma K S commented on YARN-6936: - bq. Let's add the scope of the entities to each of the

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417861#comment-16417861 ] Wangda Tan commented on YARN-8080: -- Attached ver.005 patch, which added tests to cover single component /

[jira] [Updated] (YARN-7690) expose reserved memory/Vcores of nodemanager at webUI

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7690: - Issue Type: Improvement (was: New Feature) > expose reserved memory/Vcores of nodemanager at webUI >

[jira] [Updated] (YARN-8084) Yarn native service rename for easier development?

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8084: - Environment: (was: There're a couple of classes with same name exists in YARN native service. Such as:

[jira] [Created] (YARN-8084) Yarn native service rename for easier development?

2018-03-28 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8084: Summary: Yarn native service rename for easier development? Key: YARN-8084 URL: https://issues.apache.org/jira/browse/YARN-8084 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8084) Yarn native service rename for easier development?

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8084: - Description: There're a couple of classes with same name exists in YARN native service. Such as: 1)

[jira] [Updated] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7946: - Attachment: YARN-7946.02.patch > Update TimelineServerV2 doc as per YARN-7919 >

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-03-28 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417988#comment-16417988 ] Gour Saha commented on YARN-7939: - Yes, we should use UPGRADING instead of UPGRADE (which is an action

[jira] [Commented] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-03-28 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418029#comment-16418029 ] Mridul Muralidharan commented on YARN-7935: --- [~eyang] I think there is some confusion here. Spark

[jira] [Commented] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418058#comment-16418058 ] genericqa commented on YARN-7946: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-2478) Nested containers should be supported

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2478. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and

[jira] [Updated] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7905: --- Attachment: YARN-7905-008.patch > Parent directory permission incorrect during public

[jira] [Commented] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417752#comment-16417752 ] Bibin A Chundatt commented on YARN-7905: Uploaded patch again to trigger jenkins. Missed to commit

[jira] [Updated] (YARN-1151) Ability to configure auxiliary services from HDFS-based JAR files

2018-03-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1151: Attachment: YARN-1151.2.patch > Ability to configure auxiliary services from HDFS-based JAR files >

[jira] [Commented] (YARN-7905) Parent directory permission incorrect during public localization

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417873#comment-16417873 ] genericqa commented on YARN-7905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8079) YARN native service should respect source file of ConfigFile inside Service/Component spec

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417747#comment-16417747 ] Wangda Tan edited comment on YARN-8079 at 3/28/18 4:58 PM: --- Thanks [~gsaha], Is

[jira] [Commented] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417773#comment-16417773 ] Rohith Sharma K S commented on YARN-7946: - The similar changes required in Building.txt file also

[jira] [Resolved] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7859. -- Resolution: Won't Do > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Reopened] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened YARN-7859: -- > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7859: - Hadoop Flags: (was: Reviewed) Fix Version/s: (was: 3.0.0) > New feature: add queue scheduling

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417963#comment-16417963 ] genericqa commented on YARN-7221: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-03-28 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418014#comment-16418014 ] Chandni Singh commented on YARN-7939: - [~gsaha] {quote}Yes, we should use UPGRADING instead of UPGRADE

[jira] [Commented] (YARN-7142) Support placement policy in yarn native services

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418053#comment-16418053 ] Wangda Tan commented on YARN-7142: -- Thanks [~gsaha], the last patch looks good. I would prefer to let

[jira] [Resolved] (YARN-2477) DockerContainerExecutor must support secure mode

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2477. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and

[jira] [Commented] (YARN-8079) YARN native service should respect source file of ConfigFile inside Service/Component spec

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417747#comment-16417747 ] Wangda Tan commented on YARN-8079: -- Thanks [~gsaha], Is there any additional suggestions to the patch or

[jira] [Commented] (YARN-8079) YARN native service should respect source file of ConfigFile inside Service/Component spec

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417852#comment-16417852 ] Wangda Tan commented on YARN-8079: -- [~eyang], thanks for the review! > YARN native service should respect

[jira] [Commented] (YARN-8048) Support auto-spawning of admin configured services during bootstrap of rm/apiserver

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417877#comment-16417877 ] Wangda Tan commented on YARN-8048: -- [~rohithsharma], Thanks for your responses. bq. For the 2nd level,

[jira] [Updated] (YARN-8012) Support Unmanaged Container Cleanup

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8012: - Target Version/s: 2.7.1, 3.2.0 (was: 2.7.1, 3.0.0) > Support Unmanaged Container Cleanup >

[jira] [Commented] (YARN-8079) YARN native service should respect source file of ConfigFile inside Service/Component spec

2018-03-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417920#comment-16417920 ] Eric Yang commented on YARN-8079: - [~leftnoteasy] Could you update yarn site markdown with the proper

[jira] [Commented] (YARN-8084) Yarn native service classes renaming for easier development?

2018-03-28 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417965#comment-16417965 ] Gour Saha commented on YARN-8084: - For the service.component.Component I suggest to rename it to

[jira] [Commented] (YARN-8077) The vmemLimit parameter in ContainersMonitorImpl#isProcessTreeOverLimit is confusing

2018-03-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417735#comment-16417735 ] Miklos Szegedi commented on YARN-8077: -- The Jenkins failure seems to be unrelated (protoc). Let me

[jira] [Updated] (YARN-8080) YARN native service should support component restart policy

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8080: - Attachment: YARN-8080.004.patch > YARN native service should support component restart policy >

[jira] [Commented] (YARN-7623) Fix the CapacityScheduler Queue configuration documentation

2018-03-28 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417937#comment-16417937 ] Jonathan Hung commented on YARN-7623: - Thanks! > Fix the CapacityScheduler Queue configuration

[jira] [Commented] (YARN-8048) Support auto-spawning of admin configured services during bootstrap of rm/apiserver

2018-03-28 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417980#comment-16417980 ] Gour Saha commented on YARN-8048: - I think it is okay to assume that if a service needs to be started as a

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-03-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418070#comment-16418070 ] Eric Yang commented on YARN-7939: - [~csingh] It would be nice if we clean up user submitted state to:

[jira] [Resolved] (YARN-2480) DockerContainerExecutor must support user namespaces

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2480. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and

[jira] [Resolved] (YARN-3988) DockerContainerExecutor should allow user specify "docker run" parameters

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-3988. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and

[jira] [Commented] (YARN-7690) expose reserved memory/Vcores of nodemanager at webUI

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417883#comment-16417883 ] genericqa commented on YARN-7690: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8084) Yarn native service rename for easier development?

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417882#comment-16417882 ] Wangda Tan commented on YARN-8084: -- cc: [~gsaha]/[~billie.rinaldi]/[~eyang] > Yarn native service rename

[jira] [Commented] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417891#comment-16417891 ] Haibo Chen commented on YARN-8051: -- Thanks [~rkanter] for the patch. HADOOP-12427 is dedicated to the

[jira] [Updated] (YARN-8084) Yarn native service classes renaming for easier development?

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8084: - Summary: Yarn native service classes renaming for easier development? (was: Yarn native service rename

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-03-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417907#comment-16417907 ] Eric Yang commented on YARN-7939: - [~csingh] Thank you for the patch. At high level, the patch looks good.

[jira] [Commented] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417939#comment-16417939 ] genericqa commented on YARN-7988: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7946) Update TimelineServerV2 doc as per YARN-7919

2018-03-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417960#comment-16417960 ] Rohith Sharma K S commented on YARN-7946: - +1 lgtm.. [~vrushalic] would you take a look at the

[jira] [Commented] (YARN-8084) Yarn native service classes renaming for easier development?

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418059#comment-16418059 ] Wangda Tan commented on YARN-8084: -- [~gsaha], ComponentManager sounds like a manager of a bunch of

[jira] [Commented] (YARN-8082) Include LocalizedResource size information in the NM download log for localization

2018-03-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418060#comment-16418060 ] Jason Lowe commented on YARN-8082: -- Thanks for the patch! The line-length checkstyle issue should be

[jira] [Resolved] (YARN-2482) DockerContainerExecutor configuration

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2482. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and

[jira] [Resolved] (YARN-2479) DockerContainerExecutor must support handling of distributed cache

2018-03-28 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-2479. -- Resolution: Won't Fix Closing this as DockerContainerExecutor has been deprecated in branch-2 and

[jira] [Commented] (YARN-8010) Add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-28 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417768#comment-16417768 ] Botong Huang commented on YARN-8010: Thanks [~subru] and [~giovanni.fumarola]! > Add config in

[jira] [Commented] (YARN-8079) YARN native service should respect source file of ConfigFile inside Service/Component spec

2018-03-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417816#comment-16417816 ] Eric Yang commented on YARN-8079: - [~leftnoteasy] For accessing remote HDFS, it requires username +

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2018-03-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417905#comment-16417905 ] Hudson commented on YARN-6629: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13893 (See

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-03-28 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417916#comment-16417916 ] Eric Yang commented on YARN-7939: - [~csingh] When user submit a curl PUT, the ServiceState needs to be

[jira] [Commented] (YARN-8048) Support auto-spawning of admin configured services during bootstrap of rm/apiserver

2018-03-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417956#comment-16417956 ] Rohith Sharma K S commented on YARN-8048: - bq. For the 2nd level, it's better to only read files

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-03-28 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16417990#comment-16417990 ] genericqa commented on YARN-8080: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418450#comment-16418450 ] Weiwei Yang edited comment on YARN-8085 at 3/29/18 5:18 AM: Thanks [~Tao Yang],

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8085: -- Affects Version/s: (was: 3.2.0) 3.1.0 > RMContext#resourceProfilesManager is

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418450#comment-16418450 ] Weiwei Yang commented on YARN-8085: --- Thanks [~Tao Yang], nice catch. ResourceProfilesManager was added in 

[jira] [Comment Edited] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418458#comment-16418458 ] Weiwei Yang edited comment on YARN-7497 at 3/29/18 5:34 AM: Hi [~yangjiandan]

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418458#comment-16418458 ] Weiwei Yang commented on YARN-7497: --- Hi [~yangjiandan] Thanks for the updates. Please see my comments

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2018-03-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.010.patch > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Created] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
Tao Yang created YARN-8085: -- Summary: RMContext#resourceProfilesManager is lost after RM went standby then back to active Key: YARN-8085 URL: https://issues.apache.org/jira/browse/YARN-8085 Project: Hadoop

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2018-03-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: (was: YARN-7497.010.patch) > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2018-03-28 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418484#comment-16418484 ] Jiandan Yang commented on YARN-7497: - Hi, [~cheersyang] Thanks for your review. I will rename the name

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-03-28 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418411#comment-16418411 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] I was proposing to have configuration like following:

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.001.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Commented] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418461#comment-16418461 ] Tao Yang commented on YARN-8085: Thanks [~cheersyang] for your suggestion. Yes, RMServiceContext contains

[jira] [Updated] (YARN-8085) RMContext#resourceProfilesManager is lost after RM went standby then back to active

2018-03-28 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8085: --- Attachment: YARN-8085.002.patch > RMContext#resourceProfilesManager is lost after RM went standby then back to

[jira] [Assigned] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-5881: Assignee: Sunil G (was: Wangda Tan) > Enable configuration of queue capacity in terms of absolute

[jira] [Resolved] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-5881. -- Resolution: Done > Enable configuration of queue capacity in terms of absolute resources >

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16418424#comment-16418424 ] Wangda Tan commented on YARN-5881: -- Closing this JIRA as all sub jiras are completed. > Enable

[jira] [Updated] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2018-03-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5881: - Fix Version/s: 3.1.0 > Enable configuration of queue capacity in terms of absolute resources >

  1   2   >