[jira] [Commented] (YARN-7933) [atsv2 read acls] Add TimelineWriter#writeDomain

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461968#comment-16461968 ] genericqa commented on YARN-7933: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8201) Skip stacktrace of ApplicationNotFoundException at server side

2018-05-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462099#comment-16462099 ] Bibin A Chundatt commented on YARN-8201: [~BilwaST] Could you please handle checkstyle and

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-05-03 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port.patch > Gpu locality support for Better AI scheduling >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-05-03 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2-gpu-port.patch) > Gpu locality support for Better AI scheduling >

[jira] [Updated] (YARN-6630) Container worker dir could not recover when NM restart

2018-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6630: Attachment: YARN-6630.003.patch > Container worker dir could not recover when NM restart >

[jira] [Commented] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462451#comment-16462451 ] Shane Kumpf commented on YARN-8194: --- {quote}There is no container relaunch commited to

[jira] [Updated] (YARN-8163) Add support for Node Labels in opportunistic scheduling.

2018-05-03 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8163: Attachment: YARN-8163.003.patch > Add support for Node Labels in opportunistic scheduling. >

[jira] [Updated] (YARN-7961) Improve status response when yarn application is destroyed

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7961: Fix Version/s: 3.1.1 3.2.0 > Improve status response when yarn application is destroyed >

[jira] [Resolved] (YARN-8231) Dshell application fails when one of the docker container gets killed

2018-05-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh resolved YARN-8231. - Resolution: Invalid # Distributed shell application doesn't re-launch containers when it gets

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462859#comment-16462859 ] Billie Rinaldi commented on YARN-8079: -- I tested patch 9 and it is working fine, so I think this is

[jira] [Commented] (YARN-8163) Add support for Node Labels in opportunistic scheduling.

2018-05-03 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462874#comment-16462874 ] Abhishek Modi commented on YARN-8163: - Submitted v3 patch fixing CR comments. [~giovanni.fumarola]

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462872#comment-16462872 ] Eric Yang commented on YARN-8079: - [~billie.rinaldi] STATIC works better in my opinion.  It helps to

[jira] [Commented] (YARN-8163) Add support for Node Labels in opportunistic scheduling.

2018-05-03 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462881#comment-16462881 ] Giovanni Matteo Fumarola commented on YARN-8163: +1 on v3. Waiting on Jerkins. > Add

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462459#comment-16462459 ] genericqa commented on YARN-7892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7818) Remove privileged operation warnings during container launch for DefaultLinuxContainerRuntime

2018-05-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462588#comment-16462588 ] Billie Rinaldi commented on YARN-7818: -- Looks like this change should also be made in the docker

[jira] [Comment Edited] (YARN-8163) Add support for Node Labels in opportunistic scheduling.

2018-05-03 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462881#comment-16462881 ] Giovanni Matteo Fumarola edited comment on YARN-8163 at 5/3/18 6:08 PM:

[jira] [Commented] (YARN-8226) Improve anti-affinity section description in YARN Service API doc

2018-05-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462884#comment-16462884 ] Hudson commented on YARN-8226: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14120 (See

[jira] [Updated] (YARN-8231) Dshell application fails when one of the docker container gets killed

2018-05-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-8231: -- Component/s: (was: yarn-native-services) > Dshell application fails when one

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462928#comment-16462928 ] Eric Yang commented on YARN-8079: - [~gsaha] PLAIN is usually used as reference to text file, but this

[jira] [Commented] (YARN-8201) Skip stacktrace of ApplicationNotFoundException at server side

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462850#comment-16462850 ] genericqa commented on YARN-8201: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7961) Improve status response when yarn application is destroyed

2018-05-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462857#comment-16462857 ] Hudson commented on YARN-7961: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14119 (See

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462876#comment-16462876 ] Gour Saha commented on YARN-8079: - I agree that STATIC is not fitting well. I like FILE. Does PLAIN fit the

[jira] [Updated] (YARN-8201) Skip stacktrace of ApplicationNotFoundException at server side

2018-05-03 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-8201: Attachment: YARN-8201-002.patch > Skip stacktrace of ApplicationNotFoundException at server side >

[jira] [Commented] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-05-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462446#comment-16462446 ] Shane Kumpf commented on YARN-7973: --- [~eyang] - I realized after YARN-8194 that this isn't in branch-3.1.

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-05-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462503#comment-16462503 ] Jason Lowe commented on YARN-8242: -- Thanks for the report and the patch! I'm not a fan of exposing

[jira] [Comment Edited] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462451#comment-16462451 ] Shane Kumpf edited comment on YARN-8194 at 5/3/18 1:37 PM: --- {quote}There is no

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462617#comment-16462617 ] genericqa commented on YARN-8191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7933) [atsv2 read acls] Add TimelineWriter#writeDomain

2018-05-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462638#comment-16462638 ] Haibo Chen commented on YARN-7933: -- Thanks [~rohithsharma] for updating the patch!  Looks good to me in

[jira] [Updated] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8243: Description: This is easy to test on a service with anti-affinity component, to simulate pending container

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

2018-05-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463041#comment-16463041 ] Eric Payne commented on YARN-8179: -- [~sunilg], if there is no objection, I'll commit this tomorrow. >

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462973#comment-16462973 ] Gour Saha commented on YARN-8079: - Or maybe call it SIMPLE > Support specify files to be downloaded

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463048#comment-16463048 ] Jason Lowe commented on YARN-8207: -- Thanks for updating the patch! It's looking much better. I didn't

[jira] [Commented] (YARN-8163) Add support for Node Labels in opportunistic scheduling.

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462972#comment-16462972 ] genericqa commented on YARN-8163: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-03 Thread Gour Saha (JIRA)
Gour Saha created YARN-8243: --- Summary: Flex down should first remove pending container requests (if any) and then kill running containers Key: YARN-8243 URL: https://issues.apache.org/jira/browse/YARN-8243

[jira] [Commented] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462668#comment-16462668 ] Shane Kumpf commented on YARN-8194: --- Thanks [~eyang]! > Exception when reinitializing a container using

[jira] [Updated] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8194: Fix Version/s: 3.1.1 > Exception when reinitializing a container using LinuxContainerExecutor >

[jira] [Commented] (YARN-8209) NPE in DeletionService

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462664#comment-16462664 ] Eric Yang commented on YARN-8209: - With the recent backport of YARN-7973 and YARN-8194, the branch-3.1 is

[jira] [Commented] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462741#comment-16462741 ] Eric Yang commented on YARN-7973: - [~jlowe] Yes, I am working on fixing this with addendum patch.  Sorry

[jira] [Commented] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462772#comment-16462772 ] Eric Yang commented on YARN-7973: - Addendum patch 001 committed to branch-3.1.  > Support

[jira] [Commented] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462776#comment-16462776 ] Chandni Singh commented on YARN-8194: - Thanks [~shaneku...@gmail.com] and [~eyang] for the reviewing

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462653#comment-16462653 ] Bibin A Chundatt commented on YARN-7892: [~Naganarasimha] {quote} For both getClusterAttributes

[jira] [Updated] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7973: Fix Version/s: 3.1.1 Cherry-picked for 3.1.1. > Support ContainerRelaunch for Docker containers >

[jira] [Commented] (YARN-8194) Exception when reinitializing a container using LinuxContainerExecutor

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462658#comment-16462658 ] Eric Yang commented on YARN-8194: - [~shaneku...@gmail.com] I agree with your assessment on this issue, and

[jira] [Commented] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-05-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462709#comment-16462709 ] Jason Lowe commented on YARN-7973: -- branch-3.1 is no longer building after this was committed: {noformat}

[jira] [Updated] (YARN-7973) Support ContainerRelaunch for Docker containers

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7973: Attachment: YARN-7973-branch-3.1.addendum.001.patch > Support ContainerRelaunch for Docker containers >

[jira] [Commented] (YARN-7933) [atsv2 read acls] Add TimelineWriter#writeDomain

2018-05-03 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462813#comment-16462813 ] Rohith Sharma K S commented on YARN-7933: - {quote} Does the patch require a domain id for every

[jira] [Commented] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463114#comment-16463114 ] Zian Chen commented on YARN-8223: - Really appreciate [~eyang] for helping with testing the patch. To let

[jira] [Commented] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463120#comment-16463120 ] Eric Yang commented on YARN-8223: - [~Zian Chen] Thank you for the patch.  This patch 001 works.  At this

[jira] [Updated] (YARN-7818) Remove privileged operation warnings during container launch for DefaultLinuxContainerRuntime

2018-05-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7818: -- Attachment: YARN-7818.002.patch > Remove privileged operation warnings during container launch for >

[jira] [Commented] (YARN-7818) Remove privileged operation warnings during container launch for DefaultLinuxContainerRuntime

2018-05-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463145#comment-16463145 ] Shane Kumpf commented on YARN-7818: --- Thanks for the review, [~billie.rinaldi]. I agree that these should

[jira] [Comment Edited] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463114#comment-16463114 ] Zian Chen edited comment on YARN-8223 at 5/3/18 10:42 PM: -- Really appreciate

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463097#comment-16463097 ] Suma Shivaprasad commented on YARN-8080: Thanks [~gsaha] for reviews and offline discussions on the

[jira] [Updated] (YARN-8080) YARN native service should support component restart policy

2018-05-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8080: --- Attachment: YARN-8080.007.patch > YARN native service should support component restart policy

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463104#comment-16463104 ] Suma Shivaprasad commented on YARN-8080: Attached updated patch with review comments for flex

[jira] [Commented] (YARN-8163) Add support for Node Labels in opportunistic scheduling.

2018-05-03 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463115#comment-16463115 ] Íñigo Goiri commented on YARN-8163: --- I'm not sure if the unit tests in [^YARN-8163.003.patch] cover the

[jira] [Assigned] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-8243: --- Assignee: Gour Saha > Flex down should first remove pending container requests (if any) and then >

[jira] [Updated] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8243: I am continuing to debug this and other issues around flex. Assigning this to myself and will work on a patch

[jira] [Updated] (YARN-4677) RMNodeResourceUpdateEvent update from scheduler can lead to race condition

2018-05-03 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Phillips updated YARN-4677: Attachment: YARN-4677-branch-2.001.patch > RMNodeResourceUpdateEvent update from scheduler can lead

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463202#comment-16463202 ] genericqa commented on YARN-7715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8079: --- Attachment: YARN-8079.010.patch > Support specify files to be downloaded (localized) before

[jira] [Updated] (YARN-4677) RMNodeResourceUpdateEvent update from scheduler can lead to race condition

2018-05-03 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Phillips updated YARN-4677: Attachment: (was: YARN-4677-branch-2.001.patch) > RMNodeResourceUpdateEvent update from

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463195#comment-16463195 ] genericqa commented on YARN-8080: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7818) Remove privileged operation warnings during container launch for DefaultLinuxContainerRuntime

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463206#comment-16463206 ] genericqa commented on YARN-7818: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8223: Attachment: YARN-8223.002.patch > ClassNotFoundException when auxiliary service is loaded from HDFS >

[jira] [Commented] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463229#comment-16463229 ] Zian Chen commented on YARN-8223: - Updated patch 002 adding documentation. Hi [~eyang] , could you help

[jira] [Updated] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7894: Attachment: YARN-7894.001.patch > Improve ATS response for DS_CONTAINER when container launch fails

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463238#comment-16463238 ] Suma Shivaprasad commented on YARN-8079: Thanks [~billie.rinaldi] [~gsaha] [~eyang] for your

[jira] [Commented] (YARN-8244) ContainersLauncher.ContainerLaunch can throw ConcurrentModificationException

2018-05-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463247#comment-16463247 ] Miklos Szegedi commented on YARN-8244: -- This happens with

[jira] [Created] (YARN-8244) ContainersLauncher.ContainerLaunch can throw ConcurrentModificationException

2018-05-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8244: Summary: ContainersLauncher.ContainerLaunch can throw ConcurrentModificationException Key: YARN-8244 URL: https://issues.apache.org/jira/browse/YARN-8244 Project:

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.001.patch > Update CPU and Memory cgroups params on container update as

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463266#comment-16463266 ] Eric Yang commented on YARN-8207: - [~jlowe] Thank you for the review. A couple comments: Args is array of

[jira] [Comment Edited] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463266#comment-16463266 ] Eric Yang edited comment on YARN-8207 at 5/4/18 1:34 AM: - [~jlowe] Thank you for

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463272#comment-16463272 ] genericqa commented on YARN-7894: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463276#comment-16463276 ] genericqa commented on YARN-7715: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8079) Support specify files to be downloaded (localized) before containers launched by YARN

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463279#comment-16463279 ] genericqa commented on YARN-8079: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8113) Update placement constraints doc with application namespaces and inter-app constraints

2018-05-03 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463288#comment-16463288 ] Weiwei Yang commented on YARN-8113: --- Thank you [~kkaranasos] for helping the review and polishing the

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463303#comment-16463303 ] genericqa commented on YARN-4599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8223) ClassNotFoundException when auxiliary service is loaded from HDFS

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463311#comment-16463311 ] genericqa commented on YARN-8223: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-03 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.005.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Commented] (YARN-6630) Container worker dir could not recover when NM restart

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462267#comment-16462267 ] genericqa commented on YARN-6630: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462334#comment-16462334 ] Naganarasimha G R commented on YARN-7892: - Hi [~bibinchundatt],      Hope you could specify

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462276#comment-16462276 ] Bibin A Chundatt commented on YARN-7892: [~Naganarasimha] Please find the comments # For both

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462289#comment-16462289 ] Szilard Nemeth commented on YARN-8191: -- Hi [~grepas]! Thanks for the updated patch. LGTM, except one

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-03 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462364#comment-16462364 ] Gergo Repas commented on YARN-8191: --- [~snemeth] Thanks for the review! I've added these comments to the

[jira] [Commented] (YARN-8217) RmAuthenticationFilterInitializer /TimelineAuthenticationFilterInitializer should use Configuration.getPropsWithPrefix instead of iterator

2018-05-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462414#comment-16462414 ] Hudson commented on YARN-8217: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14118 (See

[jira] [Commented] (YARN-6589) Recover all resources when NM restart

2018-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462233#comment-16462233 ] Yang Wang commented on YARN-6589: - ContainerImpl#getResource() has been changed to get from

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2018-05-03 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6589: Release Note: (was: ContainerImpl#getResource() has been changed to get from containerTokenIdentifier and

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16462385#comment-16462385 ] Szilard Nemeth commented on YARN-8191: -- Hi [~grepas]! Thanks for the latest patch, LGTM. +1

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-05-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463324#comment-16463324 ] Wangda Tan commented on YARN-4606: -- Thanks [~maniraj...@gmail.com], Some questions: 1) Does this patch

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-05-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463331#comment-16463331 ] Wangda Tan commented on YARN-8234: -- [~ziqian hu], mind to check the Jenkins report? > Improve RM system

[jira] [Updated] (YARN-8201) Skip stacktrace of ApplicationNotFoundException at server side

2018-05-03 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-8201: Attachment: YARN-8201-003.patch > Skip stacktrace of ApplicationNotFoundException at server side >

[jira] [Comment Edited] (YARN-8080) YARN native service should support component restart policy

2018-05-03 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463097#comment-16463097 ] Suma Shivaprasad edited comment on YARN-8080 at 5/4/18 5:04 AM: Thanks

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463329#comment-16463329 ] Wangda Tan commented on YARN-8232: -- +1, thanks [~ziqian hu], will commit tomorrow if no objections. >

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2018-05-03 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16463364#comment-16463364 ] genericqa commented on YARN-8234: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||