[jira] [Updated] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-09-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6727: --- Attachment: YARN-6727.006.patch Attaching patch after following updates # queueNameList null

[jira] [Commented] (YARN-7059) Use app user to publish entities from NM

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165860#comment-16165860 ] Rohith Sharma K S commented on YARN-7059: - Testing in non secured cluster end up in below

[jira] [Updated] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4090: --- Attachment: YARN-4090.008.patch Thanks for the review, [~templedf]. Uploaded patch v8 for your first comment.

[jira] [Updated] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7157: Attachment: YARN-7157-branch-2.001.patch > Add admin configuration to filter per-user's apps

[jira] [Updated] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7157: Attachment: YARN-7157-branch-3.0.001.patch > Add admin configuration to filter per-user's

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165892#comment-16165892 ] Sen Zhao commented on YARN-6878: I find other wrong order about asserEqual() in TestCapacityScheduler and

[jira] [Commented] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165943#comment-16165943 ] Rohith Sharma K S commented on YARN-7157: - On behalf of Sunil, I attached branch-2/branch-3

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166058#comment-16166058 ] Rohith Sharma K S commented on YARN-65: --- thanks [~maniraj...@gmail.com] for the updated patch! Overall

[jira] [Comment Edited] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165892#comment-16165892 ] Sen Zhao edited comment on YARN-6878 at 9/14/17 7:42 AM: - I find other wrong order

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165920#comment-16165920 ] Daniel Templeton commented on YARN-6878: Looks great. One issue:{code}

[jira] [Updated] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-6878: --- Attachment: YARN-6878.003.patch > TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the >

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166087#comment-16166087 ] Daniel Templeton commented on YARN-7009: My comments from the partial review I did: # Instead of

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16165933#comment-16165933 ] Sen Zhao commented on YARN-6878: Oh, I did not notice this. I will fix it soon. Thanks, [~templedf] >

[jira] [Commented] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-09-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166368#comment-16166368 ] Jason Lowe commented on YARN-5972: -- I'm OK with this being added to trunk as separate JIRAs. The entire

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166385#comment-16166385 ] Rohith Sharma K S commented on YARN-7190: - I am wondering why does user application classpath

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166151#comment-16166151 ] Varun Saxena commented on YARN-3895: Actually, we were thinking of including this in 3.1.0. If we do

[jira] [Comment Edited] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166151#comment-16166151 ] Varun Saxena edited comment on YARN-3895 at 9/14/17 12:16 PM: -- Actually, we

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166341#comment-16166341 ] Jason Lowe commented on YARN-7192: -- Took a quick look at the patch, some initial comments: Would it make

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166307#comment-16166307 ] Varun Saxena commented on YARN-7190: We can potentially shade these dependencies and create a fat jar.

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166271#comment-16166271 ] Jason Lowe commented on YARN-7190: -- This could be an issue in 3.x as well. I suspect the HBase project

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6612: --- Attachment: YARN-6612.016.patch Removed the used method and variable. I don't think we need a

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166606#comment-16166606 ] Yufei Gu commented on YARN-6612: The {{getWeight()}} Java doc looks good. +1. Pending for Jenkins. >

[jira] [Commented] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166607#comment-16166607 ] Arun Suresh commented on YARN-5972: --- Thanks [~jlowe], cherry-picked the 3 JIRAs and committed > Support

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166583#comment-16166583 ] Joep Rottinghuis commented on YARN-7190: Yeah, this is a legit issue. Having these jars in a

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2497.001.patch This patch addresses headroom and cleans up the WIP patch a

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166452#comment-16166452 ] Jason Lowe commented on YARN-7190: -- Yes, many tasks probably do not need YARN jars, but some do. Oozie

[jira] [Commented] (YARN-7163) RMContext need not to be injected to webapp and other Always Running services.

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167309#comment-16167309 ] Hadoop QA commented on YARN-7163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167235#comment-16167235 ] Hadoop QA commented on YARN-7203: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167275#comment-16167275 ] Hadoop QA commented on YARN-6840: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.003.patch Updated the patch. Sorry missed including the yarn-defaults-xml change

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167278#comment-16167278 ] Hadoop QA commented on YARN-7192: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (YARN-7163) RMContext need not to be injected to webapp and other Always Running services.

2017-09-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reopened YARN-7163: --- > RMContext need not to be injected to webapp and other Always Running services. >

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167326#comment-16167326 ] Rohith Sharma K S commented on YARN-3895: - thanks [~varun_saxena] for summarizing the discussions.

[jira] [Commented] (YARN-7193) Implement REST API for register Yarnfile in application catalog

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167350#comment-16167350 ] Hadoop QA commented on YARN-7193: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167342#comment-16167342 ] Rohith Sharma K S commented on YARN-3895: - I just got update from Vinod that 3.1 release plan is

[jira] [Commented] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167319#comment-16167319 ] Hadoop QA commented on YARN-7157: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7193) Implement REST API for register Yarnfile in application catalog

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167345#comment-16167345 ] Eric Yang edited comment on YARN-7193 at 9/15/17 5:26 AM: -- Fixed firebug warnings,

[jira] [Updated] (YARN-7193) Implement REST API for register Yarnfile in application catalog

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7193: Attachment: YARN-7193.yarn-native-services.003.patch Fixed firebug warnings, author tag, and check styles

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167358#comment-16167358 ] Varun Saxena commented on YARN-3895: Yeah we can think about doing this by 3.1 Lets finalize design in

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167245#comment-16167245 ] Hadoop QA commented on YARN-6878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167262#comment-16167262 ] Botong Huang commented on YARN-7203: Unit test failure is irrelevant. > Add container ExecutionType

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167281#comment-16167281 ] Hadoop QA commented on YARN-7198: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167282#comment-16167282 ] Arun Suresh commented on YARN-7192: --- The testcase failure is tracked in YARN-7196. Think the checkstyle

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167172#comment-16167172 ] Miklos Szegedi commented on YARN-7192: -- Thank you, [~asuresh] for the patch. I have a couple of

[jira] [Commented] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167184#comment-16167184 ] Hadoop QA commented on YARN-6991: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-6878: --- Attachment: YARN-6878.003.patch > TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the >

[jira] [Updated] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-6878: --- Attachment: (was: YARN-6878.003.patch) > TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig()

[jira] [Updated] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6840: Attachment: YARN-6840-YARN-5734.006.patch > Implement zookeeper based store for scheduler

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167196#comment-16167196 ] Jonathan Hung commented on YARN-6840: - Thanks [~leftnoteasy], bq. Then I suggest to add this as a

[jira] [Updated] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7198: - Attachment: YARN-7198-yarn-native-services.01.patch Attaching patch 01. I also noticed that the

[jira] [Comment Edited] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167196#comment-16167196 ] Jonathan Hung edited comment on YARN-6840 at 9/15/17 1:20 AM: -- Thanks

[jira] [Comment Edited] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167196#comment-16167196 ] Jonathan Hung edited comment on YARN-6840 at 9/15/17 1:20 AM: -- Thanks

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167205#comment-16167205 ] Billie Rinaldi commented on YARN-7198: -- Hi [~aw], if you get a chance I would greatly appreciate a

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167210#comment-16167210 ] Junping Du commented on YARN-7162: -- bq. Given that code freeze for Hadoop 3 beta 1 is tomorrow (Sept 15),

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167212#comment-16167212 ] Sunil G commented on YARN-6871: --- +1 from my side as well. However looks like patch needs rebase. Kindly

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167221#comment-16167221 ] Hadoop QA commented on YARN-2664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166135#comment-16166135 ] Rohith Sharma K S commented on YARN-3895: - I think we should target this for GA! Though YARN-6820

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166286#comment-16166286 ] Eric Payne commented on YARN-7149: -- Unit test failures are not related to this patch:

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166359#comment-16166359 ] Jason Lowe commented on YARN-7190: -- Separate directory for these that's only pulled into the classpath

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166916#comment-16166916 ] Eric Yang commented on YARN-7197: - Consider the following scenarios: # Docker container with

[jira] [Created] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-7198: Summary: Add jsvc support for RegistryDNS Key: YARN-7198 URL: https://issues.apache.org/jira/browse/YARN-7198 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166928#comment-16166928 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-1015) FS should watch resource utilization of containers and allocate speculative containers if appropriate

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-1015: Assignee: Haibo Chen (was: Karthik Kambatla) > FS should watch resource utilization of containers

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166946#comment-16166946 ] Wangda Tan commented on YARN-6840: -- Synced with [~jhung] offline, in additional to above suggestions,

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166957#comment-16166957 ] Hadoop QA commented on YARN-4511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166921#comment-16166921 ] Billie Rinaldi commented on YARN-7191: -- I will open a separate ticket for the jsvc support. > Improve

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166937#comment-16166937 ] Eric Badger commented on YARN-7197: --- Hi [~shaneku...@gmail.com], [~eyang]. I'm not sure I see the

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Attachment: YARN-6620.006-WIP.patch Attached ver.6 WIP patch. Updates: 1) Switched JAXB to handle XML

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166677#comment-16166677 ] Shane Kumpf commented on YARN-7034: --- Thanks for the patch [~miklos.szeg...@cloudera.com]! Overall the

[jira] [Updated] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7174: Attachment: YARN-7174.2.patch > Add retry logic in LogsCLI when fetch running application logs >

[jira] [Created] (YARN-7195) Document Log CLI in YarnCommands.md

2017-09-14 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7195: --- Summary: Document Log CLI in YarnCommands.md Key: YARN-7195 URL: https://issues.apache.org/jira/browse/YARN-7195 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166745#comment-16166745 ] Xuan Gong commented on YARN-7174: - Thanks for the review. [~djp] bq. Looks like we remove the verification

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166778#comment-16166778 ] Yufei Gu commented on YARN-6612: Committed to trunk. Thanks for working on this, [~templedf]. > Update

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.01.patch Another patch to address the issues reported by Jenkins. >

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166780#comment-16166780 ] Devaraj K commented on YARN-6620: - Thanks [~leftnoteasy] for the quick patch. bq. Switched JAXB to handle

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166839#comment-16166839 ] Wangda Tan commented on YARN-6840: -- Thanks [~jhung] for updating the patch, bq. For leveldb and zk, it

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166849#comment-16166849 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6717) [Umbrella] API related cleanup for Hadoop 3

2017-09-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1618#comment-1618 ] Ray Chiang commented on YARN-6717: -- Known incompatibilities that are flagged in JACC: [YARN-5713 Update

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-2664: -- Attachment: YARN-2664.20.patch > Improve RM webapp to expose info about reservations. >

[jira] [Updated] (YARN-6838) Add support to LinuxContainerExecutor to support container PAUSE

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6838: -- Target Version/s: 3.1.0 > Add support to LinuxContainerExecutor to support container PAUSE >

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.004.patch YARN-7034.branch-2.004.patch

[jira] [Created] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-14 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7196: - Summary: Fix finicky TestContainerManager tests Key: YARN-7196 URL: https://issues.apache.org/jira/browse/YARN-7196 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166811#comment-16166811 ] Hudson commented on YARN-6612: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12874 (See

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.005.patch YARN-7034.branch-2.005.patch

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166640#comment-16166640 ] Hudson commented on YARN-5216: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12872 (See

[jira] [Commented] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166639#comment-16166639 ] Hudson commented on YARN-5292: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12872 (See

[jira] [Commented] (YARN-6059) Update paused container state in the NM state store

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166641#comment-16166641 ] Hudson commented on YARN-6059: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12872 (See

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v6.patch > NM heartbeat stuck when responseId overflows MAX_INT >

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166702#comment-16166702 ] Wangda Tan commented on YARN-7149: -- [~eepayne], Thanks for updating the patch, I like the approach which

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166751#comment-16166751 ] Hadoop QA commented on YARN-6612: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166805#comment-16166805 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166814#comment-16166814 ] Hadoop QA commented on YARN-7174: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166816#comment-16166816 ] Varun Saxena commented on YARN-3895: Points to consider including what we discussed on the call. #

[jira] [Commented] (YARN-6142) Support rolling upgrade between 2.x and 3.x

2017-09-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166655#comment-16166655 ] Ray Chiang commented on YARN-6142: -- h2. Proto Changes h3. ResourceTracker.proto * Added

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166791#comment-16166791 ] Miklos Szegedi commented on YARN-7034: -- Thank you, [~shaneku...@gmail.com] for the feedback. I will

[jira] [Created] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7197: - Summary: Add support for a volume blacklist for docker containers Key: YARN-7197 URL: https://issues.apache.org/jira/browse/YARN-7197 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7197: -- Description: Docker supports bind mounting host directories into containers. Work is underway to allow

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166868#comment-16166868 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166895#comment-16166895 ] Junping Du commented on YARN-7174: -- Thanks [~xgong] for updating the patch. The patch looks good to me in

[jira] [Created] (YARN-7200) SLS generates a realtimetrack.json file but that file is missing the closing ']'

2017-09-14 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-7200: Summary: SLS generates a realtimetrack.json file but that file is missing the closing ']' Key: YARN-7200 URL: https://issues.apache.org/jira/browse/YARN-7200 Project: Hadoop

  1   2   >