[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167358#comment-16167358 ] Varun Saxena commented on YARN-3895: Yeah we can think about doing this by 3.1 Lets finalize design in

[jira] [Commented] (YARN-7193) Implement REST API for register Yarnfile in application catalog

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167350#comment-16167350 ] Hadoop QA commented on YARN-7193: - (!) A patch to the testing environment has been detected. Re-executing

[jira] [Comment Edited] (YARN-7193) Implement REST API for register Yarnfile in application catalog

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167345#comment-16167345 ] Eric Yang edited comment on YARN-7193 at 9/15/17 5:26 AM: -- Fixed firebug warnings,

[jira] [Updated] (YARN-7193) Implement REST API for register Yarnfile in application catalog

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7193: Attachment: YARN-7193.yarn-native-services.003.patch Fixed firebug warnings, author tag, and check styles

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167342#comment-16167342 ] Rohith Sharma K S commented on YARN-3895: - I just got update from Vinod that 3.1 release plan is

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167326#comment-16167326 ] Rohith Sharma K S commented on YARN-3895: - thanks [~varun_saxena] for summarizing the discussions.

[jira] [Commented] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167319#comment-16167319 ] Hadoop QA commented on YARN-7157: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7163) RMContext need not to be injected to webapp and other Always Running services.

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167309#comment-16167309 ] Hadoop QA commented on YARN-7163: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (YARN-7163) RMContext need not to be injected to webapp and other Always Running services.

2017-09-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reopened YARN-7163: --- > RMContext need not to be injected to webapp and other Always Running services. >

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167282#comment-16167282 ] Arun Suresh commented on YARN-7192: --- The testcase failure is tracked in YARN-7196. Think the checkstyle

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167281#comment-16167281 ] Hadoop QA commented on YARN-7198: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167278#comment-16167278 ] Hadoop QA commented on YARN-7192: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167275#comment-16167275 ] Hadoop QA commented on YARN-6840: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167262#comment-16167262 ] Botong Huang commented on YARN-7203: Unit test failure is irrelevant. > Add container ExecutionType

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167245#comment-16167245 ] Hadoop QA commented on YARN-6878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.003.patch Updated the patch. Sorry missed including the yarn-defaults-xml change

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167235#comment-16167235 ] Hadoop QA commented on YARN-7203: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167221#comment-16167221 ] Hadoop QA commented on YARN-2664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167212#comment-16167212 ] Sunil G commented on YARN-6871: --- +1 from my side as well. However looks like patch needs rebase. Kindly

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167210#comment-16167210 ] Junping Du commented on YARN-7162: -- bq. Given that code freeze for Hadoop 3 beta 1 is tomorrow (Sept 15),

[jira] [Commented] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167205#comment-16167205 ] Billie Rinaldi commented on YARN-7198: -- Hi [~aw], if you get a chance I would greatly appreciate a

[jira] [Comment Edited] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167196#comment-16167196 ] Jonathan Hung edited comment on YARN-6840 at 9/15/17 1:20 AM: -- Thanks

[jira] [Comment Edited] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167196#comment-16167196 ] Jonathan Hung edited comment on YARN-6840 at 9/15/17 1:20 AM: -- Thanks

[jira] [Updated] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6840: Attachment: YARN-6840-YARN-5734.006.patch > Implement zookeeper based store for scheduler

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167196#comment-16167196 ] Jonathan Hung commented on YARN-6840: - Thanks [~leftnoteasy], bq. Then I suggest to add this as a

[jira] [Updated] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7198: - Attachment: YARN-7198-yarn-native-services.01.patch Attaching patch 01. I also noticed that the

[jira] [Updated] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-6878: --- Attachment: YARN-6878.003.patch > TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the >

[jira] [Updated] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-14 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-6878: --- Attachment: (was: YARN-6878.003.patch) > TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig()

[jira] [Commented] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167184#comment-16167184 ] Hadoop QA commented on YARN-6991: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167172#comment-16167172 ] Miklos Szegedi commented on YARN-7192: -- Thank you, [~asuresh] for the patch. I have a couple of

[jira] [Updated] (YARN-6991) "Kill application" button does not show error if other user tries to kill the application for secure cluster

2017-09-14 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6991: --- Attachment: YARN-6991.003.patch Thanks for the review [~sunilg]. Updated patch after fixing

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.002.patch Updated the patch based on suggestions - and fixed the testcases /

[jira] [Commented] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167153#comment-16167153 ] Hadoop QA commented on YARN-7199: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7203: --- Attachment: YARN-7203.v1.patch > Add container ExecutionType into ContainerReport >

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167130#comment-16167130 ] Miklos Szegedi commented on YARN-7034: -- I could not reproduce the unit test error locally. >

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167129#comment-16167129 ] Vrushali C commented on YARN-7190: -- Hi [~jlowe] Were you referring to HADOOP-12857 for the hadoop-tools

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167128#comment-16167128 ] Miklos Szegedi commented on YARN-7009: -- Thank you, [~asuresh] for the feedback. Yes indeed there is no

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167123#comment-16167123 ] Eric Yang commented on YARN-7197: - [~ebadger] This is similar to firewall rules. We need a way to define

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167124#comment-16167124 ] Miklos Szegedi commented on YARN-7192: -- Thank you, [~asuresh] and [~roniburd] for the replies. I

[jira] [Created] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-14 Thread Botong Huang (JIRA)
Botong Huang created YARN-7203: -- Summary: Add container ExecutionType into ContainerReport Key: YARN-7203 URL: https://issues.apache.org/jira/browse/YARN-7203 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167103#comment-16167103 ] Botong Huang commented on YARN-7199: Retry same patch as v2... >

[jira] [Updated] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7199: --- Attachment: YARN-7199.v2.patch > TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests

[jira] [Commented] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167098#comment-16167098 ] Hadoop QA commented on YARN-7199: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Roni Burd (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167093#comment-16167093 ] Roni Burd commented on YARN-7192: - I agree with the performance/concurrency concerns but think Arun's

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167061#comment-16167061 ] Yufei Gu commented on YARN-6612: [~templedf], do you need this on branch-3.0? > Update fair scheduler

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167080#comment-16167080 ] Hadoop QA commented on YARN-2664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6626) Embed REST API service into RM

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167071#comment-16167071 ] Eric Yang edited comment on YARN-6626 at 9/14/17 10:47 PM: --- This can be done by

[jira] [Commented] (YARN-6495) check docker container's exit code when writing to cgroup task files

2017-09-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167078#comment-16167078 ] Eric Badger commented on YARN-6495: --- Hey [~Jaeboo], sorry for taking so long to actually take a good look

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167071#comment-16167071 ] Eric Yang commented on YARN-6626: - This can be done by specifying hadoop-yarn-service-api as dependency to

[jira] [Commented] (YARN-7186) Add examples in yarn-service

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167065#comment-16167065 ] Billie Rinaldi commented on YARN-7186: -- +1, this looks good to me. I will fix the whitespace and

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167076#comment-16167076 ] Arun Suresh commented on YARN-7009: --- Thanks for the patch [~miklos.szeg...@cloudera.com]. I was thinking,

[jira] [Created] (YARN-7202) End-to-end UT for api-server

2017-09-14 Thread Jian He (JIRA)
Jian He created YARN-7202: - Summary: End-to-end UT for api-server Key: YARN-7202 URL: https://issues.apache.org/jira/browse/YARN-7202 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Created] (YARN-7201) Add more sophisticated example YARN service

2017-09-14 Thread Jian He (JIRA)
Jian He created YARN-7201: - Summary: Add more sophisticated example YARN service Key: YARN-7201 URL: https://issues.apache.org/jira/browse/YARN-7201 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7057) FSAppAttempt#getResourceUsage doesn't need to consider resources queued for preemption

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7057: --- Fix Version/s: 3.1.0 > FSAppAttempt#getResourceUsage doesn't need to consider resources queued for >

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167056#comment-16167056 ] Robert Kanter commented on YARN-7162: - I also agree that the JSON format is better. But it's not

[jira] [Updated] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6612: --- Fix Version/s: (was: 3.0.0-beta1) 3.1.0 > Update fair scheduler policies to be aware of

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167043#comment-16167043 ] Junping Du commented on YARN-7162: -- bq. Maybe we do want to support the old format, JSON, and XML, but we

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167041#comment-16167041 ] Robert Kanter commented on YARN-7162: - If the admin really wants to have different timeouts for

[jira] [Updated] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7199: --- Attachment: YARN-7199.v1.patch > TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests

[jira] [Assigned] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang reassigned YARN-7199: -- Assignee: Botong Huang > TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167028#comment-16167028 ] Arun Suresh commented on YARN-7192: --- Thanks for the detailed review [~jlowe]. bq. Would it make sense for

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167024#comment-16167024 ] Junping Du commented on YARN-7162: -- bq. if you wanted to have nodeA do 50, nodeB do 70, etc, you can't do

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: (was: YARN-6675.00.patch) > Add NM support to launch opportunistic containers based on

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167021#comment-16167021 ] Robert Kanter commented on YARN-7162: - It would be better if we had the pluggable JSON support (i.e.

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167004#comment-16167004 ] Junping Du commented on YARN-7162: -- wait... Sorry for coming late on this. I think it could be better if

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167000#comment-16167000 ] Botong Huang commented on YARN-7102: After fighting through unit tests... in v6 patch:

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166994#comment-16166994 ] Haibo Chen commented on YARN-4511: -- TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable is

[jira] [Comment Edited] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166981#comment-16166981 ] Íñigo Goiri edited comment on YARN-2664 at 9/14/17 9:22 PM: v20 was a bad diff

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-2664: -- Attachment: YARN-2664.20.patch v20 was a but diff to trunk. Updating it properly. > Improve RM webapp

[jira] [Created] (YARN-7200) SLS generates a realtimetrack.json file but that file is missing the closing ']'

2017-09-14 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-7200: Summary: SLS generates a realtimetrack.json file but that file is missing the closing ']' Key: YARN-7200 URL: https://issues.apache.org/jira/browse/YARN-7200 Project: Hadoop

[jira] [Commented] (YARN-7162) Remove XML excludes file format

2017-09-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166980#comment-16166980 ] Ray Chiang commented on YARN-7162: -- +1 (binding). LGTM. > Remove XML excludes file format >

[jira] [Created] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-14 Thread Botong Huang (JIRA)
Botong Huang created YARN-7199: -- Summary: TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk Key: YARN-7199 URL: https://issues.apache.org/jira/browse/YARN-7199

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166976#comment-16166976 ] Xuan Gong commented on YARN-7174: - bq. I think we haven't addressed this comment in v2 patch? I have

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

2017-09-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-2664: -- Attachment: (was: YARN-2664.20.patch) > Improve RM webapp to expose info about reservations. >

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166969#comment-16166969 ] Miklos Szegedi commented on YARN-7192: -- [~asuresh], thank you, I think this is very useful. I worked

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166957#comment-16166957 ] Hadoop QA commented on YARN-4511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166946#comment-16166946 ] Wangda Tan commented on YARN-6840: -- Synced with [~jhung] offline, in additional to above suggestions,

[jira] [Assigned] (YARN-1015) FS should watch resource utilization of containers and allocate speculative containers if appropriate

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-1015: Assignee: Haibo Chen (was: Karthik Kambatla) > FS should watch resource utilization of containers

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166937#comment-16166937 ] Eric Badger commented on YARN-7197: --- Hi [~shaneku...@gmail.com], [~eyang]. I'm not sure I see the

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166928#comment-16166928 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7198) Add jsvc support for RegistryDNS

2017-09-14 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-7198: Summary: Add jsvc support for RegistryDNS Key: YARN-7198 URL: https://issues.apache.org/jira/browse/YARN-7198 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166921#comment-16166921 ] Billie Rinaldi commented on YARN-7191: -- I will open a separate ticket for the jsvc support. > Improve

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166916#comment-16166916 ] Eric Yang commented on YARN-7197: - Consider the following scenarios: # Docker container with

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166895#comment-16166895 ] Junping Du commented on YARN-7174: -- Thanks [~xgong] for updating the patch. The patch looks good to me in

[jira] [Updated] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7197: -- Description: Docker supports bind mounting host directories into containers. Work is underway to allow

[jira] [Created] (YARN-7197) Add support for a volume blacklist for docker containers

2017-09-14 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7197: - Summary: Add support for a volume blacklist for docker containers Key: YARN-7197 URL: https://issues.apache.org/jira/browse/YARN-7197 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166868#comment-16166868 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166849#comment-16166849 ] Hadoop QA commented on YARN-7034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

2017-09-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166839#comment-16166839 ] Wangda Tan commented on YARN-6840: -- Thanks [~jhung] for updating the patch, bq. For leveldb and zk, it

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.005.patch YARN-7034.branch-2.005.patch

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2017-09-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166816#comment-16166816 ] Varun Saxena commented on YARN-3895: Points to consider including what we discussed on the call. #

[jira] [Commented] (YARN-7174) Add retry logic in LogsCLI when fetch running application logs

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166814#comment-16166814 ] Hadoop QA commented on YARN-7174: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166811#comment-16166811 ] Hudson commented on YARN-6612: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12874 (See

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166805#comment-16166805 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-14 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7196: - Summary: Fix finicky TestContainerManager tests Key: YARN-7196 URL: https://issues.apache.org/jira/browse/YARN-7196 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7034: - Attachment: YARN-7034.004.patch YARN-7034.branch-2.004.patch

[jira] [Commented] (YARN-7034) DefaultLinuxContainerRuntime and DockerLinuxContainerRuntime sends client environment variables to container-executor

2017-09-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166791#comment-16166791 ] Miklos Szegedi commented on YARN-7034: -- Thank you, [~shaneku...@gmail.com] for the feedback. I will

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166780#comment-16166780 ] Devaraj K commented on YARN-6620: - Thanks [~leftnoteasy] for the quick patch. bq. Switched JAXB to handle

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-09-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166778#comment-16166778 ] Yufei Gu commented on YARN-6612: Committed to trunk. Thanks for working on this, [~templedf]. > Update

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.01.patch Another patch to address the issues reported by Jenkins. >

  1   2   >