[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176987#comment-16176987 ] Jason Lowe commented on YARN-7226: -- bq. So my vote would be for putting this patch in and then filing a

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.002.patch Fixing minor test issue for newly added yarn config key. >

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177087#comment-16177087 ] Hadoop QA commented on YARN-7009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-22 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177109#comment-16177109 ] Sidharta Seethana commented on YARN-7226: - [~ebadger], [~jlowe] {quote} The client gets to decide

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.02.patch Updated the patch address issues identified by

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177198#comment-16177198 ] Hadoop QA commented on YARN-7191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177224#comment-16177224 ] Wangda Tan commented on YARN-2497: -- [~templedf], I just took a quick look at your patch, some minor

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177285#comment-16177285 ] Wangda Tan commented on YARN-4511: -- [~haibo.chen], thanks for working on the patch, I'm reviewing the

[jira] [Commented] (YARN-7201) Add an apache httpd example YARN service

2017-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177314#comment-16177314 ] Jian He commented on YARN-7201: --- Thanks Billie! the example looks great. Both service has name

[jira] [Updated] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7245: - Attachment: CapSched UI Showing Inaccurate Per User Max AM Resource.png The value in the {{Max AM

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-22 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176967#comment-16176967 ] Botong Huang commented on YARN-7102: Ah got your point, let me work on the synchronized version of

[jira] [Assigned] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-09-22 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-7190: -- Assignee: Varun Saxena > Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177203#comment-16177203 ] Xuan Gong commented on YARN-6570: - Committed into branch-2.8. Thanks for the fix > No logs were found for

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177201#comment-16177201 ] Xuan Gong commented on YARN-6570: - +1 LGTM. Checking this in > No logs were found for running application,

[jira] [Commented] (YARN-7238) Documentation for API based scheduler configuration management

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176939#comment-16176939 ] Hadoop QA commented on YARN-7238: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176983#comment-16176983 ] Hadoop QA commented on YARN-6691: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-22 Thread Chetna Chaudhari (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177124#comment-16177124 ] Chetna Chaudhari commented on YARN-6943: Thanks [~ajisakaa] for reviewing patch, I have worked on

[jira] [Updated] (YARN-6943) Update Yarn to YARN in documentation

2017-09-22 Thread Chetna Chaudhari (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chetna Chaudhari updated YARN-6943: --- Attachment: YARN-6943-2.patch > Update Yarn to YARN in documentation >

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: (was: YARN-2497.004.patch) > Changes for fair scheduler to support allocate

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177197#comment-16177197 ] Junping Du commented on YARN-6570: -- Findbug is not related to the patch here. I think we are good to go

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177218#comment-16177218 ] Hadoop QA commented on YARN-7244: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6570) No logs were found for running application, running container

2017-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6570: - Fix Version/s: (was: 2.8.2) 2.8.3 > No logs were found for running application,

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177320#comment-16177320 ] Hadoop QA commented on YARN-6550: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-22 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176961#comment-16176961 ] Eric Badger commented on YARN-7226: --- I can see the need for Docker containers to supply their own env

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2497.003.patch > Changes for fair scheduler to support allocate resource

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2497.004.patch This patch should be better. It also adds docs and more

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177219#comment-16177219 ] Junping Du commented on YARN-6570: -- Thanks [~xgong]. Correct it to 2.8.3 for landing on branch-2.8 only.

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177137#comment-16177137 ] Jian He commented on YARN-7191: --- uploaded an initial draft > Improve yarn-service documentation >

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: YARN-7191.yarn-native-services.01.patch > Improve yarn-service documentation >

[jira] [Commented] (YARN-7118) AHS REST API can return NullPointerException

2017-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177173#comment-16177173 ] Hudson commented on YARN-7118: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12950 (See

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177265#comment-16177265 ] Hudson commented on YARN-6878: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12952 (See

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177295#comment-16177295 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-09-22 Thread Eric Payne (JIRA)
Eric Payne created YARN-7245: Summary: In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user Key: YARN-7245 URL: https://issues.apache.org/jira/browse/YARN-7245 Project:

[jira] [Updated] (YARN-7219) Fix AllocateRequestProto difference between branch-2/branch-2.8 and trunk

2017-09-22 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-7219: - Attachment: YARN-7219.001.patch > Fix AllocateRequestProto difference between branch-2/branch-2.8 and

[jira] [Commented] (YARN-7219) Fix AllocateRequestProto difference between branch-2/branch-2.8 and trunk

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177283#comment-16177283 ] Hadoop QA commented on YARN-7219: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177256#comment-16177256 ] Daniel Templeton commented on YARN-2497: Thanks for the review! Now that I know your use case for

[jira] [Updated] (YARN-6550) Capture launch_container.sh logs

2017-09-22 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6550: --- Attachment: YARN-6550.012.patch Had missed changing the renamed variables while doing exec.

[jira] [Commented] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176149#comment-16176149 ] Hadoop QA commented on YARN-7243: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176189#comment-16176189 ] Hadoop QA commented on YARN-7243: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-22 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6871: -- Attachment: YARN-6871.008.patch > Add additional deSelects params in getAppReport >

[jira] [Created] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
Yeliang Cang created YARN-7243: -- Summary: Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager Key: YARN-7243 URL: https://issues.apache.org/jira/browse/YARN-7243 Project: Hadoop YARN

[jira] [Commented] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176102#comment-16176102 ] Yeliang Cang commented on YARN-7243: In the below code: {code:title=FairSchedulerEventLog.java}

[jira] [Commented] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176107#comment-16176107 ] Yeliang Cang commented on YARN-7243: Submit patch002 to remove the trailing whitespace in

[jira] [Commented] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176019#comment-16176019 ] Yeliang Cang commented on YARN-7243: Add patch001. > Moving logging APIs over to slf4j in

[jira] [Updated] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7243: --- Attachment: YARN-7243.001.patch > Moving logging APIs over to slf4j in

[jira] [Updated] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-7243: --- Attachment: YARN-7243.002.patch > Moving logging APIs over to slf4j in

[jira] [Commented] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176007#comment-16176007 ] Hadoop QA commented on YARN-6916: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176085#comment-16176085 ] Hadoop QA commented on YARN-6871: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177326#comment-16177326 ] Haibo Chen commented on YARN-7009: -- Thanks for the update. I think we can avoid

[jira] [Updated] (YARN-7201) Add an apache httpd example YARN service

2017-09-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7201: - Attachment: YARN-7201.yarn-native-services.011.patch Thanks for the review, [~jianhe]. I have

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177333#comment-16177333 ] Haibo Chen commented on YARN-4511: -- Thanks [~leftnoteasy] for reviewing. I will be on vacations for the

[jira] [Commented] (YARN-7201) Add an apache httpd example YARN service

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177388#comment-16177388 ] Hadoop QA commented on YARN-7201: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177390#comment-16177390 ] Wangda Tan commented on YARN-4511: -- Thanks [~haibo.chen], 1) SchedulerNode#resetAllocationThisHeartbeat:

[jira] [Commented] (YARN-6943) Update Yarn to YARN in documentation

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177464#comment-16177464 ] Hadoop QA commented on YARN-6943: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177470#comment-16177470 ] Yeliang Cang commented on YARN-7243: Sorry, there are many other "org.apache.commons.logging.Log"

[jira] [Comment Edited] (YARN-7243) Moving logging APIs over to slf4j in hadoop-yarn-server-resourcemanager

2017-09-22 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177470#comment-16177470 ] Yeliang Cang edited comment on YARN-7243 at 9/23/17 3:23 AM: - Sorry, there are

[jira] [Commented] (YARN-7135) Clean up lock-try order in common scheduler code

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177583#comment-16177583 ] Hadoop QA commented on YARN-7135: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177367#comment-16177367 ] Hadoop QA commented on YARN-4511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-22 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6953: --- Attachment: YARN-6953.007.patch > Clean up ResourceUtils.setMinimumAllocationForMandatoryResources()

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-22 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177473#comment-16177473 ] Manikandan R commented on YARN-6953: [~wangda] Rebased patch with latest trunk and attached new patch.

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177476#comment-16177476 ] Hadoop QA commented on YARN-6953: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7109) Extend aggregation operation for new ATS design

2017-09-22 Thread Linlin Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177478#comment-16177478 ] Linlin Zhou commented on YARN-7109: --- Hi, Zian I am interested in this problem, since you are busy those

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177434#comment-16177434 ] Hadoop QA commented on YARN-6626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7135) Clean up lock-try order in common scheduler code

2017-09-22 Thread weiyuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weiyuan updated YARN-7135: -- Attachment: YARN-7135.004.patch > Clean up lock-try order in common scheduler code >

[jira] [Commented] (YARN-6509) Add a size threshold beyond which yarn logs will require a force option

2017-09-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177360#comment-16177360 ] Xuan Gong commented on YARN-6509: - Test-case failures are not related. > Add a size threshold beyond which

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177369#comment-16177369 ] Arun Suresh commented on YARN-4511: --- Would like to take a closer look at this at well - should be able to

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177577#comment-16177577 ] Varun Vasudev commented on YARN-6623: - [~andrew.wang] - YARN-4266 adds a new field for the Docker

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177578#comment-16177578 ] Varun Vasudev commented on YARN-6623: - [~andrew.wang] - YARN-4266 adds a new field for the Docker

[jira] [Commented] (YARN-6509) Add a size threshold beyond which yarn logs will require a force option

2017-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177580#comment-16177580 ] Junping Du commented on YARN-6509: -- Thanks [~xgong] for updating the patch. v3 patch looks good to me in

[jira] [Updated] (YARN-6626) Embed REST API service into RM

2017-09-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6626: Attachment: YARN-6626.yarn-native-services.004.patch Added @XmlType annotation to make data structure

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177357#comment-16177357 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177381#comment-16177381 ] Junping Du commented on YARN-6623: -- Hi [~vvasudev], do you agree with what we discussed in security alias

[jira] [Commented] (YARN-6878) TestCapacityScheduler.testDefaultNodeLabelExpressionQueueConfig() has the args to assertEqual() in the wrong order

2017-09-22 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177445#comment-16177445 ] Sen Zhao commented on YARN-6878: Thanks for your review and commit, [~templedf]! >

[jira] [Comment Edited] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176346#comment-16176346 ] Varun Vasudev edited comment on YARN-6623 at 9/22/17 12:41 PM: ---

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176386#comment-16176386 ] Sunil G commented on YARN-6504: --- Adding to this discussion, I would like to hightlight couple of thoughts.

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176346#comment-16176346 ] Varun Vasudev commented on YARN-6623: - [~leftnoteasy] - please don't commit the patch tomorrow. I need

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-09-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176401#comment-16176401 ] Sunil G commented on YARN-7237: --- Thanks [~leftnoteasy] for the idea. I also think this is better Some high

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176376#comment-16176376 ] Jason Lowe commented on YARN-7226: -- bq. For example, an image used for running MR tasks could specify its

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176421#comment-16176421 ] Jason Lowe commented on YARN-7102: -- Not a fan of that approach either. It has a corner case with the same

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176435#comment-16176435 ] Arun Suresh commented on YARN-6623: --- Thanks for the heads up [~djp].. Kindly do push this into branch-2

[jira] [Assigned] (YARN-7166) Container REST endpoints should report resource types

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-7166: -- Assignee: Daniel Templeton > Container REST endpoints should report resource types >

[jira] [Updated] (YARN-7201) Add an apache httpd example YARN service

2017-09-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7201: - Attachment: YARN-7201.yarn-native-services.009.patch New patch adds an IP-based example for

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176002#comment-16176002 ] Daniel Templeton commented on YARN-6504: Can we maybe get around the MR override capability by

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-09-22 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176004#comment-16176004 ] Daniel Templeton commented on YARN-7237: I agree with you. The overrides and the maximums are

[jira] [Created] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-22 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created YARN-7244: - Summary: ShuffleHandler is not aware of disks that are added Key: YARN-7244 URL: https://issues.apache.org/jira/browse/YARN-7244 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7201) Add an apache httpd example YARN service

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176569#comment-16176569 ] Hadoop QA commented on YARN-7201: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-22 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-7244: -- Attachment: YARN-7244.001.patch v1 patch that adds a new LocalDirAllocator#getLocalPathToRead() that

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176461#comment-16176461 ] Jason Lowe commented on YARN-7102: -- Forgot to mention that the above scenario is probably happening a lot

[jira] [Comment Edited] (YARN-6626) Embed REST API service into RM

2017-09-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176621#comment-16176621 ] Eric Yang edited comment on YARN-6626 at 9/22/17 3:59 PM: -- Fixed findbugs, unit

[jira] [Updated] (YARN-6626) Embed REST API service into RM

2017-09-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6626: Attachment: YARN-6626.yarn-native-services.003.patch Fixed findbugs issue. > Embed REST API service into RM

[jira] [Commented] (YARN-7116) CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage.

2017-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176700#comment-16176700 ] Eric Payne commented on YARN-7116: -- [~leftnoteasy], [~sunilg] If there are no objections, I'll backport

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176681#comment-16176681 ] Haibo Chen commented on YARN-7009: -- Thanks [~miklos.szeg...@cloudera.com] for the patch. A few comments:

[jira] [Commented] (YARN-7116) CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage.

2017-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176701#comment-16176701 ] Wangda Tan commented on YARN-7116: -- [~eepayne], I'm fine with backporting to 2.8 > CapacityScheduler Web

[jira] [Commented] (YARN-6550) Capture launch_container.sh logs

2017-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176705#comment-16176705 ] Wangda Tan commented on YARN-6550: -- Thanks [~suma.shivaprasad] for updating the patch, +1 to latest patch,

[jira] [Updated] (YARN-7238) Documentation for API based scheduler configuration management

2017-09-22 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7238: Attachment: YARN-7238-YARN-5734.001.patch > Documentation for API based scheduler configuration

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-09-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176821#comment-16176821 ] Jason Lowe commented on YARN-7102: -- Ah sorry, so maybe we're OK with this scenario in the current code as

[jira] [Commented] (YARN-7238) Documentation for API based scheduler configuration management

2017-09-22 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176820#comment-16176820 ] Jonathan Hung commented on YARN-7238: - 001 patch for initial documentation. Documents configurations

[jira] [Updated] (YARN-7116) CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage.

2017-09-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7116: - Fix Version/s: 2.8.3 > CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM >

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176843#comment-16176843 ] Hadoop QA commented on YARN-6626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7009: - Attachment: YARN-7009.005.patch Thank you for the review [~haibochen] and [~templedf]. I updated

  1   2   >