[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181238#comment-16181238 ] Hadoop QA commented on YARN-6626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-26 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181259#comment-16181259 ] Vrushali C commented on YARN-7253: -- +1 LGTM > Shared Cache Manager daemon command listed as admin subcmd

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181394#comment-16181394 ] Jonathan Hung commented on YARN-7252: - 001 patch to fix this issue. Ended up going a different

[jira] [Commented] (YARN-7256) Giving Yarn Application the Option to Black Out Certain Nodes On the Fly

2017-09-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181416#comment-16181416 ] Jason Lowe commented on YARN-7256: -- YARN already allows application-level blacklisting since YARN-750. Is

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181413#comment-16181413 ] Eric Yang commented on YARN-6623: - A couple concerns: # Moving code from Java to C without findbugs check

[jira] [Updated] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6626: Attachment: YARN-6626.yarn-native-services.007.patch Added instruction to QuickStart.md. Existing test case

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-26 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181276#comment-16181276 ] Chris Trezzo commented on YARN-7253: Thanks [~vrushalic]! I will commit later today to trunk and

[jira] [Commented] (YARN-5887) Policies for choosing which opportunistic containers to kill

2017-09-26 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181302#comment-16181302 ] Konstantinos Karanasos commented on YARN-5887: -- Hi [~Hugo Oshiro], The problem with the

[jira] [Created] (YARN-7256) Giving Yarn Application the Option to Black Out Certain Nodes On the Fly

2017-09-26 Thread Tanping Wang (JIRA)
Tanping Wang created YARN-7256: -- Summary: Giving Yarn Application the Option to Black Out Certain Nodes On the Fly Key: YARN-7256 URL: https://issues.apache.org/jira/browse/YARN-7256 Project: Hadoop

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181231#comment-16181231 ] Wangda Tan commented on YARN-2497: -- [~templedf], bq. because it gets submitted as the label expression

[jira] [Updated] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7202: Attachment: YARN-7202.yarn-native-services.002.patch Fixed check style issues. > End-to-end UT for

[jira] [Commented] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2017-09-26 Thread Sean Po (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181385#comment-16181385 ] Sean Po commented on YARN-5329: --- [~subru], [~curino] the test failure occurs because of the change in

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181441#comment-16181441 ] Wangda Tan commented on YARN-7252: -- [~jhung], I'm trying to understand the problem: when root.a deleted by

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181270#comment-16181270 ] Wangda Tan commented on YARN-7248: -- [~asuresh], I agree we should not add new field to public/stable enum

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181278#comment-16181278 ] Jason Lowe commented on YARN-7248: -- Thanks for the patch! It no longer applies and needs to be rebased.

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181266#comment-16181266 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7237) Cleanup usages of ResourceProfiles

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181325#comment-16181325 ] Wangda Tan commented on YARN-7237: -- [~sunilg], I think the default for minimum / maximum is a reasonable

[jira] [Commented] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181251#comment-16181251 ] Hadoop QA commented on YARN-7202: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7252: Attachment: YARN-7252-YARN-5734.001.patch > Removing queue then failing over results in exception >

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181444#comment-16181444 ] Eric Yang commented on YARN-6626: - The test case failures are seen in current yarn-native-services branch.

[jira] [Updated] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7252: - Priority: Critical (was: Major) > Removing queue then failing over results in exception >

[jira] [Updated] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7252: - Target Version/s: YARN-5734 > Removing queue then failing over results in exception >

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181512#comment-16181512 ] Jonathan Hung commented on YARN-7252: - Hi [~leftnoteasy], it will be added to the logs. The issue is

[jira] [Comment Edited] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181527#comment-16181527 ] Jian He edited comment on YARN-7191 at 9/26/17 8:36 PM: Thanks for the comments.

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181527#comment-16181527 ] Jian He commented on YARN-7191: --- Thanks for the comments. bq. It's a little confusing that this patch

[jira] [Commented] (YARN-7257) AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181664#comment-16181664 ] Hadoop QA commented on YARN-7257: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181706#comment-16181706 ] Eric Yang commented on YARN-7202: - [~jianhe] The test case are designed to be unit tests for ApiServer

[jira] [Comment Edited] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181706#comment-16181706 ] Eric Yang edited comment on YARN-7202 at 9/26/17 10:52 PM: --- [~jianhe] The test

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: YARN-7191.yarn-native-services.03.patch > Improve yarn-service documentation >

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: (was: YARN-7191.yarn-native-services.03.patch) > Improve yarn-service documentation >

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181531#comment-16181531 ] Wangda Tan commented on YARN-7241: -- [~jhung], I'm doing another scan of the aggregated patch, some

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181570#comment-16181570 ] Hadoop QA commented on YARN-7252: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181628#comment-16181628 ] Wangda Tan commented on YARN-6623: -- [~eyang], Thanks for the comments. I'm agree with #2, which we

[jira] [Commented] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181567#comment-16181567 ] Hadoop QA commented on YARN-7202: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181595#comment-16181595 ] Hadoop QA commented on YARN-7191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Moved] (YARN-7257) AggregatedLogsBlock reports a bad 'end' value as a bad 'start' value

2017-09-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved MAPREDUCE-6969 to YARN-7257: - Affects Version/s: (was: 3.0.0-beta1) (was:

[jira] [Updated] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7226: - Attachment: YARN-7226.004.patch Thanks for the review, Eric! bq. Is there a reason for us to catch the

[jira] [Updated] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6620: - Attachment: YARN-6620.011.patch Thanks [~zhengchenyu] for your review, I replied your comments here: bq.

[jira] [Commented] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181680#comment-16181680 ] Jian He commented on YARN-7202: --- [~eyang], thanks for working on the patch. I looked at the patch, looks like

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181687#comment-16181687 ] Hadoop QA commented on YARN-6626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-09-26 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7258: - Summary: Add Node and Rack Hints to Opportunistic Scheduler Key: YARN-7258 URL: https://issues.apache.org/jira/browse/YARN-7258 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: YARN-7191.yarn-native-services.03.patch > Improve yarn-service documentation >

[jira] [Commented] (YARN-7216) Missing ability to list configuration vs status

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181534#comment-16181534 ] Eric Yang commented on YARN-7216: - In hdfs:///user/$USER/.yarn/yarn/services/(service)/(service).json file

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181699#comment-16181699 ] Hadoop QA commented on YARN-7226: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181703#comment-16181703 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181576#comment-16181576 ] Wangda Tan commented on YARN-7252: -- [~jhung], Thanks for the explanation, overall the fix looks good, few

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181652#comment-16181652 ] Jian He commented on YARN-6626: --- bq. Every web filter is extended from WebServices. The WebServices is an

[jira] [Updated] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7252: Attachment: YARN-7252-YARN-5734.002.patch > Removing queue then failing over results in exception >

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181727#comment-16181727 ] Eric Yang commented on YARN-6626: - [~jianhe] I will change the api-services to api-service. Are you sure

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181756#comment-16181756 ] Gour Saha commented on YARN-6626: - Minor comment - {code} + if(enableServiceApi) { {code} A space

[jira] [Commented] (YARN-7259) add rolling policy to LogAggregationIndexedFileController

2017-09-26 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181795#comment-16181795 ] Xuan Gong commented on YARN-7259: - Planning to add rolling policy based on time as well. But I can not find

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-26 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181815#comment-16181815 ] Sidharta Seethana commented on YARN-7226: - [~jlowe], a couple of comments : * Is there a reason

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181845#comment-16181845 ] Eric Yang commented on YARN-6623: - [~wangda] How does a non-privileged user acquire excessive permission by

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181848#comment-16181848 ] Hadoop QA commented on YARN-6626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181911#comment-16181911 ] Jonathan Hung commented on YARN-7251: - 004-v2 to fix compile/test errors > Misc changes to YARN-5734 >

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: (was: YARN-7251-YARN-5734.001-v2.patch) > Misc changes to YARN-5734 >

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.003-v2.patch > Misc changes to YARN-5734 > -

[jira] [Comment Edited] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181783#comment-16181783 ] Jonathan Hung edited comment on YARN-7251 at 9/27/17 12:31 AM: --- Attached

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181783#comment-16181783 ] Jonathan Hung commented on YARN-7251: - Attached YARN-7251-YARN-5734.003-v2.patch to address these

[jira] [Updated] (YARN-7259) add rolling policy to LogAggregationIndexedFileController

2017-09-26 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7259: Description: We would roll over the log files based on the size. It only happens when the partial log

[jira] [Created] (YARN-7259) add rolling policy to LogAggregationIndexedFileController

2017-09-26 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7259: --- Summary: add rolling policy to LogAggregationIndexedFileController Key: YARN-7259 URL: https://issues.apache.org/jira/browse/YARN-7259 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7255) FiCaSchedulerApp.getAllocation() have a unuse parameter

2017-09-26 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-7255: --- Description: In {{CapacityScheduler.allocate()}}, there is a call {{getResourceCalculator()}} to get a value

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181728#comment-16181728 ] Jonathan Hung commented on YARN-7252: - [~leftnoteasy] thanks for taking a look. Attached 002 patch. bq.

[jira] [Reopened] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reopened YARN-7251: - > Misc changes to YARN-5734 > - > > Key: YARN-7251 >

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181753#comment-16181753 ] Jian He commented on YARN-6626: --- The @Inject annotation needs to remain. This is what I meant {code} ---

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181755#comment-16181755 ] Gour Saha commented on YARN-6626: - bq. Added ability to load ApiServer to RM as a web filter using

[jira] [Commented] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181778#comment-16181778 ] Jian He commented on YARN-7202: --- I'm just worried some ended up testing the ServiceClientForTest instead of

[jira] [Updated] (YARN-7255) FiCaSchedulerApp.getAllocation() have a unuse parameter

2017-09-26 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-7255: --- Description: In {{CapacityScheduler.allocate()}}, there is a call {{getResourceCalculator()}} to get a value

[jira] [Commented] (YARN-7255) FiCaSchedulerApp.getAllocation() have a unuse parameter

2017-09-26 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181828#comment-16181828 ] Sen Zhao commented on YARN-7255: This modification does not involve any tests and the failed tests are

[jira] [Updated] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6626: Attachment: YARN-6626.yarn-native-services.008.patch Update api-services to api-service. > Embed REST API

[jira] [Commented] (YARN-3767) Yarn Scheduler Load Simulator does not work

2017-09-26 Thread sandeep (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181758#comment-16181758 ] sandeep commented on YARN-3767: --- Simulator UI throws 404 when we click on simulate or track and throws below

[jira] [Comment Edited] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181786#comment-16181786 ] Jonathan Hung edited comment on YARN-7241 at 9/27/17 12:33 AM: ---

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181786#comment-16181786 ] Jonathan Hung commented on YARN-7241: - [~leftnoteasy] thanks - attached a patch to YARN-7251, also

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181813#comment-16181813 ] Hadoop QA commented on YARN-7252: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181873#comment-16181873 ] Hadoop QA commented on YARN-7251: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.004-v2.patch > Misc changes to YARN-5734 > -

[jira] [Commented] (YARN-6620) [YARN-6223] NM Java side code changes to support isolate GPU devices by using CGroups

2017-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181764#comment-16181764 ] Hadoop QA commented on YARN-6620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.001-v2.patch > Misc changes to YARN-5734 > -

[jira] [Updated] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7241: Attachment: YARN-7241.004.patch > Merge YARN-5734 to trunk/branch-2 >

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181922#comment-16181922 ] Jonathan Hung commented on YARN-7241: - Attaching 005 patch containing changes from YARN-7251 (see

[jira] [Updated] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-26 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7241: Attachment: YARN-7241.005.patch > Merge YARN-5734 to trunk/branch-2 >

[jira] [Updated] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-26 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7249: - Fix Version/s: 2.8.2 OK. I cherry-picked this to 2.8.2. Thanks. > Fix CapacityScheduler NPE issue when a

[jira] [Commented] (YARN-7245) In Cap Sched UI, Max AM Resource column in Active Users Info section should be per-user

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181178#comment-16181178 ] Sunil G commented on YARN-7245: --- This is bad. We ideally need user based max-am-limit. > In Cap Sched UI,

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181210#comment-16181210 ] Wangda Tan commented on YARN-7249: -- Thanks [~eepayne], I just removed 2.8.3 from fix version. > Fix

[jira] [Comment Edited] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180966#comment-16180966 ] Eric Yang edited comment on YARN-6626 at 9/26/17 3:43 PM: -- Remove .clone from

[jira] [Updated] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-6626: Attachment: YARN-6626.yarn-native-services.006.patch Remove .clone from getResource. The probability of

[jira] [Commented] (YARN-7116) CapacityScheduler Web UI: Queue's AM usage is always show on per-user's AM usage.

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181174#comment-16181174 ] Sunil G commented on YARN-7116: --- Yes. Its a good addition in branch-2.8 > CapacityScheduler Web UI: Queue's

[jira] [Assigned] (YARN-6626) Embed REST API service into RM

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-6626: --- Assignee: Eric Yang > Embed REST API service into RM > -- > >

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181225#comment-16181225 ] Arun Suresh commented on YARN-7248: --- [~jlowe] / [~leftnoteasy] / [~djp].. Thoughts ? > NM returns new

[jira] [Updated] (YARN-6570) No logs were found for running application, running container

2017-09-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6570: - Fix Version/s: (was: 3.1.0) (was: 3.0.0-beta1) (was:

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180989#comment-16180989 ] Hudson commented on YARN-6570: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12978 (See

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-26 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181132#comment-16181132 ] Billie Rinaldi commented on YARN-7191: -- Thanks for the documentation patch, [~jianhe]! Some comments:

[jira] [Updated] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7202: Attachment: YARN-7202.yarn-native-services.001.patch Added test cases to verify the API Server REST API end

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-26 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181019#comment-16181019 ] Eric Badger commented on YARN-7226: --- Hey [~jlowe], thanks for the patch. I have one question on it.

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-09-26 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181152#comment-16181152 ] Manikandan R commented on YARN-65: -- [~rohithsharma] [~Naganarasimha] Thanks for your reviews and commit >

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181173#comment-16181173 ] Sunil G commented on YARN-7244: --- Thanks [~kshukla] for this improvement. Some doubts here. # ShuffleHandler

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-09-26 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16181171#comment-16181171 ] Manikandan R commented on YARN-7119: As of now, updateNodeResource accepts below params: NodeID

[jira] [Assigned] (YARN-7202) End-to-end UT for api-server

2017-09-26 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7202: --- Assignee: Eric Yang > End-to-end UT for api-server > > >

[jira] [Updated] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7249: - Fix Version/s: (was: 2.8.3) > Fix CapacityScheduler NPE issue when a container preempted while the

[jira] [Reopened] (YARN-6570) No logs were found for running application, running container

2017-09-26 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened YARN-6570: -- I missed the NEW state exposure in the trunk/branch-2 patch which will also be problematic. This not only

  1   2   >