[jira] [Updated] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7240: -- Attachment: YARN-7240.002.patch [~kartheek], looks like the patch has not been rebased. Re-attaching

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179951#comment-16179951 ] Wangda Tan commented on YARN-6570: -- [~jlowe] / [~xgong], [~ssath...@hortonworks.com] just reported

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179720#comment-16179720 ] Hadoop QA commented on YARN-7249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7248: -- Attachment: YARN-7248.001.patch Attaching initial patch based on discussions above. * Removed the

[jira] [Comment Edited] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179887#comment-16179887 ] Botong Huang edited comment on YARN-2037 at 9/25/17 10:38 PM: -- Unit test

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179907#comment-16179907 ] Wangda Tan commented on YARN-7249: -- [~eepayne], bq. doesn't make sense if node is null, but if

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179992#comment-16179992 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-2915. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Comment Edited] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179887#comment-16179887 ] Botong Huang edited comment on YARN-2037 at 9/25/17 10:39 PM: -- Unit test

[jira] [Created] (YARN-7252) Removing queue then failing over results in exception

2017-09-25 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7252: --- Summary: Removing queue then failing over results in exception Key: YARN-7252 URL: https://issues.apache.org/jira/browse/YARN-7252 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179806#comment-16179806 ] Arun Suresh commented on YARN-7240: --- bq. Requeing the containers to the front of the queuedGuaranteed or

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179901#comment-16179901 ] Jonathan Hung commented on YARN-7241: - Updating with 003 patch to put some quotes around SchedConfCLI

[jira] [Updated] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7241: Attachment: YARN-7241.003.patch > Merge YARN-5734 to trunk/branch-2 >

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179904#comment-16179904 ] Arun Suresh commented on YARN-7240: --- +1. The latest patch looks good. (I will take care of the unused

[jira] [Updated] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7240: -- Target Version/s: 2.9.0, 3.0.0-beta1 > Add more states and transitions to stabilize the NM Container

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179899#comment-16179899 ] Jonathan Hung commented on YARN-7251: - Attaching 002 to put quotes around SchedConfCLI examples, since

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179981#comment-16179981 ] Hadoop QA commented on YARN-7248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-09-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179775#comment-16179775 ] Miklos Szegedi commented on YARN-1014: -- Thank you for the patch [~haibochen]. I have a few comments:

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2037: - Target Version/s: 2.9.0 (was: 2.7.5) > Add restart support for Unmanaged AMs >

[jira] [Commented] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179898#comment-16179898 ] Subru Krishnan commented on YARN-2037: -- Thanks [~botong] for the patch. +1 from my side. I'll wait

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.002.patch > Misc changes to YARN-5734 > - >

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179941#comment-16179941 ] Hadoop QA commented on YARN-7226: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179939#comment-16179939 ] Jonathan Hung commented on YARN-7251: - Thanks [~leftnoteasy], will commit this and YARN-7238. > Misc

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179953#comment-16179953 ] Hudson commented on YARN-7240: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12973 (See

[jira] [Assigned] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7248: - Assignee: Arun Suresh > NM returns new SCHEDULED container status to older clients >

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179819#comment-16179819 ] Chris Trezzo commented on YARN-7250: The TestNMClient failure is happening on trunk as well, and is

[jira] [Updated] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7226: - Attachment: YARN-7226.003.patch Attaching a patch that implements the ignore-whitelist-vars-for-Docker

[jira] [Commented] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179887#comment-16179887 ] Botong Huang commented on YARN-2037: Unit test failure is irrelevant and being tracked under YARN-7044.

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179971#comment-16179971 ] Arun Suresh commented on YARN-6570: --- [~wangda], It looks like prior to YARN-6570, The nodemanager never

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180007#comment-16180007 ] Hadoop QA commented on YARN-7249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7253: -- Summary: Shared Cache Manager daemon command listed as admin subcmd in yarn script Key: YARN-7253 URL: https://issues.apache.org/jira/browse/YARN-7253 Project: Hadoop

[jira] [Resolved] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung resolved YARN-7251. - Resolution: Fixed > Misc changes to YARN-5734 > - > > Key:

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Fix Version/s: YARN-5734 > Misc changes to YARN-5734 > - > >

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Priority: Trivial (was: Minor) > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Description: Currently the command to start the shared cache manager daemon is listed as an admin

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180131#comment-16180131 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180030#comment-16180030 ] Jian He commented on YARN-7191: --- Updated the doc again > Improve yarn-service documentation >

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: YARN-7191.yarn-native-services.02.patch > Improve yarn-service documentation >

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180062#comment-16180062 ] Hadoop QA commented on YARN-7253: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180072#comment-16180072 ] Jonathan Hung commented on YARN-7252: - One approach I see is adding a reinitialize wrapper in

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180198#comment-16180198 ] kartheek muthyala commented on YARN-7240: - Thank you for [~asuresh], for rebasing and the

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180246#comment-16180246 ] Eric Yang commented on YARN-6626: - [~jianhe] Resource Manager jetty server is setup to chain a series of

[jira] [Updated] (YARN-7238) Documentation for API based scheduler configuration management

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7238: Fix Version/s: YARN-5734 > Documentation for API based scheduler configuration management >

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-alpha4 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-beta1 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Commented] (YARN-7247) Assign multiple will lead to hot point problems of physical resource consumption

2017-09-25 Thread balloons (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180148#comment-16180148 ] balloons commented on YARN-7247: Thanks [~yufeigu], the *YARN-1042* issue can completely solve my problem.

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180279#comment-16180279 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7118) AHS REST API can return NullPointerException

2017-09-25 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7118: - Attachment: YARN-7118-branch-2.01.patch Here is a version of the patch that works with branch-2.

[jira] [Commented] (YARN-7157) Add admin configuration to filter per-user's apps in secure cluster

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179029#comment-16179029 ] Hadoop QA commented on YARN-7157: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179115#comment-16179115 ] Jason Lowe commented on YARN-7226: -- bq. If the user doesn't override the env vars, it is expected that

[jira] [Updated] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-09-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-2162: --- Attachment: YARN-2162.006.patch Thanks for the review, [~templedf]. - 1. Add the check in class

[jira] [Comment Edited] (YARN-2162) add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

2017-09-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178690#comment-16178690 ] Yufei Gu edited comment on YARN-2162 at 9/25/17 7:59 AM: - Thanks for the review,

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178721#comment-16178721 ] Yufei Gu commented on YARN-7207: What did I do in my first patch? # Cache the RM proxy server host name and

[jira] [Commented] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-09-25 Thread zhengchenyu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178812#comment-16178812 ] zhengchenyu commented on YARN-6223: --- I thinks NM recovery for gpu doesn't take effect. Becuase

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178832#comment-16178832 ] Daniel Templeton commented on YARN-6504: The vast majority of users still only ask for 1 core and

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178837#comment-16178837 ] Sunil G commented on YARN-6953: --- Latest patch seems fine (v8 patch). I will wait for [~dan...@cloudera.com]

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-09-25 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178838#comment-16178838 ] Sunil G commented on YARN-6871: --- Yes. Latest patch seems fine to me. I could commit tomorrow if there are no

[jira] [Comment Edited] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178851#comment-16178851 ] Peter Bacsko edited comment on YARN-6504 at 9/25/17 11:07 AM: -- Just my 2

[jira] [Commented] (YARN-6504) Add support for resource profiles in MapReduce

2017-09-25 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16178851#comment-16178851 ] Peter Bacsko commented on YARN-6504: Just my 2 cents: there could be Hadoop users out there who spent

[jira] [Commented] (YARN-7246) Fix the default docker binary path

2017-09-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179152#comment-16179152 ] Eric Badger commented on YARN-7246: --- [~shaneku...@gmail.com], can you update the description to give a

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179207#comment-16179207 ] Eric Badger commented on YARN-6623: --- Hey [~vvasudev], thanks for the updated patch! The changes related

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179240#comment-16179240 ] Jason Lowe commented on YARN-6570: -- -1 for the branch-2.8 patch. This broke a lot of things since nobody,

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.013.patch Uploaded the wrong patch file by mistake. YARN-6623.013.patch is

[jira] [Commented] (YARN-7118) AHS REST API can return NullPointerException

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179178#comment-16179178 ] Hadoop QA commented on YARN-7118: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-09-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179209#comment-16179209 ] Eric Yang commented on YARN-5534: - [~miklos.szeg...@cloudera.com] White list should be visible to all users

[jira] [Created] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7248: Summary: NM returns new SCHEDULED container status to older clients Key: YARN-7248 URL: https://issues.apache.org/jira/browse/YARN-7248 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.001.patch Thanks for the review [~ebadger]. {noformat} Hey Varun Vasudev,

[jira] [Updated] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6570: - Fix Version/s: (was: 2.8.3) I reverted this from branch-2.8 and also filed YARN-7248 to address the

[jira] [Commented] (YARN-4163) Audit getQueueInfo and getApplications calls

2017-09-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179253#comment-16179253 ] Eric Payne commented on YARN-4163: -- [~lichangleo], please let me know if you plan on up-merging the patch

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179233#comment-16179233 ] Jason Lowe commented on YARN-4597: -- Sorry to arrive late here, but this has backwards-compatibility

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179231#comment-16179231 ] Jason Lowe commented on YARN-7248: -- Clients should pass a version flag or something similar to indicate

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: (was: YARN-6623.001.patch) > Add support to turn off launching privileged containers

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179268#comment-16179268 ] Eric Badger commented on YARN-6623: --- Looks good to me! +1 (non-binding) pending jenkins > Add support to

[jira] [Created] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7249: Summary: Fix CapacityScheduler NPE issue when a container preempted while the node is being removed Key: YARN-7249 URL: https://issues.apache.org/jira/browse/YARN-7249

[jira] [Resolved] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-7249. -- Resolution: Invalid Sorry for the noise, it is not an issue for 2.8 as well. Closing as invalid. > Fix

[jira] [Reopened] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-7249: -- Double checked, it is still a problem: {code} @Override public void completedContainer(Resource

[jira] [Updated] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7249: - Attachment: YARN-7249.branch-2.8.001.patch > Fix CapacityScheduler NPE issue when a container preempted

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179348#comment-16179348 ] Wangda Tan commented on YARN-7249: -- [~eepayne] could you help with review? It is a straightforward patch.

[jira] [Commented] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179356#comment-16179356 ] Hudson commented on YARN-7153: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12967 (See

[jira] [Updated] (YARN-7105) Refactor of Queue Visualization

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7105: - Description: Based on the discussion with [~wangda], current implementation of Queue is not easy to use

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179430#comment-16179430 ] Wangda Tan commented on YARN-7241: -- 1) for CLI: {{schedconf}} => {{scheduler-conf}} - Need to change

[jira] [Commented] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179326#comment-16179326 ] Akira Ajisaka commented on YARN-7153: - +1, checking this in. > Remove duplicated code in

[jira] [Updated] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7153: Priority: Minor (was: Major) > Remove duplicated code in AMRMClientAsyncImpl.java >

[jira] [Commented] (YARN-7247) Assign multiple will lead to hot point problems of physical resource consumption

2017-09-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179340#comment-16179340 ] Yufei Gu commented on YARN-7247: [~balloons], this is not a problem of multi assignment. You are basically

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179337#comment-16179337 ] Arun Suresh commented on YARN-7248: --- Thanks for raising this [~jlowe]. So, given that old clients only

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179343#comment-16179343 ] Arun Suresh commented on YARN-6570: --- Sorry, am just a bit confused. In both branch-2 and trunk, we have:

[jira] [Commented] (YARN-7105) Refactor of Queue Visualization

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179357#comment-16179357 ] Wangda Tan commented on YARN-7105: -- Thanks [~dingda6] for this prototype, also this is design doc for this

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179392#comment-16179392 ] Jason Lowe commented on YARN-7248: -- Maybe I'm missing something, but it looks like containers can be in

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179401#comment-16179401 ] Jason Lowe commented on YARN-7248: -- bq. Is it ok if for the fix, we check and return RUNNING to the client

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179469#comment-16179469 ] Jason Lowe commented on YARN-7248: -- Sounds good. We'll be all set until someone comes along in Hadoop 3.4

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179408#comment-16179408 ] Jason Lowe commented on YARN-6570: -- Yes, which is why I didn't revert this from branch-2 or trunk, just

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179434#comment-16179434 ] Arun Suresh commented on YARN-6570: --- Got it.. thanks > No logs were found for running application,

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179458#comment-16179458 ] Arun Suresh commented on YARN-7248: --- Ah yes, we had included LOCALIZING in the reported SCHEDULED state

[jira] [Updated] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-7240: Attachment: YARN-7240.002.patch [~asuresh], Thank you for the quick feedback. The updated

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179520#comment-16179520 ] Jonathan Hung commented on YARN-7241: - Thanks for the feedback [~leftnoteasy] - most of these changes

[jira] [Created] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7250: -- Summary: Update Shared cache client api to use URLs Key: YARN-7250 URL: https://issues.apache.org/jira/browse/YARN-7250 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7251: --- Summary: Misc changes to YARN-5734 Key: YARN-7251 URL: https://issues.apache.org/jira/browse/YARN-7251 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179550#comment-16179550 ] Hadoop QA commented on YARN-7240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179552#comment-16179552 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Attachment: YARN-7250-trunk-001.patch Attached v1 patch. > Update Shared cache client api to use URLs

  1   2   >