[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180279#comment-16180279 ] Hadoop QA commented on YARN-2497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-25 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180246#comment-16180246 ] Eric Yang commented on YARN-6626: - [~jianhe] Resource Manager jetty server is setup to chain a series of

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180198#comment-16180198 ] kartheek muthyala commented on YARN-7240: - Thank you for [~asuresh], for rebasing and the

[jira] [Commented] (YARN-7247) Assign multiple will lead to hot point problems of physical resource consumption

2017-09-25 Thread balloons (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180148#comment-16180148 ] balloons commented on YARN-7247: Thanks [~yufeigu], the *YARN-1042* issue can completely solve my problem.

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180131#comment-16180131 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7252) Removing queue then failing over results in exception

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180072#comment-16180072 ] Jonathan Hung commented on YARN-7252: - One approach I see is adding a reinitialize wrapper in

[jira] [Commented] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180062#comment-16180062 ] Hadoop QA commented on YARN-7253: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180060#comment-16180060 ] Hadoop QA commented on YARN-7191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-alpha4 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Affects Version/s: 3.0.0-beta1 > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Assigned] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo reassigned YARN-7253: -- Assignee: Chris Trezzo > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Attachment: YARN-7253-trunk-001.patch Trunk v1 patch attached. > Shared Cache Manager daemon command

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Description: Currently the command to start the shared cache manager daemon is listed as an admin

[jira] [Updated] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7253: --- Priority: Trivial (was: Minor) > Shared Cache Manager daemon command listed as admin subcmd in yarn

[jira] [Commented] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180044#comment-16180044 ] Sen Zhao commented on YARN-7153: Thanks for your review, [~ajisakaa]! > Remove duplicated code in

[jira] [Created] (YARN-7253) Shared Cache Manager daemon command listed as admin subcmd in yarn script

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7253: -- Summary: Shared Cache Manager daemon command listed as admin subcmd in yarn script Key: YARN-7253 URL: https://issues.apache.org/jira/browse/YARN-7253 Project: Hadoop

[jira] [Commented] (YARN-7191) Improve yarn-service documentation

2017-09-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180030#comment-16180030 ] Jian He commented on YARN-7191: --- Updated the doc again > Improve yarn-service documentation >

[jira] [Updated] (YARN-7191) Improve yarn-service documentation

2017-09-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7191: -- Attachment: YARN-7191.yarn-native-services.02.patch > Improve yarn-service documentation >

[jira] [Resolved] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung resolved YARN-7251. - Resolution: Fixed > Misc changes to YARN-5734 > - > > Key:

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Fix Version/s: YARN-5734 > Misc changes to YARN-5734 > - > >

[jira] [Updated] (YARN-7238) Documentation for API based scheduler configuration management

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7238: Fix Version/s: YARN-5734 > Documentation for API based scheduler configuration management >

[jira] [Commented] (YARN-7238) Documentation for API based scheduler configuration management

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180016#comment-16180016 ] Jonathan Hung commented on YARN-7238: - Committing based on discussion in YARN-7241 and YARN-7251 >

[jira] [Commented] (YARN-6626) Embed REST API service into RM

2017-09-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180010#comment-16180010 ] Jian He commented on YARN-6626: --- Thanks [~eyang] for the patch, some questions and comments on the patch: -

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16180007#comment-16180007 ] Hadoop QA commented on YARN-7249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7252) Removing queue then failing over results in exception

2017-09-25 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7252: --- Summary: Removing queue then failing over results in exception Key: YARN-7252 URL: https://issues.apache.org/jira/browse/YARN-7252 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179992#comment-16179992 ] Hadoop QA commented on YARN-7241: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179981#comment-16179981 ] Hadoop QA commented on YARN-7248: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179971#comment-16179971 ] Arun Suresh commented on YARN-6570: --- [~wangda], It looks like prior to YARN-6570, The nodemanager never

[jira] [Commented] (YARN-7207) Cache the local host name when getting application list in RM

2017-09-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179957#comment-16179957 ] Robert Kanter commented on YARN-7207: - Looks good overall, a few comments: # In

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179953#comment-16179953 ] Hudson commented on YARN-7240: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12973 (See

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179951#comment-16179951 ] Wangda Tan commented on YARN-6570: -- [~jlowe] / [~xgong], [~ssath...@hortonworks.com] just reported

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179941#comment-16179941 ] Hadoop QA commented on YARN-7226: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179939#comment-16179939 ] Jonathan Hung commented on YARN-7251: - Thanks [~leftnoteasy], will commit this and YARN-7238. > Misc

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179915#comment-16179915 ] Wangda Tan commented on YARN-7251: -- Patch LGTM, thanks [~jhung]! > Misc changes to YARN-5734 >

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179907#comment-16179907 ] Wangda Tan commented on YARN-7249: -- [~eepayne], bq. doesn't make sense if node is null, but if

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179904#comment-16179904 ] Arun Suresh commented on YARN-7240: --- +1. The latest patch looks good. (I will take care of the unused

[jira] [Updated] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7240: -- Target Version/s: 2.9.0, 3.0.0-beta1 > Add more states and transitions to stabilize the NM Container

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179901#comment-16179901 ] Jonathan Hung commented on YARN-7241: - Updating with 003 patch to put some quotes around SchedConfCLI

[jira] [Updated] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7241: Attachment: YARN-7241.003.patch > Merge YARN-5734 to trunk/branch-2 >

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179899#comment-16179899 ] Jonathan Hung commented on YARN-7251: - Attaching 002 to put quotes around SchedConfCLI examples, since

[jira] [Commented] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179898#comment-16179898 ] Subru Krishnan commented on YARN-2037: -- Thanks [~botong] for the patch. +1 from my side. I'll wait

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.002.patch > Misc changes to YARN-5734 > - >

[jira] [Comment Edited] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179887#comment-16179887 ] Botong Huang edited comment on YARN-2037 at 9/25/17 10:39 PM: -- Unit test

[jira] [Comment Edited] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179887#comment-16179887 ] Botong Huang edited comment on YARN-2037 at 9/25/17 10:38 PM: -- Unit test

[jira] [Commented] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179887#comment-16179887 ] Botong Huang commented on YARN-2037: Unit test failure is irrelevant and being tracked under YARN-7044.

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2037: - Target Version/s: 2.9.0 (was: 2.7.5) > Add restart support for Unmanaged AMs >

[jira] [Updated] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7226: - Attachment: YARN-7226.003.patch Attaching a patch that implements the ignore-whitelist-vars-for-Docker

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179851#comment-16179851 ] Hadoop QA commented on YARN-7240: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179841#comment-16179841 ] Hadoop QA commented on YARN-1014: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179819#comment-16179819 ] Chris Trezzo commented on YARN-7250: The TestNMClient failure is happening on trunk as well, and is

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179806#comment-16179806 ] Arun Suresh commented on YARN-7240: --- bq. Requeing the containers to the front of the queuedGuaranteed or

[jira] [Updated] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7240: -- Attachment: YARN-7240.002.patch [~kartheek], looks like the patch has not been rebased. Re-attaching

[jira] [Resolved] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-2915. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[jira] [Commented] (YARN-1014) Configure OOM Killer to kill OPPORTUNISTIC containers first

2017-09-25 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179775#comment-16179775 ] Miklos Szegedi commented on YARN-1014: -- Thank you for the patch [~haibochen]. I have a few comments:

[jira] [Assigned] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7251: --- Assignee: Jonathan Hung > Misc changes to YARN-5734 > - > >

[jira] [Updated] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7248: -- Attachment: YARN-7248.001.patch Attaching initial patch based on discussions above. * Removed the

[jira] [Assigned] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7248: - Assignee: Arun Suresh > NM returns new SCHEDULED container status to older clients >

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179720#comment-16179720 ] Hadoop QA commented on YARN-7249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179698#comment-16179698 ] Sidharta Seethana commented on YARN-7226: - {quote} But how does this work today for Docker

[jira] [Commented] (YARN-7226) Whitelisted variables do not support delayed variable expansion

2017-09-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179676#comment-16179676 ] Eric Badger commented on YARN-7226: --- [~jlowe], this approach makes sense to me. I don't see any case

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179675#comment-16179675 ] Jonathan Hung commented on YARN-7241: - Hi [~leftnoteasy], attached a patch to YARN-7251 addressing

[jira] [Updated] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7241: Attachment: YARN-7241.002.patch > Merge YARN-5734 to trunk/branch-2 >

[jira] [Commented] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179674#comment-16179674 ] Daniel Templeton commented on YARN-2497: [~leftnoteasy], it looks to me like

[jira] [Commented] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179670#comment-16179670 ] Jonathan Hung commented on YARN-7251: - Attaching 001 patch based on comments in

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-09-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2497.004.patch I found the bug that was causing the CS test failures. I also

[jira] [Updated] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7251: Attachment: YARN-7251-YARN-5734.001.patch > Misc changes to YARN-5734 > - >

[jira] [Commented] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179656#comment-16179656 ] Hadoop QA commented on YARN-7250: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179653#comment-16179653 ] Eric Payne commented on YARN-7249: -- [~leftnoteasy], I recognize that calling {{queue.completedContainer}}

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Description: We should make the SharedCacheClient use api more consistent with other YARN api

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179553#comment-16179553 ] Eric Payne commented on YARN-7249: -- [~leftnoteasy]: Sure. Looking now. > Fix CapacityScheduler NPE issue

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179550#comment-16179550 ] Hadoop QA commented on YARN-7240: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179552#comment-16179552 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7251) Misc changes to YARN-5734

2017-09-25 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7251: --- Summary: Misc changes to YARN-5734 Key: YARN-7251 URL: https://issues.apache.org/jira/browse/YARN-7251 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-7250: --- Attachment: YARN-7250-trunk-001.patch Attached v1 patch. > Update Shared cache client api to use URLs

[jira] [Created] (YARN-7250) Update Shared cache client api to use URLs

2017-09-25 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-7250: -- Summary: Update Shared cache client api to use URLs Key: YARN-7250 URL: https://issues.apache.org/jira/browse/YARN-7250 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179520#comment-16179520 ] Jonathan Hung commented on YARN-7241: - Thanks for the feedback [~leftnoteasy] - most of these changes

[jira] [Updated] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-25 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-7240: Attachment: YARN-7240.002.patch [~asuresh], Thank you for the quick feedback. The updated

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179469#comment-16179469 ] Jason Lowe commented on YARN-7248: -- Sounds good. We'll be all set until someone comes along in Hadoop 3.4

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179458#comment-16179458 ] Arun Suresh commented on YARN-7248: --- Ah yes, we had included LOCALIZING in the reported SCHEDULED state

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179434#comment-16179434 ] Arun Suresh commented on YARN-6570: --- Got it.. thanks > No logs were found for running application,

[jira] [Commented] (YARN-7241) Merge YARN-5734 to trunk/branch-2

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179430#comment-16179430 ] Wangda Tan commented on YARN-7241: -- 1) for CLI: {{schedconf}} => {{scheduler-conf}} - Need to change

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179408#comment-16179408 ] Jason Lowe commented on YARN-6570: -- Yes, which is why I didn't revert this from branch-2 or trunk, just

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179401#comment-16179401 ] Jason Lowe commented on YARN-7248: -- bq. Is it ok if for the fix, we check and return RUNNING to the client

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179392#comment-16179392 ] Jason Lowe commented on YARN-7248: -- Maybe I'm missing something, but it looks like containers can be in

[jira] [Commented] (YARN-7105) Refactor of Queue Visualization

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179357#comment-16179357 ] Wangda Tan commented on YARN-7105: -- Thanks [~dingda6] for this prototype, also this is design doc for this

[jira] [Updated] (YARN-7105) Refactor of Queue Visualization

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7105: - Description: Based on the discussion with [~wangda], current implementation of Queue is not easy to use

[jira] [Commented] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179356#comment-16179356 ] Hudson commented on YARN-7153: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12967 (See

[jira] [Commented] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179348#comment-16179348 ] Wangda Tan commented on YARN-7249: -- [~eepayne] could you help with review? It is a straightforward patch.

[jira] [Updated] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7249: - Attachment: YARN-7249.branch-2.8.001.patch > Fix CapacityScheduler NPE issue when a container preempted

[jira] [Reopened] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-7249: -- Double checked, it is still a problem: {code} @Override public void completedContainer(Resource

[jira] [Commented] (YARN-6570) No logs were found for running application, running container

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179343#comment-16179343 ] Arun Suresh commented on YARN-6570: --- Sorry, am just a bit confused. In both branch-2 and trunk, we have:

[jira] [Commented] (YARN-7247) Assign multiple will lead to hot point problems of physical resource consumption

2017-09-25 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179340#comment-16179340 ] Yufei Gu commented on YARN-7247: [~balloons], this is not a problem of multi assignment. You are basically

[jira] [Commented] (YARN-7248) NM returns new SCHEDULED container status to older clients

2017-09-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179337#comment-16179337 ] Arun Suresh commented on YARN-7248: --- Thanks for raising this [~jlowe]. So, given that old clients only

[jira] [Resolved] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-7249. -- Resolution: Invalid Sorry for the noise, it is not an issue for 2.8 as well. Closing as invalid. > Fix

[jira] [Updated] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7153: Priority: Minor (was: Major) > Remove duplicated code in AMRMClientAsyncImpl.java >

[jira] [Commented] (YARN-7153) Remove duplicated code in AMRMClientAsyncImpl.java

2017-09-25 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179326#comment-16179326 ] Akira Ajisaka commented on YARN-7153: - +1, checking this in. > Remove duplicated code in

[jira] [Created] (YARN-7249) Fix CapacityScheduler NPE issue when a container preempted while the node is being removed

2017-09-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7249: Summary: Fix CapacityScheduler NPE issue when a container preempted while the node is being removed Key: YARN-7249 URL: https://issues.apache.org/jira/browse/YARN-7249

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16179268#comment-16179268 ] Eric Badger commented on YARN-6623: --- Looks good to me! +1 (non-binding) pending jenkins > Add support to

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: YARN-6623.013.patch Uploaded the wrong patch file by mistake. YARN-6623.013.patch is

[jira] [Updated] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-25 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-6623: Attachment: (was: YARN-6623.001.patch) > Add support to turn off launching privileged containers

  1   2   >