[jira] [Commented] (YARN-5642) Typos in 11 log messages

2016-09-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487511#comment-15487511 ] Sean Busbey commented on YARN-5642: --- good finds! interested in coming up with a patch for fixing these?

[jira] [Commented] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487659#comment-15487659 ] Jian He commented on YARN-5637: --- Thanks Arun, some comments: - Do we need to do something for this condition

[jira] [Reopened] (YARN-5635) Revert YARN-5567

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reopened YARN-5635: - Assignee: (was: Allen Wittenauer) Reopening the issue as per the comment in

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Fix Version/s: (was: 3.0.0-alpha2) > Better handling when bad script is configured as

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Target Version/s: 3.0.0-alpha2 > Better handling when bad script is configured as Node's

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487743#comment-15487743 ] Hadoop QA commented on YARN-5620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-5644) Define exit code for allowing NodeManager health script to mar

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang resolved YARN-5644. -- Resolution: Duplicate > Define exit code for allowing NodeManager health script to mar >

[jira] [Resolved] (YARN-5643) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5643. --- Resolution: Invalid should be a HADOOP jira > Remove package line length checkstyle rule >

[jira] [Updated] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5009: - Attachment: YARN-5009-branch-2.6.002.patch The merge conflicts for branch-2.6 were trivial context

[jira] [Commented] (YARN-5428) Allow for specifying the docker client configuration directory

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487463#comment-15487463 ] Shane Kumpf commented on YARN-5428: --- Thanks for the feedback, [~aw]. I agree with the above, but could

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-09-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487715#comment-15487715 ] Chris Douglas commented on YARN-5547: - bq. Skipping the container entirely would be very bad. The NM

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487435#comment-15487435 ] Hudson commented on YARN-5630: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10433 (See

[jira] [Commented] (YARN-5641) Localizer leaves behind tarballs after container is complete

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487444#comment-15487444 ] Naganarasimha G R commented on YARN-5641: - which version? > Localizer leaves behind tarballs after

[jira] [Commented] (YARN-5641) Localizer leaves behind tarballs after container is complete

2016-09-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487505#comment-15487505 ] Eric Badger commented on YARN-5641: --- [~Naganarasimha], I see the issue in 2.7. I suspect that it is also

[jira] [Updated] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5540: - Attachment: YARN-5540.003.patch Thanks for the review, Wangda! Updated the method names per the

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Description: Earlier fix to YARN-5567 is reverted because its not ideal to get the whole

[jira] [Commented] (YARN-5645) Support a white list of admin approved mounts

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487710#comment-15487710 ] Shane Kumpf commented on YARN-5645: --- Oops, I overlooked that one. Thanks for following up. I'll close

[jira] [Resolved] (YARN-5645) Support a white list of admin approved mounts

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5645. --- Resolution: Duplicate > Support a white list of admin approved mounts >

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487635#comment-15487635 ] Naganarasimha G R commented on YARN-5567: - reopened YARN-5635, put some comments there for further

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487633#comment-15487633 ] Naganarasimha G R commented on YARN-5635: - One of the approaches which was pointed in YARN-5567 :

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.014.patch Reverting this: bq. Also.. I pulled in a change from YARN-5637 here.

[jira] [Commented] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487687#comment-15487687 ] Hadoop QA commented on YARN-5540: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5645) Support a white list of admin approved mounts

2016-09-13 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487697#comment-15487697 ] Daniel Templeton commented on YARN-5645: How is this different from YARN-5534? > Support a white

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487835#comment-15487835 ] Ray Chiang commented on YARN-5635: -- And does anyone mind if I make this a subtask of YARN-5078? > Better

[jira] [Updated] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5540: - Attachment: YARN-5540.004.patch Oops, just realized patch 003 is missing the TODO comment removal. Fixed

[jira] [Created] (YARN-5644) Define exit code for allowing NodeManager health script to mar

2016-09-13 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-5644: Summary: Define exit code for allowing NodeManager health script to mar Key: YARN-5644 URL: https://issues.apache.org/jira/browse/YARN-5644 Project: Hadoop YARN

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487639#comment-15487639 ] Naganarasimha G R commented on YARN-5635: - One more comment from allen {code} It needs to be

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5635: - Assignee: Yufei Gu > Better handling when bad script is configured as Node's HealthScript >

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487832#comment-15487832 ] Ray Chiang commented on YARN-5635: -- I had captured something in a separate JIRA, but putting it here.

[jira] [Commented] (YARN-5641) Localizer leaves behind tarballs after container is complete

2016-09-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487533#comment-15487533 ] Eric Badger commented on YARN-5641: --- The problem appears to be a race between FileUtil.java:unTarUsingTar

[jira] [Commented] (YARN-5640) Issue while accessing resource manager webapp rest service

2016-09-13 Thread Loknath Priyatham Teja Singamsetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487563#comment-15487563 ] Loknath Priyatham Teja Singamsetty commented on YARN-5640: --- Thanks [~jlowe]. I

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487613#comment-15487613 ] Karthik Kambatla commented on YARN-5605: The unit test failure is unrelated, and two of the

[jira] [Commented] (YARN-5644) Define exit code for allowing NodeManager health script to mar

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487612#comment-15487612 ] Ray Chiang commented on YARN-5644: -- [~aw] [~Naganarasimha], we can continue the discussion here. I did my

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Hadoop Flags: (was: Incompatible change) > Better handling when bad script is configured

[jira] [Commented] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487644#comment-15487644 ] Hadoop QA commented on YARN-5540: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5645) Support a white list of admin approved mounts.

2016-09-13 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5645: - Summary: Support a white list of admin approved mounts. Key: YARN-5645 URL: https://issues.apache.org/jira/browse/YARN-5645 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5643) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-5643: - Summary: Remove package line length checkstyle rule Key: YARN-5643 URL: https://issues.apache.org/jira/browse/YARN-5643 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Description: Earlier fix to YARN-5567 is reverted because its not ideal to get the w. The

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Summary: Better handling when bad script is configured as Node's HealthScript (was: Revert

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-5635: Description: Earlier fix to YARN-5567 is reverted because its not ideal to get the. The

[jira] [Updated] (YARN-5645) Support a white list of admin approved mounts

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5645: -- Summary: Support a white list of admin approved mounts (was: Support a white list of admin approved

[jira] [Resolved] (YARN-5595) Update documentation and Javadoc to match change to NodeHealthScriptRunner#reportHealthStatus

2016-09-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-5595. Resolution: Won't Fix According to discussion in YARN-5567, we don't need this as well. So close it and

[jira] [Comment Edited] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487889#comment-15487889 ] Allen Wittenauer edited comment on YARN-5635 at 9/13/16 5:49 PM: - bq. does

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487889#comment-15487889 ] Allen Wittenauer commented on YARN-5635: bq. does that hold true for even making it an option via a

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487913#comment-15487913 ] Naganarasimha G R commented on YARN-5635: - Sorry Missed the earlier comment from Allen

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487877#comment-15487877 ] Ray Chiang commented on YARN-5635: -- [~aw] does that hold true for even making it an option via a

[jira] [Assigned] (YARN-4591) YARN Web UIs should provide a robots.txt

2016-09-13 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana reassigned YARN-4591: --- Assignee: Sidharta Seethana > YARN Web UIs should provide a robots.txt >

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487878#comment-15487878 ] Naganarasimha G R commented on YARN-5635: - [~rchiang], Unfortunately i reopened this jira and

[jira] [Commented] (YARN-4591) YARN Web UIs should provide a robots.txt

2016-09-13 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488191#comment-15488191 ] Sidharta Seethana commented on YARN-4591: - I'll take a crack at this. Thanks. > YARN Web UIs

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487860#comment-15487860 ] Allen Wittenauer commented on YARN-5635: bq. except the newly defined error code which will mark

[jira] [Assigned] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-3139: Assignee: Wangda Tan (was: Li Lu) > Improve locks in

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488723#comment-15488723 ] Hadoop QA commented on YARN-5620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488722#comment-15488722 ] Hadoop QA commented on YARN-5620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3139: - Attachment: YARN-3139.0.patch Attached first patch to run Jenkins. > Improve locks in

[jira] [Commented] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-09-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488679#comment-15488679 ] Chris Trezzo commented on YARN-5009: Thanks [~jlowe]! > NMLeveldbStateStoreService database can grow

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488661#comment-15488661 ] Hadoop QA commented on YARN-5620: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4794) Deadlock in NMClientImpl

2016-09-13 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488846#comment-15488846 ] Chris Trezzo commented on YARN-4794: Thanks! > Deadlock in NMClientImpl > > >

[jira] [Updated] (YARN-4794) Deadlock in NMClientImpl

2016-09-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4794: -- Target Version/s: 2.7.3, 2.8.0, 2.9.0, 2.6.5 (was: 2.8.0, 2.7.3, 2.9.0, 2.6.5) Fix Version/s:

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.002.patch Updating patch based on [~jianhe]'s suggesting and rebasing with latest

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488730#comment-15488730 ] Hadoop QA commented on YARN-3139: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-3140) Improve locks in AbstractCSQueue/LeafQueue/ParentQueue

2016-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488272#comment-15488272 ] Wangda Tan edited comment on YARN-3140 at 9/13/16 8:09 PM: --- [~jianhe]/[~jlowe]

[jira] [Commented] (YARN-3140) Improve locks in AbstractCSQueue/LeafQueue/ParentQueue

2016-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488272#comment-15488272 ] Wangda Tan commented on YARN-3140: -- [~jianhe] could you take a look at this patch? > Improve locks in

[jira] [Commented] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

2016-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488274#comment-15488274 ] Wangda Tan commented on YARN-3141: -- [~jianhe], [~kasha] could you take a look at this patch? > Improve

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488447#comment-15488447 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Updated] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5009: - Fix Version/s: 2.6.5 I committed this to branch-2.6. > NMLeveldbStateStoreService database can grow

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-09-13 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488333#comment-15488333 ] Jason Lowe commented on YARN-5547: -- Yes, having the ability to recover unknown keys that cannot be ignored

[jira] [Resolved] (YARN-4743) ResourceManager crash because TimSort

2016-09-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-4743. Resolution: Won't Fix > ResourceManager crash because TimSort > - > >

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-13 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488485#comment-15488485 ] Yufei Gu commented on YARN-4743: We don't sort running apps anymore according to YARN-3547, and the code

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.015.patch Deleted, renamed and re-uploaded the attachment > Core changes in

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-09-13 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488403#comment-15488403 ] Eric Payne commented on YARN-4945: -- bq. Does this make sense? [~sunilg], Thanks for the reply. Yes. I was

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.014.patch Uploading patch with minor refactoring: *

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: (was: YARN-5620.014.patch) > Core changes in NodeManager to support re-initialization of

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488464#comment-15488464 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488977#comment-15488977 ] Vinod Kumar Vavilapalli commented on YARN-5635: --- I'm deliberately staying out of the

[jira] [Commented] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

2016-09-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488937#comment-15488937 ] Karthik Kambatla commented on YARN-3141: I ll need at least until later this week. [~templedf] -

[jira] [Comment Edited] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488712#comment-15488712 ] Arun Suresh edited comment on YARN-5637 at 9/14/16 12:45 AM: - Updating patch

[jira] [Created] (YARN-5646) Documentation for scheduling of OPPORTUNISTIC containers

2016-09-13 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-5646: Summary: Documentation for scheduling of OPPORTUNISTIC containers Key: YARN-5646 URL: https://issues.apache.org/jira/browse/YARN-5646 Project: Hadoop

[jira] [Commented] (YARN-5631) Missing refreshClusterMaxPriority usage in rmadmin help message

2016-09-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489248#comment-15489248 ] Rohith Sharma K S commented on YARN-5631: - [~lewuathe] could you please provide branch-2.8 patch?

[jira] [Comment Edited] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488712#comment-15488712 ] Arun Suresh edited comment on YARN-5637 at 9/14/16 12:47 AM: - Updating patch

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489040#comment-15489040 ] Allen Wittenauer commented on YARN-5635: I'd respond, but I don't believe in giving that type of

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-09-13 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489201#comment-15489201 ] Sunil G commented on YARN-5545: --- [~bibinchundatt], [~Naganarasimha Garla] Had an offline discussion with

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

2016-09-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489276#comment-15489276 ] Rohith Sharma K S commented on YARN-3692: - [~naganarasimha...@apache.org] Would you give your

[jira] [Commented] (YARN-3359) Recover collector list in RM failed over

2016-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489295#comment-15489295 ] Junping Du commented on YARN-3359: -- Thanks [~gtCarrera9] for reply. bq. The only challenge is when two or

[jira] [Comment Edited] (YARN-3359) Recover collector list in RM failed over

2016-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489295#comment-15489295 ] Junping Du edited comment on YARN-3359 at 9/14/16 3:45 AM: --- Thanks [~gtCarrera9]

[jira] [Created] (YARN-5648) [Security] Client side changes for authentication

2016-09-13 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-5648: -- Summary: [Security] Client side changes for authentication Key: YARN-5648 URL: https://issues.apache.org/jira/browse/YARN-5648 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-09-13 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-5647: -- Summary: [Security] Collector and reader side changes for loading auth filters and principals Key: YARN-5647 URL: https://issues.apache.org/jira/browse/YARN-5647

[jira] [Commented] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

2016-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489400#comment-15489400 ] Wangda Tan commented on YARN-3141: -- Thanks [~kasha] / [~templedf] in advance! Meanwhile, I'm running large

[jira] [Commented] (YARN-5639) Add a tests for RMWebService @PUT/@POST methods.

2016-09-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489374#comment-15489374 ] Rohith Sharma K S commented on YARN-5639: - I cross verified test code and found that

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-09-13 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-5635: - Issue Type: Sub-task (was: Bug) Parent: YARN-5078 > Better handling when bad script is configured

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489523#comment-15489523 ] Jian He commented on YARN-5620: --- Thanks Arun for updating, The merged variable is not initialized with the

[jira] [Commented] (YARN-3359) Recover collector list in RM failed over

2016-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489375#comment-15489375 ] Junping Du commented on YARN-3359: -- More specifically, I think there are several works need to be done for

[jira] [Resolved] (YARN-5639) Add a tests for RMWebService @PUT/@POST methods.

2016-09-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-5639. - Resolution: Implemented > Add a tests for RMWebService @PUT/@POST methods. >

[jira] [Updated] (YARN-5163) Fix TestClientToAMTokens and TestClientRMTokens

2016-09-13 Thread Wei Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Zhou updated YARN-5163: --- Attachment: YARN-5163-v2.patch The patch is updated and tested with unit tests and built-in benchmarks. The

[jira] [Commented] (YARN-5641) Localizer leaves behind tarballs after container is complete

2016-09-13 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487350#comment-15487350 ] Eric Badger commented on YARN-5641: --- Here is an example log of the failure. The localizer attempts to

[jira] [Resolved] (YARN-5628) Remove package line length checkstyle rule

2016-09-13 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-5628. --- Resolution: Invalid This needs to be a HADOOP jira. > Remove package line length checkstyle rule >

[jira] [Created] (YARN-5642) Typos in 11 log messages

2016-09-13 Thread Mehran Hassani (JIRA)
Mehran Hassani created YARN-5642: Summary: Typos in 11 log messages Key: YARN-5642 URL: https://issues.apache.org/jira/browse/YARN-5642 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-09-13 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487355#comment-15487355 ] Allen Wittenauer commented on YARN-5567: It needs to be available via metrics2, otherwise it's

[jira] [Updated] (YARN-5631) Missing refreshClusterMaxPriority usage in rmadmin help message

2016-09-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5631: Target Version/s: 2.8.0 > Missing refreshClusterMaxPriority usage in rmadmin help message >

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486721#comment-15486721 ] Jian He commented on YARN-5620: --- [~asuresh], found a couple more issues while looking at the other patch: -

[jira] [Commented] (YARN-5631) Missing refreshClusterMaxPriority usage in rmadmin help message

2016-09-13 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486833#comment-15486833 ] Rohith Sharma K S commented on YARN-5631: - committed to trunk/branch-2.. patch could not be applied

  1   2   >