[jira] [Updated] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2315: Attachment: YARN-2315.001.patch Should use setCurrentCapacity instead of setCapacity to configure used

[jira] [Commented] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105091#comment-14105091 ] zhihai xu commented on YARN-2315: - I implemented a test cae testQueueInfo in the new patch

[jira] [Updated] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2434: - Summary: RM should not recover containers from previously failed attempt when AM restart is not enabled

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105116#comment-14105116 ] Wangda Tan commented on YARN-2434: -- Jian, thanks for the patch, LGTM +1 RM should not

[jira] [Commented] (YARN-2433) Stale token used by restarted AM (with previous containers retained) to request new container

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105119#comment-14105119 ] Wangda Tan commented on YARN-2433: -- [~yingdachen], thanks for reporting this issue, I can

[jira] [Updated] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-08-21 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated YARN-2198: --- Attachment: YARN-2198.separation.patch This patch contains the separation of winutils into a separate

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105192#comment-14105192 ] Hadoop QA commented on YARN-415: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2014-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-160: --- Attachment: apache-yarn-160.1.patch Uploaded new patch to address [~djp] comments. nodemanagers

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: demo.png RM should log using RMStore at startup time

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.2.patch Updated to address Karthik's comment: 1. Updated to log in

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105215#comment-14105215 ] Tsuyoshi OZAWA commented on YARN-1326: -- demo.png shows how the Web UI changes with the

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-21 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105276#comment-14105276 ] Rohith commented on YARN-1879: -- Hi, Any update on this issue? Mark Idempotent/AtMostOnce

[jira] [Commented] (YARN-2422) yarn.scheduler.maximum-allocation-mb should not be hard-coded in yarn-default.xml

2014-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105285#comment-14105285 ] Varun Vasudev commented on YARN-2422: - I agree with [~sandyr] on deriving the value.

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105292#comment-14105292 ] Tsuyoshi OZAWA commented on YARN-1879: -- Thank you for pinging, [~rohithsharma]. I'm

[jira] [Commented] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105306#comment-14105306 ] Hadoop QA commented on YARN-2315: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105319#comment-14105319 ] Hadoop QA commented on YARN-2424: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
Amir Mal created YARN-2435: -- Summary: Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users Key: YARN-2435 URL: https://issues.apache.org/jira/browse/YARN-2435 Project:

[jira] [Commented] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105332#comment-14105332 ] Amir Mal commented on YARN-2435: h2. my test cluster configuration files: h3.

[jira] [Updated] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Mal updated YARN-2435: --- Environment: Red Hat Enterprise Linux Server release 6.4 (Santiago); Linux 2.6.32-358.el6.x86_64 GNU/Linux;

[jira] [Updated] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Mal updated YARN-2435: --- Environment: Red Hat Enterprise Linux Server release 6.4 (Santiago); Linux 2.6.32-358.el6.x86_64 GNU/Linux;

[jira] [Updated] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amir Mal updated YARN-2435: --- Description: A user without ADMINISTER_QUEUE privilege can kill application from all queues. to replicate

[jira] [Commented] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105337#comment-14105337 ] Amir Mal commented on YARN-2435: from the resourcemanager log file: {quote} 2014-08-21

[jira] [Created] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2436: -- Summary: [post-HADOOP-9902] yarn application help doesn't work Key: YARN-2436 URL: https://issues.apache.org/jira/browse/YARN-2436 Project: Hadoop YARN

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105354#comment-14105354 ] Allen Wittenauer commented on YARN-2436: Specifically from the old code: {code}

[jira] [Created] (YARN-2437) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

2014-08-21 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2437: -- Summary: [post-HADOOP-9902] yarn-daemons.sh needs to give starting info Key: YARN-2437 URL: https://issues.apache.org/jira/browse/YARN-2437 Project: Hadoop YARN

[jira] [Commented] (YARN-1801) NPE in public localizer

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105372#comment-14105372 ] Jason Lowe commented on YARN-1801: -- bq. Even if the assoc is null, should we close the

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105387#comment-14105387 ] Hadoop QA commented on YARN-2434: - {color:red}-1 overall{color}. Here are the results of

Container not killed even on SUCEEDED status

2014-08-21 Thread Kuldeep Bora
Hello, I have a job with no reducers and 20 mappers, out of which 14 get scheduled at a time. But strangely even if mappers reach a SUCEEDED status the container running them is not killed. Due to which the next set of mappers never get scheduled. I admit that there may be threads running in the

[jira] [Updated] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2436: --- Labels: newbie (was: ) [post-HADOOP-9902] yarn application help doesn't work

[jira] [Updated] (YARN-2437) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2437: --- Labels: newbie (was: ) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105423#comment-14105423 ] Allen Wittenauer commented on YARN-2424: Release audit warnings have nothign to do

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2424: --- Assignee: Chris Douglas LCE should support non-cgroups, non-secure mode

[jira] [Commented] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105462#comment-14105462 ] Varun Vasudev commented on YARN-2435: - [~MeMir] I think you're missing a setting in

[jira] [Updated] (YARN-2428) LCE default banned user list should have yarn

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2428: --- Component/s: nodemanager LCE default banned user list should have yarn

[jira] [Updated] (YARN-2428) LCE default banned user list should have yarn

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2428: --- Labels: newbie (was: ) LCE default banned user list should have yarn

[jira] [Updated] (YARN-2428) LCE default banned user list should have yarn

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2428: --- Priority: Trivial (was: Major) LCE default banned user list should have yarn

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105503#comment-14105503 ] Eric Payne commented on YARN-415: - Thanks, [~kkambatl] {quote} IIUC, we are tracking the

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105525#comment-14105525 ] Eric Payne commented on YARN-2056: -- Thanks, [~leftnoteasy] {quote} May a another way to do

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1410#comment-1410 ] Hudson commented on YARN-2424: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See

[jira] [Commented] (YARN-2174) Enabling HTTPs for the writer REST API of TimelineServer

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105562#comment-14105562 ] Hudson commented on YARN-2174: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105560#comment-14105560 ] Hudson commented on YARN-1919: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See

[jira] [Commented] (YARN-2034) Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105563#comment-14105563 ] Hudson commented on YARN-2034: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See

[jira] [Commented] (YARN-415) Capture memory allocation at the app-level for chargeback

2014-08-21 Thread Kendall Thrapp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105569#comment-14105569 ] Kendall Thrapp commented on YARN-415: - Updated the JIRA title to say allocation instead

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2424: Assignee: Allen Wittenauer (was: Chris Douglas) LCE should support non-cgroups, non-secure mode

[jira] [Commented] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105649#comment-14105649 ] Amir Mal commented on YARN-2435: Thank you Varun, You're right I missed the yarn.admin.acl

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-21 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: YARN-2408-2.patch New patch, includes some tests and includes new code which makes

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105686#comment-14105686 ] Eric Payne commented on YARN-2056: -- [~leftnoteasy]], actually, since

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105712#comment-14105712 ] Karthik Kambatla commented on YARN-1326: Do we need to add a field name to the

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105766#comment-14105766 ] Hadoop QA commented on YARN-160: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105777#comment-14105777 ] Hudson commented on YARN-2424: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105774#comment-14105774 ] Hudson commented on YARN-2424: -- FAILURE: Integrated in Hadoop-trunk-Commit #6092 (See

[jira] [Commented] (YARN-2034) Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105785#comment-14105785 ] Hudson commented on YARN-2034: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See

[jira] [Commented] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105772#comment-14105772 ] zhihai xu commented on YARN-2315: - The test error is java.net.BindException: Address

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105782#comment-14105782 ] Hudson commented on YARN-1919: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See

[jira] [Commented] (YARN-2174) Enabling HTTPs for the writer REST API of TimelineServer

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105784#comment-14105784 ] Hudson commented on YARN-2174: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-21 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: (was: YARN-2408.patch) Resource Request REST API for YARN

[jira] [Updated] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-611: --- Attachment: YARN-611.5.patch Add an AM retry count reset window to YARN RM

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105827#comment-14105827 ] Xuan Gong commented on YARN-611: bq. the policies should be YARN services if they are

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105828#comment-14105828 ] Xuan Gong commented on YARN-611: this patch addresses other comments from Steve Add an AM

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105845#comment-14105845 ] Hudson commented on YARN-2424: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1870 (See

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105850#comment-14105850 ] Hudson commented on YARN-1919: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1870 (See

[jira] [Updated] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2035: -- Attachment: YARN-2035-v2.patch FileSystemApplicationHistoryStore blocks RM and AHS while NN is

[jira] [Commented] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105859#comment-14105859 ] Jonathan Eagles commented on YARN-2035: --- [~zjshen], added the tests you suggested by

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

2014-08-21 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105863#comment-14105863 ] Abin Shahab commented on YARN-18: - [~djp], and [~gujilangzi], I tried patching this on trunk

[jira] [Commented] (YARN-728) Yarn and MR default classpath are wrong on Windows

2014-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105882#comment-14105882 ] Steve Loughran commented on YARN-728: - marking as a duplicate of the (fixed) YARN-1138

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2393: --- Attachment: yarn-2393-4.patch The latest patch looks mostly good. Uploading a new patch that

[jira] [Commented] (YARN-1554) add an env variable for the YARN AM classpath

2014-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105885#comment-14105885 ] Steve Loughran commented on YARN-1554: -- ..it's a proposed solution to YARN-973 : that

[jira] [Updated] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2436: --- Attachment: YARN-2436.patch Simple one line fix. [post-HADOOP-9902] yarn application help

[jira] [Assigned] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned YARN-2436: -- Assignee: Allen Wittenauer [post-HADOOP-9902] yarn application help doesn't work

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105903#comment-14105903 ] Wei Yan commented on YARN-2393: --- Thanks, karthik. The javadoc looks good to me. Fair

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105910#comment-14105910 ] Karthik Kambatla commented on YARN-2393: Cool. +1, pending Jenkins. Fair

[jira] [Commented] (YARN-2395) Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105914#comment-14105914 ] Karthik Kambatla commented on YARN-2395: bq. I removed the old

[jira] [Updated] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li updated YARN-2421: --- Attachment: yarn2421.patch CapacityScheduler still allocates containers to an app in the FINISHING state

[jira] [Updated] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2395: --- Summary: FairScheduler: Preemption timeout should be configurable per queue (was: Fair

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105927#comment-14105927 ] Chen He commented on YARN-2421: --- [~lichangleo], is this +System.out.println(xxx inside

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.3.patch Thanks for your review, Karthik. I confirmed that we can do it

[jira] [Updated] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li updated YARN-2421: --- Attachment: yarn2421.patch updated patch CapacityScheduler still allocates containers to an app in the

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105936#comment-14105936 ] chang li commented on YARN-2421: [~airbots], Have removed that, thanks for finding that out

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

2014-08-21 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105986#comment-14105986 ] Abin Shahab commented on YARN-18: - Ok it merged fine to trunk. I am having issues merging to

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105988#comment-14105988 ] Ravi Prakash commented on YARN-2436: Patch lgtm. +1. Tested $ yarn application help;

[jira] [Created] (YARN-2438) YARN_PROXYSERVER_* isn't documented in yarn-env.sh

2014-08-21 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2438: -- Summary: YARN_PROXYSERVER_* isn't documented in yarn-env.sh Key: YARN-2438 URL: https://issues.apache.org/jira/browse/YARN-2438 Project: Hadoop YARN

[jira] [Updated] (YARN-2438) YARN_PROXYSERVER_* isn't documented in yarn-env.sh

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2438: --- Labels: newbie (was: ) YARN_PROXYSERVER_* isn't documented in yarn-env.sh

[jira] [Updated] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-2431: - Attachment: YARN-2431.patch Patch to ensure we call postExecute on the LCEResourcesHandler after a

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106062#comment-14106062 ] Carlo Curino commented on YARN-1707: Minor fixes Making the CapacityScheduler more

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106083#comment-14106083 ] Jian He commented on YARN-2434: --- Thanks Jason for reviewing and committing ! RM should not

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106089#comment-14106089 ] Hadoop QA commented on YARN-1492: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-21 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106104#comment-14106104 ] Nathan Roberts commented on YARN-2431: -- +1 lgtm, non-binding NM restart: cgroup is

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-08-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106111#comment-14106111 ] Chris Trezzo commented on YARN-1492: Working to address the various warnings. truly

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106143#comment-14106143 ] Jian He commented on YARN-415: -- bq. TestContainerResourceUsage Ah, sorry, I missed this newly

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106198#comment-14106198 ] Hudson commented on YARN-2436: -- FAILURE: Integrated in Hadoop-trunk-Commit #6093 (See

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106259#comment-14106259 ] Hadoop QA commented on YARN-2408: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

2014-08-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106279#comment-14106279 ] Junping Du commented on YARN-18: Thanks [~gujilangzi] and [~ashahab] for the effort! Last

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106296#comment-14106296 ] Hadoop QA commented on YARN-415: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1801) NPE in public localizer

2014-08-21 Thread Beckham007 (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106306#comment-14106306 ] Beckham007 commented on YARN-1801: -- Agree with [~jlowe] NPE in public localizer

[jira] [Commented] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106310#comment-14106310 ] Jonathan Eagles commented on YARN-2035: --- Ignore the last patch as it has bugs.

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106339#comment-14106339 ] Hadoop QA commented on YARN-1707: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106345#comment-14106345 ] Hadoop QA commented on YARN-2431: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106374#comment-14106374 ] Hadoop QA commented on YARN-1326: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2385) Consider splitting getAppsinQueue to getRunningAppsInQueue + getPendingAppsInQueue

2014-08-21 Thread Subramaniam Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Krishnan updated YARN-2385: --- Summary: Consider splitting getAppsinQueue to getRunningAppsInQueue +

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106384#comment-14106384 ] Hadoop QA commented on YARN-2421: - {color:red}-1 overall{color}. Here are the results of

  1   2   >