[jira] [Commented] (YARN-1801) NPE in public localizer

2014-08-21 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106555#comment-14106555 ] Hong Zhiguo commented on YARN-1801: --- I think YARN-1575 already fixed this NPE. We could m

[jira] [Updated] (YARN-2437) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2437: --- Description: With the merger and cleanup of the daemon launch code, yarn-daemons.sh no longer

[jira] [Updated] (YARN-2437) [post-HADOOP-9902] start-yarn.sh/stop-yarn needs to give info

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2437: --- Summary: [post-HADOOP-9902] start-yarn.sh/stop-yarn needs to give info (was: [post-HADOOP-990

[jira] [Commented] (YARN-2437) [post-HADOOP-9902] start-yarn.sh/stop-yarn needs to give info

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106430#comment-14106430 ] Allen Wittenauer commented on YARN-2437: Yeah. Updated the JIRA to reflect that. :

[jira] [Updated] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li updated YARN-2421: --- Attachment: yarn2421.patch updated patch with apache license header > CapacityScheduler still allocates conta

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2014-08-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106406#comment-14106406 ] Junping Du commented on YARN-160: - Thanks for addressing my comments, [~vvasudev]! {code} +

[jira] [Updated] (YARN-2385) Consider splitting getAppsinQueue to getRunningAppsInQueue + getPendingAppsInQueue

2014-08-21 Thread Subramaniam Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Krishnan updated YARN-2385: --- Description: Currently getAppsinQueue returns both pending & running apps. The purpose

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106398#comment-14106398 ] Wei Yan commented on YARN-2393: --- For the maxAMResource, the patch still uses the dynamic one.

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106396#comment-14106396 ] Ashwin Shankar commented on YARN-2393: -- Thanks Wei, patch looks good ! What did you gu

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106384#comment-14106384 ] Hadoop QA commented on YARN-2421: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106385#comment-14106385 ] Wei Yan commented on YARN-2393: --- the release audit warnings are not related this jira. > Fai

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106382#comment-14106382 ] Hadoop QA commented on YARN-2393: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2385) Consider splitting getAppsinQueue to getRunningAppsInQueue + getPendingAppsInQueue

2014-08-21 Thread Subramaniam Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subramaniam Krishnan updated YARN-2385: --- Summary: Consider splitting getAppsinQueue to getRunningAppsInQueue + getPendingAppsIn

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106374#comment-14106374 ] Hadoop QA commented on YARN-1326: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106348#comment-14106348 ] Hadoop QA commented on YARN-1492: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106345#comment-14106345 ] Hadoop QA commented on YARN-2431: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106339#comment-14106339 ] Hadoop QA commented on YARN-1707: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1707: --- Attachment: YARN-1707.3.patch > Making the CapacityScheduler more dynamic > --

[jira] [Commented] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106310#comment-14106310 ] Jonathan Eagles commented on YARN-2035: --- Ignore the last patch as it has bugs. > Fil

[jira] [Commented] (YARN-1801) NPE in public localizer

2014-08-21 Thread Beckham007 (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106306#comment-14106306 ] Beckham007 commented on YARN-1801: -- Agree with [~jlowe] > NPE in public localizer > -

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106296#comment-14106296 ] Hadoop QA commented on YARN-415: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

2014-08-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106279#comment-14106279 ] Junping Du commented on YARN-18: Thanks [~gujilangzi] and [~ashahab] for the effort! Last tim

[jira] [Commented] (YARN-2437) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

2014-08-21 Thread Hao Gao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106269#comment-14106269 ] Hao Gao commented on YARN-2437: --- Should the information be printed in start-yarn.sh and stop-

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106259#comment-14106259 ] Hadoop QA commented on YARN-2408: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106219#comment-14106219 ] Wangda Tan commented on YARN-2056: -- Hi [~eepayne], I think you're right, we can skip the

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106198#comment-14106198 ] Hudson commented on YARN-2436: -- FAILURE: Integrated in Hadoop-trunk-Commit #6093 (See [https:

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106196#comment-14106196 ] Hudson commented on YARN-2434: -- FAILURE: Integrated in Hadoop-trunk-Commit #6093 (See [https:

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106143#comment-14106143 ] Jian He commented on YARN-415: -- bq. TestContainerResourceUsage Ah, sorry, I missed this newly a

[jira] [Commented] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2014-08-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106125#comment-14106125 ] Zhijie Shen commented on YARN-2032: --- Filed HADOOP-10995 and uploaded a patch, which shoul

[jira] [Updated] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-415: Attachment: YARN-415.201408212033.txt [~kkambatl], Thanks for your help in reviewing this. {quote} A more mi

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-08-21 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106111#comment-14106111 ] Chris Trezzo commented on YARN-1492: Working to address the various warnings. > truly

[jira] [Commented] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-21 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106104#comment-14106104 ] Nathan Roberts commented on YARN-2431: -- +1 lgtm, non-binding > NM restart: cgroup is

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106089#comment-14106089 ] Hadoop QA commented on YARN-1492: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106083#comment-14106083 ] Jian He commented on YARN-2434: --- Thanks Jason for reviewing and committing ! > RM should not

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106081#comment-14106081 ] Jian He commented on YARN-415: -- Eric, thanks for your effort on this issue! we may need a tes

[jira] [Updated] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1707: --- Attachment: (was: YARN-1707.3.patch) > Making the CapacityScheduler more dynamic > ---

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106062#comment-14106062 ] Carlo Curino commented on YARN-1707: Minor fixes > Making the CapacityScheduler more

[jira] [Updated] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1707: --- Attachment: YARN-1707.3.patch > Making the CapacityScheduler more dynamic > --

[jira] [Updated] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-2431: - Attachment: YARN-2431.patch Patch to ensure we call postExecute on the LCEResourcesHandler after a reacqu

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14106053#comment-14106053 ] Jason Lowe commented on YARN-2434: -- Release audit warnings are unrelated, see HDFS-6905.

[jira] [Updated] (YARN-2438) YARN_PROXYSERVER_* isn't documented in yarn-env.sh

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2438: --- Labels: newbie (was: ) > YARN_PROXYSERVER_* isn't documented in yarn-env.sh > ---

[jira] [Created] (YARN-2438) YARN_PROXYSERVER_* isn't documented in yarn-env.sh

2014-08-21 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2438: -- Summary: YARN_PROXYSERVER_* isn't documented in yarn-env.sh Key: YARN-2438 URL: https://issues.apache.org/jira/browse/YARN-2438 Project: Hadoop YARN Issu

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105988#comment-14105988 ] Ravi Prakash commented on YARN-2436: Patch lgtm. +1. Tested $ yarn application help;

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

2014-08-21 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105986#comment-14105986 ] Abin Shahab commented on YARN-18: - Ok it merged fine to trunk. I am having issues merging to

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105936#comment-14105936 ] chang li commented on YARN-2421: [~airbots], Have removed that, thanks for finding that out

[jira] [Updated] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li updated YARN-2421: --- Attachment: yarn2421.patch updated patch > CapacityScheduler still allocates containers to an app in the FINI

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.3.patch Thanks for your review, Karthik. I confirmed that we can do it witho

[jira] [Commented] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105927#comment-14105927 ] Chen He commented on YARN-2421: --- [~lichangleo], is this "+System.out.println("xxx inside

[jira] [Updated] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2395: --- Summary: FairScheduler: Preemption timeout should be configurable per queue (was: Fair Schedu

[jira] [Updated] (YARN-2421) CapacityScheduler still allocates containers to an app in the FINISHING state

2014-08-21 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li updated YARN-2421: --- Attachment: yarn2421.patch > CapacityScheduler still allocates containers to an app in the FINISHING state > -

[jira] [Commented] (YARN-2395) Fair Scheduler : implement fair share preemption at parent queue based on fairSharePreemptionTimeout

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105914#comment-14105914 ] Karthik Kambatla commented on YARN-2395: bq. I removed the old "defaultFairSharePre

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105910#comment-14105910 ] Karthik Kambatla commented on YARN-2393: Cool. +1, pending Jenkins. > Fair Sched

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105903#comment-14105903 ] Wei Yan commented on YARN-2393: --- Thanks, karthik. The javadoc looks good to me. > Fair Sched

[jira] [Assigned] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned YARN-2436: -- Assignee: Allen Wittenauer > [post-HADOOP-9902] yarn application help doesn't work > ---

[jira] [Updated] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2436: --- Attachment: YARN-2436.patch Simple one line fix. > [post-HADOOP-9902] yarn application help d

[jira] [Commented] (YARN-1554) add an env variable for the YARN AM classpath

2014-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105885#comment-14105885 ] Steve Loughran commented on YARN-1554: -- ..it's a proposed solution to YARN-973 : that

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement steady fair share

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2393: --- Attachment: yarn-2393-4.patch The latest patch looks mostly good. Uploading a new patch that i

[jira] [Commented] (YARN-728) Yarn and MR default classpath are wrong on Windows

2014-08-21 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105882#comment-14105882 ] Steve Loughran commented on YARN-728: - marking as a duplicate of the (fixed) YARN-1138

[jira] [Commented] (YARN-18) Configurable Hierarchical Topology for YARN

2014-08-21 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105863#comment-14105863 ] Abin Shahab commented on YARN-18: - [~djp], and [~gujilangzi], I tried patching this on trunk

[jira] [Commented] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105859#comment-14105859 ] Jonathan Eagles commented on YARN-2035: --- [~zjshen], added the tests you suggested by

[jira] [Updated] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2035: -- Attachment: YARN-2035-v2.patch > FileSystemApplicationHistoryStore blocks RM and AHS while NN is

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105850#comment-14105850 ] Hudson commented on YARN-1919: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1870 (See [htt

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105845#comment-14105845 ] Hudson commented on YARN-2424: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1870 (See [htt

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105828#comment-14105828 ] Xuan Gong commented on YARN-611: this patch addresses other comments from Steve > Add an AM

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105827#comment-14105827 ] Xuan Gong commented on YARN-611: bq. the policies should be YARN services if they are starti

[jira] [Updated] (YARN-611) Add an AM retry count reset window to YARN RM

2014-08-21 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-611: --- Attachment: YARN-611.5.patch > Add an AM retry count reset window to YARN RM >

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-21 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: (was: YARN-2408.patch) > Resource Request REST API for YARN >

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105782#comment-14105782 ] Hudson commented on YARN-1919: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See [https://

[jira] [Commented] (YARN-2174) Enabling HTTPs for the writer REST API of TimelineServer

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105784#comment-14105784 ] Hudson commented on YARN-2174: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See [https://

[jira] [Commented] (YARN-2034) Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105785#comment-14105785 ] Hudson commented on YARN-2034: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See [https://

[jira] [Commented] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105772#comment-14105772 ] zhihai xu commented on YARN-2315: - The test error is "java.net.BindException: Address alrea

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105774#comment-14105774 ] Hudson commented on YARN-2424: -- FAILURE: Integrated in Hadoop-trunk-Commit #6092 (See [https:

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105777#comment-14105777 ] Hudson commented on YARN-2424: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1844 (See [https://

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105766#comment-14105766 ] Hadoop QA commented on YARN-160: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105712#comment-14105712 ] Karthik Kambatla commented on YARN-1326: Do we need to add a field "name" to the st

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105686#comment-14105686 ] Eric Payne commented on YARN-2056: -- [~leftnoteasy]], actually, since {{ProportionalCapaci

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-21 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: YARN-2408-2.patch New patch, includes some tests and includes new code which makes the

[jira] [Commented] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Amir Mal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105649#comment-14105649 ] Amir Mal commented on YARN-2435: Thank you Varun, You're right I missed the yarn.admin.acl

[jira] [Updated] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-415: -- Summary: Capture aggregate memory allocation at the app-level for chargeback (was: Capture memor

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2424: Assignee: Allen Wittenauer (was: Chris Douglas) > LCE should support non-cgroups, non-secure mode >

[jira] [Updated] (YARN-415) Capture memory allocation at the app-level for chargeback

2014-08-21 Thread Kendall Thrapp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kendall Thrapp updated YARN-415: Summary: Capture memory allocation at the app-level for chargeback (was: Capture memory utilization

[jira] [Commented] (YARN-415) Capture memory allocation at the app-level for chargeback

2014-08-21 Thread Kendall Thrapp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105569#comment-14105569 ] Kendall Thrapp commented on YARN-415: - Updated the JIRA title to say allocation instead

[jira] [Commented] (YARN-2034) Description for yarn.nodemanager.localizer.cache.target-size-mb is incorrect

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105563#comment-14105563 ] Hudson commented on YARN-2034: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See [https://b

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105560#comment-14105560 ] Hudson commented on YARN-1919: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See [https://b

[jira] [Commented] (YARN-2174) Enabling HTTPs for the writer REST API of TimelineServer

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105562#comment-14105562 ] Hudson commented on YARN-2174: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See [https://b

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1410#comment-1410 ] Hudson commented on YARN-2424: -- FAILURE: Integrated in Hadoop-Yarn-trunk #653 (See [https://b

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105525#comment-14105525 ] Eric Payne commented on YARN-2056: -- Thanks, [~leftnoteasy] {quote} May a another way to do

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105503#comment-14105503 ] Eric Payne commented on YARN-415: - Thanks, [~kkambatl] {quote} IIUC, we are tracking the all

[jira] [Updated] (YARN-2428) LCE default banned user list should have yarn

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2428: --- Priority: Trivial (was: Major) > LCE default banned user list should have yarn >

[jira] [Updated] (YARN-2428) LCE default banned user list should have yarn

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2428: --- Component/s: nodemanager > LCE default banned user list should have yarn > ---

[jira] [Updated] (YARN-2428) LCE default banned user list should have yarn

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2428: --- Labels: newbie (was: ) > LCE default banned user list should have yarn >

[jira] [Commented] (YARN-2435) Capacity scheduler should only allow Kill Application Requests from ADMINISTER_QUEUE users

2014-08-21 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105462#comment-14105462 ] Varun Vasudev commented on YARN-2435: - [~MeMir] I think you're missing a setting in you

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2424: --- Assignee: Chris Douglas > LCE should support non-cgroups, non-secure mode > --

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105423#comment-14105423 ] Allen Wittenauer commented on YARN-2424: Release audit warnings have nothign to do

[jira] [Updated] (YARN-2437) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2437: --- Labels: newbie (was: ) > [post-HADOOP-9902] yarn-daemons.sh needs to give starting info > ---

[jira] [Updated] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-21 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2436: --- Labels: newbie (was: ) > [post-HADOOP-9902] yarn application help doesn't work >

Container not killed even on SUCEEDED status

2014-08-21 Thread Kuldeep Bora
Hello, I have a job with no reducers and 20 mappers, out of which 14 get scheduled at a time. But strangely even if mappers reach a SUCEEDED status the container running them is not killed. Due to which the next set of mappers never get scheduled. I admit that there may be threads running in the j

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105387#comment-14105387 ] Hadoop QA commented on YARN-2434: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1801) NPE in public localizer

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105372#comment-14105372 ] Jason Lowe commented on YARN-1801: -- bq. Even if the assoc is null, should we close the thr

[jira] [Created] (YARN-2437) [post-HADOOP-9902] yarn-daemons.sh needs to give starting info

2014-08-21 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2437: -- Summary: [post-HADOOP-9902] yarn-daemons.sh needs to give starting info Key: YARN-2437 URL: https://issues.apache.org/jira/browse/YARN-2437 Project: Hadoop YARN

  1   2   >