[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093781#comment-14093781 ] Hadoop QA commented on YARN-2408: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2408: -- Priority: Major (was: Minor) Resource Request REST API for YARN --

[jira] [Assigned] (YARN-2407) Users are not allowed to view their own jobs, denied by JobACLsManager

2014-08-12 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K reassigned YARN-2407: --- Assignee: Yu Gao Users are not allowed to view their own jobs, denied by JobACLsManager

[jira] [Created] (YARN-2409) InvalidStateTransitonException in ResourceManager after job recovery

2014-08-12 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2409: --- Summary: InvalidStateTransitonException in ResourceManager after job recovery Key: YARN-2409 URL: https://issues.apache.org/jira/browse/YARN-2409 Project: Hadoop YARN

[jira] [Commented] (YARN-1337) Recover containers upon nodemanager restart

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094003#comment-14094003 ] Hudson commented on YARN-1337: -- FAILURE: Integrated in Hadoop-trunk-Commit #6050 (See

[jira] [Commented] (YARN-1337) Recover containers upon nodemanager restart

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094018#comment-14094018 ] Hudson commented on YARN-1337: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #643 (See

[jira] [Commented] (YARN-2400) TestAMRestart fails intermittently

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094015#comment-14094015 ] Hudson commented on YARN-2400: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #643 (See

[jira] [Commented] (YARN-2138) Cleanup notifyDone* methods in RMStateStore

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094019#comment-14094019 ] Hudson commented on YARN-2138: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #643 (See

[jira] [Updated] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-659: Attachment: YARN-659.5.patch Rebased on trunk. RMStateStore's removeApplication APIs should just

[jira] [Commented] (YARN-2409) InvalidStateTransitonException in ResourceManager after job recovery

2014-08-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094073#comment-14094073 ] Eric Payne commented on YARN-2409: -- [~nishan], Is the application timeline service (ATS)

[jira] [Resolved] (YARN-1352) Recover LogAggregationService upon nodemanager restart

2014-08-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-1352. -- Resolution: Duplicate Resolving as log aggregation should be covered by the combination of recovering

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094178#comment-14094178 ] chang li commented on YARN-2308: [~wangda] I don't think this conf set should be necessary

[jira] [Commented] (YARN-1337) Recover containers upon nodemanager restart

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094199#comment-14094199 ] Hudson commented on YARN-1337: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1861 (See

[jira] [Commented] (YARN-2400) TestAMRestart fails intermittently

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094196#comment-14094196 ] Hudson commented on YARN-2400: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1861 (See

[jira] [Commented] (YARN-2138) Cleanup notifyDone* methods in RMStateStore

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094200#comment-14094200 ] Hudson commented on YARN-2138: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1861 (See

[jira] [Created] (YARN-2410) Nodemanager ShuffleHandler can easily exhaust file descriptors

2014-08-12 Thread Nathan Roberts (JIRA)
Nathan Roberts created YARN-2410: Summary: Nodemanager ShuffleHandler can easily exhaust file descriptors Key: YARN-2410 URL: https://issues.apache.org/jira/browse/YARN-2410 Project: Hadoop YARN

[jira] [Commented] (YARN-2400) TestAMRestart fails intermittently

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094212#comment-14094212 ] Hudson commented on YARN-2400: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1835 (See

[jira] [Commented] (YARN-2138) Cleanup notifyDone* methods in RMStateStore

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094216#comment-14094216 ] Hudson commented on YARN-2138: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1835 (See

[jira] [Commented] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094228#comment-14094228 ] Hadoop QA commented on YARN-659: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-12 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2393: -- Attachment: YARN-2393-2.patch Update a patch which address Ashwin's comment: recompute share when new queue

[jira] [Commented] (YARN-2393) Fair Scheduler : Implement static fair share

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094327#comment-14094327 ] Hadoop QA commented on YARN-2393: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2373) WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094371#comment-14094371 ] Jian He commented on YARN-2373: --- Larry, thanks for updating the patch ! LGTM, +1

[jira] [Updated] (YARN-2373) WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2373: -- Assignee: Larry McCay WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords

[jira] [Updated] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2399: --- Attachment: yarn-2399-3.patch Updated the patch to address Sandy's comments. As part of

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.2.patch Patch for most items in this jira not covered in subtasks, including

[jira] [Commented] (YARN-2411) [Capacity Scheduler] support simple user and group mappings to queues

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094402#comment-14094402 ] Allen Wittenauer commented on YARN-2411: It took me a minute to understand what is

[jira] [Commented] (YARN-2373) WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords

2014-08-12 Thread Larry McCay (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094405#comment-14094405 ] Larry McCay commented on YARN-2373: --- Thank you for the very good reviews, [~jianhe]! Can

[jira] [Updated] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2014-08-12 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2032: Attachment: YARN-2032-branch2-2.patch Attching update patch for branch 2 Thanks, Mayank

[jira] [Updated] (YARN-2411) [Capacity Scheduler] support simple user and group mappings to queues

2014-08-12 Thread Ram Venkatesh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram Venkatesh updated YARN-2411: Description: YARN-2257 has a proposal to extend and share the queue placement rules for the fair

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094467#comment-14094467 ] Karthik Kambatla commented on YARN-415: --- Recently, I have been thinking about related

[jira] [Updated] (YARN-2317) Update documentation about how to write YARN applications

2014-08-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2317: Attachment: YARN-2317-081214.patch New patch addressed [~zjshen]'s further comments. Reformatted the FAQ section

[jira] [Commented] (YARN-2411) [Capacity Scheduler] support simple user and group mappings to queues

2014-08-12 Thread Ram Venkatesh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094446#comment-14094446 ] Ram Venkatesh commented on YARN-2411: - Correct - this feature is to map from the

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094495#comment-14094495 ] Hadoop QA commented on YARN-2399: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2373) WebAppUtils Should Use configuration.getPassword for Accessing SSL Passwords

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094512#comment-14094512 ] Hudson commented on YARN-2373: -- FAILURE: Integrated in Hadoop-trunk-Commit #6052 (See

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094568#comment-14094568 ] Hadoop QA commented on YARN-1198: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094598#comment-14094598 ] Sandy Ryza commented on YARN-2399: -- +1 FairScheduler: Merge AppSchedulable and

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.3.patch Update broken test to reflect intentional change in behavior Capacity

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094669#comment-14094669 ] Jian He commented on YARN-415: -- Karthik, sure, thanks for reviewing the patch. Capture memory

[jira] [Commented] (YARN-2317) Update documentation about how to write YARN applications

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094674#comment-14094674 ] Hadoop QA commented on YARN-2317: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094694#comment-14094694 ] Hadoop QA commented on YARN-2032: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2317) Update documentation about how to write YARN applications

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094712#comment-14094712 ] Zhijie Shen commented on YARN-2317: --- +1 for the latest patch. I'll commit it. Update

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094750#comment-14094750 ] Hadoop QA commented on YARN-1198: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-925) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094763#comment-14094763 ] Karthik Kambatla commented on YARN-925: --- Folks, I just realized a part of this went

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-08-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2277: -- Attachment: YARN-2277-v7.patch Add Cross-Origin support to the ATS REST API

[jira] [Commented] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-08-12 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094772#comment-14094772 ] Jonathan Eagles commented on YARN-2277: --- [~zjshen], addressed you issues. As for

[jira] [Commented] (YARN-2317) Update documentation about how to write YARN applications

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094786#comment-14094786 ] Hudson commented on YARN-2317: -- FAILURE: Integrated in Hadoop-trunk-Commit #6053 (See

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094784#comment-14094784 ] Hudson commented on YARN-2399: -- FAILURE: Integrated in Hadoop-trunk-Commit #6053 (See

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094788#comment-14094788 ] Arpit Agarwal commented on YARN-2399: - Hi, looks like this was committed and it broke

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094815#comment-14094815 ] Karthik Kambatla commented on YARN-2399: Sorry about that. Looking into it. I did a

[jira] [Commented] (YARN-925) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094825#comment-14094825 ] Zhijie Shen commented on YARN-925: -- bq. Folks, I just realized a part of this went into

[jira] [Created] (YARN-2412) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

2014-08-12 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2412: - Summary: Augment HistoryStorage Reader Interface to Support Filters When Getting Applications Key: YARN-2412 URL: https://issues.apache.org/jira/browse/YARN-2412 Project:

[jira] [Commented] (YARN-2412) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094840#comment-14094840 ] Zhijie Shen commented on YARN-2412: --- Per discussion on YARN-925, let's continue the

[jira] [Updated] (YARN-2412) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2412: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 Augment HistoryStorage Reader Interface to

[jira] [Updated] (YARN-925) HistoryStorage Reader Interface for Application History Server

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-925: - Assignee: Mayank Bansal (was: Shinichi Yamashita) Summary: HistoryStorage Reader Interface for

[jira] [Updated] (YARN-2412) Augment HistoryStorage Reader Interface to Support Filters When Getting Applications

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2412: -- Description:

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094845#comment-14094845 ] Karthik Kambatla commented on YARN-2399: Thanks for catching this, Arpit. Just

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094859#comment-14094859 ] Hudson commented on YARN-2399: -- FAILURE: Integrated in Hadoop-trunk-Commit #6054 (See

[jira] [Commented] (YARN-2399) FairScheduler: Merge AppSchedulable and FSSchedulerApp into FSAppAttempt

2014-08-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094864#comment-14094864 ] Arpit Agarwal commented on YARN-2399: - Thanks Karthik! Verified the build break is

[jira] [Created] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-2413: -- Summary: capacity scheduler will overallocate vcores Key: YARN-2413 URL: https://issues.apache.org/jira/browse/YARN-2413 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2413: --- Description: It doesn't appear that the capacity scheduler is properly allocating vcores when

[jira] [Commented] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094873#comment-14094873 ] Allen Wittenauer commented on YARN-2413: I might have missed something, but there

[jira] [Commented] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094882#comment-14094882 ] Tsuyoshi OZAWA commented on YARN-659: - The test failure is not related to this patch,

[jira] [Commented] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094885#comment-14094885 ] Sandy Ryza commented on YARN-2413: -- The capacity scheduler truncates all vcore requests to

[jira] [Commented] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094891#comment-14094891 ] Hadoop QA commented on YARN-2277: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094897#comment-14094897 ] Allen Wittenauer commented on YARN-2413: What we're seeing with the default

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094900#comment-14094900 ] Zhijie Shen commented on YARN-2414: --- The following code makes in AppBlock makes the

[jira] [Commented] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094899#comment-14094899 ] Sandy Ryza commented on YARN-2413: -- I believe this is the expected behavior (i.e. Capacity

[jira] [Updated] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2414: -- Component/s: webapp RM web UI: app page will crash if app is failed before any attempt has been

[jira] [Created] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2414: - Summary: RM web UI: app page will crash if app is failed before any attempt has been created Key: YARN-2414 URL: https://issues.apache.org/jira/browse/YARN-2414 Project:

[jira] [Commented] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094903#comment-14094903 ] Sandy Ryza commented on YARN-2413: -- I don't have an opinion on whether we should keep this

[jira] [Updated] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1198: -- Attachment: YARN-1198.4.patch redo-patch against current trunk, trigger rebuild b/c something went

[jira] [Comment Edited] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094922#comment-14094922 ] Allen Wittenauer edited comment on YARN-2413 at 8/12/14 11:59 PM:

[jira] [Commented] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094922#comment-14094922 ] Allen Wittenauer commented on YARN-2413: From an operations perspective, this is

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094924#comment-14094924 ] Zhijie Shen commented on YARN-2308: --- Investigated into the problem: when submitting the

[jira] [Updated] (YARN-2413) capacity scheduler will overallocate vcores

2014-08-12 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-2413: --- Component/s: documentation capacity scheduler will overallocate vcores

[jira] [Resolved] (YARN-1585) Provide a way to format the RMStateStore

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1585. Resolution: Duplicate Target Version/s: (was: ) Provide a way to format the

[jira] [Commented] (YARN-1370) Fair scheduler to re-populate container allocation state

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094950#comment-14094950 ] Karthik Kambatla commented on YARN-1370: TestAMRestart passes for me locally. +1.

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094957#comment-14094957 ] Tsuyoshi OZAWA commented on YARN-2229: -- Thanks for your review, Jian. OK, it sounds

[jira] [Commented] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094958#comment-14094958 ] Tsuyoshi OZAWA commented on YARN-659: - [~jianhe] [~kkambatl] could you take a look,

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094997#comment-14094997 ] Craig Welch commented on YARN-1198: --- So, looking at this a bit more holistically - it

[jira] [Commented] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094998#comment-14094998 ] Jian He commented on YARN-2378: --- [~subru], thanks for the patch ! some comments: - We may

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095004#comment-14095004 ] Jason Lowe commented on YARN-1198: -- I'd like to avoid iterating all the applications in

[jira] [Created] (YARN-2415) Mark MiniYARNCluster as Public Stable

2014-08-12 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created YARN-2415: -- Summary: Mark MiniYARNCluster as Public Stable Key: YARN-2415 URL: https://issues.apache.org/jira/browse/YARN-2415 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-2415) Mark MiniYARNCluster as Public Stable

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-2415: -- Assignee: Karthik Kambatla Mark MiniYARNCluster as Public Stable

[jira] [Updated] (YARN-2415) Expose MiniYARNCluster for use outside of YARN

2014-08-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2415: --- Component/s: client Target Version/s: 2.6.0 Affects Version/s: 2.5.0

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095017#comment-14095017 ] Jian He commented on YARN-2308: --- Reject an app that's at ACCEPTED state doesn't seem

[jira] [Commented] (YARN-1370) Fair scheduler to re-populate container allocation state

2014-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095032#comment-14095032 ] Hudson commented on YARN-1370: -- FAILURE: Integrated in Hadoop-trunk-Commit #6055 (See

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095036#comment-14095036 ] Zhijie Shen commented on YARN-2308: --- Actually, app is rejected at AppAddedSchedulerEvent,

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095039#comment-14095039 ] Wangda Tan commented on YARN-2414: -- Assigned it to myself, will post a patch soon RM web

[jira] [Assigned] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2414: Assignee: Wangda Tan RM web UI: app page will crash if app is failed before any attempt has been

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095040#comment-14095040 ] Jian He commented on YARN-2308: --- bq. RMApp will enter ACCEPTED regardless the app is added or

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095049#comment-14095049 ] Jian He commented on YARN-1372: --- bq. maybe we can just use

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095050#comment-14095050 ] Wangda Tan commented on YARN-2308: -- bq. I think we should catch exception in following

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095055#comment-14095055 ] Wangda Tan commented on YARN-2308: -- Typo: bq. We cannot catch exception here, because now

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095075#comment-14095075 ] Hadoop QA commented on YARN-1198: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095092#comment-14095092 ] Jian He commented on YARN-2308: --- bq. We cannot catch exception here, because no exception