[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128140#comment-14128140 ] Zhijie Shen commented on YARN-1530: --- [~bcwalrus], thanks for your interests in the

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128156#comment-14128156 ] Zhijie Shen commented on YARN-2517: --- Scan through the patch, the approach is quite close

[jira] [Comment Edited] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128140#comment-14128140 ] Zhijie Shen edited comment on YARN-1530 at 9/10/14 7:36 AM:

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128357#comment-14128357 ] Hudson commented on YARN-1471: -- FAILURE: Integrated in Hadoop-Yarn-trunk #676 (See

[jira] [Commented] (YARN-2526) SLS can deadlock when all the threads are taken by AMSimulators

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128491#comment-14128491 ] Hudson commented on YARN-2526: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1867 (See

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128494#comment-14128494 ] Hudson commented on YARN-1471: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1867 (See

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128567#comment-14128567 ] Tsuyoshi OZAWA commented on YARN-2517: -- Thanks for your review, Zhijie. I think batch

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1458: --- Target Version/s: 2.6.0 (was: 2.2.0) Fix Version/s: (was: 2.2.1) In Fair

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128590#comment-14128590 ] Karthik Kambatla commented on YARN-1458: +1. Committing version 8. In Fair

[jira] [Updated] (YARN-1458) FairScheduler: Zero weight can lead to livelock

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1458: --- Summary: FairScheduler: Zero weight can lead to livelock (was: In Fair Scheduler, size based

[jira] [Commented] (YARN-1458) FairScheduler: Zero weight can lead to livelock

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128619#comment-14128619 ] Karthik Kambatla commented on YARN-1458: Thanks Zhihai and [~qingwu.fu] for working

[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager

2014-09-10 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128622#comment-14128622 ] Benoy Antony commented on YARN-2527: Thank you [~zjshen]. I am investigating on how

[jira] [Updated] (YARN-2527) NPE in ApplicationACLsManager

2014-09-10 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated YARN-2527: --- Attachment: YARN-2527.patch Attaching a new patch. Added one more test case to test the case of

[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128687#comment-14128687 ] Hadoop QA commented on YARN-2527: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2529) Generic history service RPC interface doesn't work wen service authorization is enabled

2014-09-10 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2529: - Summary: Generic history service RPC interface doesn't work wen service authorization is enabled Key: YARN-2529 URL: https://issues.apache.org/jira/browse/YARN-2529

[jira] [Updated] (YARN-2529) Generic history service RPC interface doesn't work when service authorization is enabled

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2529: -- Summary: Generic history service RPC interface doesn't work when service authorization is enabled (was:

[jira] [Commented] (YARN-2517) Implement TimelineClientAsync

2014-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128819#comment-14128819 ] Vinod Kumar Vavilapalli commented on YARN-2517: --- I am +1 about a client that

[jira] [Updated] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-10 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2440: Attachment: apache-yarn-2440.6.patch Uploaded new patch to address Vinod's comments. {quote}

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128842#comment-14128842 ] Hadoop QA commented on YARN-2440: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128843#comment-14128843 ] Vinod Kumar Vavilapalli commented on YARN-2440: --- bq. As I mentioned before, I

[jira] [Updated] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated YARN-1492: --- Attachment: shared_cache_design_v6.pdf Attached v6 design doc to reflect the current implementation.

[jira] [Comment Edited] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128843#comment-14128843 ] Vinod Kumar Vavilapalli edited comment on YARN-2440 at 9/10/14 6:16 PM:

[jira] [Created] (YARN-2530) MapReduce should take cpu into account when doing headroom calculations

2014-09-10 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2530: --- Summary: MapReduce should take cpu into account when doing headroom calculations Key: YARN-2530 URL: https://issues.apache.org/jira/browse/YARN-2530 Project: Hadoop

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128865#comment-14128865 ] Hadoop QA commented on YARN-1492: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128877#comment-14128877 ] Vinod Kumar Vavilapalli commented on YARN-2033: --- Looks mostly good. Rename

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128915#comment-14128915 ] Hudson commented on YARN-1471: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1892 (See

[jira] [Commented] (YARN-2526) SLS can deadlock when all the threads are taken by AMSimulators

2014-09-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128911#comment-14128911 ] Hudson commented on YARN-2526: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1892 (See

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.11.patch Good catch! I uploaded a new patch with the updated config names.

[jira] [Created] (YARN-2531) CGroups - Admins should be allowed to enforce strict cpu limits

2014-09-10 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2531: --- Summary: CGroups - Admins should be allowed to enforce strict cpu limits Key: YARN-2531 URL: https://issues.apache.org/jira/browse/YARN-2531 Project: Hadoop YARN

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128927#comment-14128927 ] Xuan Gong commented on YARN-2459: - Committed into trunk and branch-2. Thanks, Jian. RM

[jira] [Commented] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128929#comment-14128929 ] Xuan Gong commented on YARN-2459: - Also, Thanks Mayank for the initial patch. RM crashes

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.12.patch Missed the changes in YarnConfiguration in the last patch, added them in

[jira] [Created] (YARN-2532) Track pending resources at the application level

2014-09-10 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2532: -- Summary: Track pending resources at the application level Key: YARN-2532 URL: https://issues.apache.org/jira/browse/YARN-2532 Project: Hadoop YARN

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128984#comment-14128984 ] Karthik Kambatla commented on YARN-1492: Thanks for updating the design, Chris.

[jira] [Commented] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14128985#comment-14128985 ] Jian He commented on YARN-2158: --- looks good, committing TestRMWebServicesAppsModification

[jira] [Commented] (YARN-2532) Track pending resources at the application level

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129013#comment-14129013 ] Karthik Kambatla commented on YARN-2532: bq. For the FS at least, this is just

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129020#comment-14129020 ] Vinod Kumar Vavilapalli commented on YARN-2440: --- The build machine ran into

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129022#comment-14129022 ] Jian He commented on YARN-415: -- Hi [~eepayne], sorry for being unclear. my main question was,

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-09-10 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129024#comment-14129024 ] Craig Welch commented on YARN-796: -- So, I'm adding code to check whether a user should be

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

2014-09-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129038#comment-14129038 ] Chris Douglas commented on YARN-1710: - {{GreedyReservationAgent}} * Consider {{@link}}

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

2014-09-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129041#comment-14129041 ] Chris Douglas commented on YARN-2475: - {{SimpleCapacityReplanner}} * The Clock can be

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129042#comment-14129042 ] Hadoop QA commented on YARN-2033: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2458) Add file handling features to the Windows Secure Container Executor LRPC service

2014-09-10 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129061#comment-14129061 ] Remus Rusanu commented on YARN-2458: The solution proposed here is to have the Windows

[jira] [Updated] (YARN-2459) RM crashes if App gets rejected for any reason and HA is enabled

2014-09-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2459: Fix Version/s: 2.6.0 RM crashes if App gets rejected for any reason and HA is enabled

[jira] [Commented] (YARN-2456) Possible deadlock in CapacityScheduler when RM is recovering apps

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129066#comment-14129066 ] Jian He commented on YARN-2456: --- Folks, thanks for the comments. Renamed the title as

[jira] [Updated] (YARN-2456) Possible livelock in CapacityScheduler when RM is recovering apps

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2456: -- Summary: Possible livelock in CapacityScheduler when RM is recovering apps (was: Possible lovelock in

[jira] [Updated] (YARN-2456) Possible lovelock in CapacityScheduler when RM is recovering apps

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2456: -- Summary: Possible lovelock in CapacityScheduler when RM is recovering apps (was: Possible deadlock in

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-09-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129119#comment-14129119 ] Eric Payne commented on YARN-415: - Thanks for clarifying [~jianhe]. {quote} is this

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129133#comment-14129133 ] Zhijie Shen commented on YARN-611: -- bq. How about attempt_failures_sliding_window_size? Or

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129141#comment-14129141 ] Jian He commented on YARN-415: -- Eric, thanks for your explanation. sounds good to me. One

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-09-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129181#comment-14129181 ] Jason Lowe commented on YARN-2056: -- Sorry for coming in late. I think there's an issue

[jira] [Updated] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-09-10 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1372: Attachment: YARN-1372.003.patch As per feedback, remove containers when the corresponding

[jira] [Updated] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-09-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-415: Attachment: YARN-415.201409102216.txt Thanks a lot, [~jianhe]. I have added comment headers for the new APIs

[jira] [Created] (YARN-2533) Redirect stdout and stderr to a file for all applications/frameworks

2014-09-10 Thread Kannan Rajah (JIRA)
Kannan Rajah created YARN-2533: -- Summary: Redirect stdout and stderr to a file for all applications/frameworks Key: YARN-2533 URL: https://issues.apache.org/jira/browse/YARN-2533 Project: Hadoop YARN

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.15.patch Talked with Jian offline. Updated to reduce epoch bits from 32

[jira] [Updated] (YARN-120) Make yarn-common services robust

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-120: -- Fix Version/s: (was: 3.0.0) Make yarn-common services robust

[jira] [Updated] (YARN-121) Yarn services to throw a YarnException on invalid state changs

2014-09-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-121: -- Fix Version/s: (was: 3.0.0) Yarn services to throw a YarnException on invalid state changs

[jira] [Updated] (YARN-2529) Generic history service RPC interface doesn't work when service authorization is enabled

2014-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2529: -- Attachment: YARN-2529.1.patch I created a patch to make application history protocol use timeline policy

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-09-10 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129342#comment-14129342 ] Chris Trezzo commented on YARN-1492: Thanks [~kasha]! A couple of questions: bq. 2.

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129354#comment-14129354 ] Junping Du commented on YARN-2033: -- Sure. Will commit it soon. Thanks [~zjshen] for the

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129359#comment-14129359 ] Hadoop QA commented on YARN-1372: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2464) Provide Hadoop as a local resource (on HDFS) which can be used by other projcets

2014-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129379#comment-14129379 ] Junping Du commented on YARN-2464: -- [~sseth], I will assign to myself to work on it if you

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-09-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129378#comment-14129378 ] Karthik Kambatla commented on YARN-1492: I am good with fixing the in-memory store

[jira] [Commented] (YARN-415) Capture aggregate memory allocation at the app-level for chargeback

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129384#comment-14129384 ] Hadoop QA commented on YARN-415: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129429#comment-14129429 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2529) Generic history service RPC interface doesn't work when service authorization is enabled

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129430#comment-14129430 ] Hadoop QA commented on YARN-2529: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.16.patch Fixed to pass tests. ContainerId can overflow with RM restart

[jira] [Commented] (YARN-1372) Ensure all completed containers are reported to the AMs across RM restart

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129459#comment-14129459 ] Jian He commented on YARN-1372: --- Thanks for updating the patch. Some comments and naming

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: (was: YARN-2229.16.patch) ContainerId can overflow with RM restart

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-09-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129464#comment-14129464 ] Wangda Tan commented on YARN-796: - Hi Craig, I think when RM is running, the solution should

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.16.patch ContainerId can overflow with RM restart

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: (was: YARN-2229.16.patch) ContainerId can overflow with RM restart

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.16.patch ContainerId can overflow with RM restart

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-09-10 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129480#comment-14129480 ] Craig Welch commented on YARN-796: -- Good, what you describe wrt the cli is what I was

[jira] [Assigned] (YARN-2495) [YARN-796] Allow admin specify labels in each NM (Distributed configuration)

2014-09-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2495: --- Assignee: Naganarasimha G R [YARN-796] Allow admin specify labels in each NM

[jira] [Assigned] (YARN-2499) [YARN-796] Respect labels in preemption policy of fair scheduler

2014-09-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-2499: --- Assignee: Naganarasimha G R [YARN-796] Respect labels in preemption policy of fair

[jira] [Updated] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-09-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-796: Attachment: YARN-796.node-label.consolidate.2.patch Attached updated consolidated patch, named

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129528#comment-14129528 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-09-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129533#comment-14129533 ] Vinod Kumar Vavilapalli commented on YARN-2440: --- This looks good, +1.

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129541#comment-14129541 ] Hadoop QA commented on YARN-2229: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-09-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129557#comment-14129557 ] Tsuyoshi OZAWA commented on YARN-2229: -- The latest v16 patch is ready for review.

[jira] [Created] (YARN-2534) FairScheduler: totalMaxShare is not calculated correctly in computeSharesInternal

2014-09-10 Thread zhihai xu (JIRA)
zhihai xu created YARN-2534: --- Summary: FairScheduler: totalMaxShare is not calculated correctly in computeSharesInternal Key: YARN-2534 URL: https://issues.apache.org/jira/browse/YARN-2534 Project: Hadoop

[jira] [Updated] (YARN-2534) FairScheduler: totalMaxShare is not calculated correctly in computeSharesInternal

2014-09-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2534: Attachment: YARN-2534.000.patch FairScheduler: totalMaxShare is not calculated correctly in

[jira] [Commented] (YARN-2534) FairScheduler: totalMaxShare is not calculated correctly in computeSharesInternal

2014-09-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129582#comment-14129582 ] zhihai xu commented on YARN-2534: - I uploaded a patch YARN-2534.000.patch for review. I

[jira] [Updated] (YARN-2534) FairScheduler: totalMaxShare is not calculated correctly in computeSharesInternal

2014-09-10 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2534: Fix Version/s: (was: 2.6.0) FairScheduler: totalMaxShare is not calculated correctly in

[jira] [Updated] (YARN-611) Add an AM retry count reset window to YARN RM

2014-09-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-611: --- Attachment: YARN-611.9.patch Add an AM retry count reset window to YARN RM

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-09-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129606#comment-14129606 ] Xuan Gong commented on YARN-611: bq. The name sliding window: Sliding window of what? We

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129609#comment-14129609 ] Hadoop QA commented on YARN-611: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2496) [YARN-796] Changes for capacity scheduler to support allocate resource respect labels

2014-09-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129610#comment-14129610 ] Jian He commented on YARN-2496: --- briefly looked at the patch: - CSQueueUtils.java format

[jira] [Updated] (YARN-611) Add an AM retry count reset window to YARN RM

2014-09-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-611: --- Attachment: YARN-611.9.rebase.patch Add an AM retry count reset window to YARN RM

[jira] [Commented] (YARN-2534) FairScheduler: totalMaxShare is not calculated correctly in computeSharesInternal

2014-09-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129611#comment-14129611 ] Hadoop QA commented on YARN-2534: - {color:green}+1 overall{color}. Here are the results of