[jira] [Created] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-2261: - Summary: YARN should have a way to run post-application cleanup Key: YARN-2261 URL: https://issues.apache.org/jira/browse/YARN-2261 Project: Hadoop

[jira] [Commented] (YARN-2248) Capacity Scheduler changes for moving apps between queues

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054566#comment-14054566 ] Hadoop QA commented on YARN-2248: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054571#comment-14054571 ] Vinod Kumar Vavilapalli commented on YARN-2261: --- The proposal here is to have

[jira] [Commented] (YARN-2256) Too many nodemanager audit logs are generated

2014-07-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054574#comment-14054574 ] Varun Saxena commented on YARN-2256: I will make the following changes : 1. Create new

[jira] [Commented] (YARN-2258) Aggregation of MR job logs failing when Resourcemanager switches

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054587#comment-14054587 ] Vinod Kumar Vavilapalli commented on YARN-2258: --- I see. I now think this is a

[jira] [Commented] (YARN-2259) NM-Local dir cleanup failing when Resourcemanager switches

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054590#comment-14054590 ] Vinod Kumar Vavilapalli commented on YARN-2259: --- Nishan, can you please

[jira] [Updated] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2257: -- Summary: Add user to queue mappings to automatically place users' apps into

[jira] [Assigned] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-2257: - Assignee: Vinod Kumar Vavilapalli Assigning this to myself. Will post the

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054617#comment-14054617 ] Sandy Ryza commented on YARN-2257: -- To add some background: since MR1, the Fair Scheduler

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054625#comment-14054625 ] Tsuyoshi OZAWA commented on YARN-2013: -- Thank you for review and comments, Junping and

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-07-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054629#comment-14054629 ] Sandy Ryza commented on YARN-2026: -- I had a conversation with [~kkambatl] about this, and

[jira] [Updated] (YARN-2248) Capacity Scheduler changes for moving apps between queues

2014-07-08 Thread Krisztian Horvath (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Horvath updated YARN-2248: Attachment: YARN-2248-3.patch The order of the live container resource release is important

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

2014-07-08 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054648#comment-14054648 ] Mayank Bansal commented on YARN-2022: - Merged to Branch 2.5 Thanks, Mayank

[jira] [Commented] (YARN-2259) NM-Local dir cleanup failing when Resourcemanager switches

2014-07-08 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054653#comment-14054653 ] Nishan Shetty commented on YARN-2259: - Hi [~vinodkv] cleanup failing means the

[jira] [Updated] (YARN-2259) NM-Local dir cleanup failing when Resourcemanager switches

2014-07-08 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2259: Attachment: Capture.PNG NM-Local dir cleanup failing when Resourcemanager switches

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054667#comment-14054667 ] Steve Loughran commented on YARN-2242: -- thinking about this, one thing I'd like for my

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054672#comment-14054672 ] Zhijie Shen commented on YARN-2242: --- bq. There's nothing in the Application Report that

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054677#comment-14054677 ] Zhijie Shen commented on YARN-2242: --- As is mentioned in YARN-2013, the thing bothers me

[jira] [Commented] (YARN-2248) Capacity Scheduler changes for moving apps between queues

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054682#comment-14054682 ] Hadoop QA commented on YARN-2248: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-08 Thread Patrick Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054683#comment-14054683 ] Patrick Liu commented on YARN-2257: --- Thanks for all of your consideration, cause this is

[jira] [Commented] (YARN-2252) Intermittent failure for testcase TestFairScheduler.testContinuousScheduling

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054803#comment-14054803 ] Hadoop QA commented on YARN-2252: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1366) AM should implement Resync with the ApplicationMasterService instead of shutting down

2014-07-08 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-1366: - Attachment: YARN-1366.13.patch Thanks Jian He and Bikas Saha for reviewing patch. I updated patch with

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-08 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2262: Description: Few fields displaying wrong values in Timeline server after RM restart State: null

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-08 Thread Patrick Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054818#comment-14054818 ] Patrick Liu commented on YARN-2257: --- Hi, [~vinodkv]. Although I am new, I want

[jira] [Commented] (YARN-1366) AM should implement Resync with the ApplicationMasterService instead of shutting down

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054839#comment-14054839 ] Hadoop QA commented on YARN-1366: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054847#comment-14054847 ] Hudson commented on YARN-2158: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #607 (See

[jira] [Updated] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-07-08 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated YARN-2198: --- Attachment: YARN-2198.1.patch This patch goes on top of YARN-1972. Remove the need to run

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-07-08 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054887#comment-14054887 ] Remus Rusanu commented on YARN-2198: RB https://reviews.apache.org/r/23334/ Remove

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-07-08 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054909#comment-14054909 ] Remus Rusanu commented on YARN-2198: I have uploaded a first patch so we can start the

[jira] [Commented] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14054956#comment-14054956 ] Hudson commented on YARN-2158: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1798 (See

[jira] [Updated] (YARN-2045) Data persisted in NM should be versioned

2014-07-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2045: - Attachment: YARN-2045-v2.patch Rename NMStateVersion to NMDBSchemaVersion, so that other DB store (like

[jira] [Commented] (YARN-2158) TestRMWebServicesAppsModification sometimes fails in trunk

2014-07-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055016#comment-14055016 ] Hudson commented on YARN-2158: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1825 (See

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055028#comment-14055028 ] Hadoop QA commented on YARN-2045: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2263) CSQueueUtils.computeMaxActiveApplicationsPerUser may cause deadlock for nested MapReduce jobs

2014-07-08 Thread Chen He (JIRA)
Chen He created YARN-2263: - Summary: CSQueueUtils.computeMaxActiveApplicationsPerUser may cause deadlock for nested MapReduce jobs Key: YARN-2263 URL: https://issues.apache.org/jira/browse/YARN-2263 Project:

[jira] [Updated] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-08 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-1680: -- Attachment: YARN-1680-v2.patch reattach the patch to trigger the QA availableResources sent to

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055103#comment-14055103 ] Xuan Gong commented on YARN-611: [~revans2] Thanks for the review. bq. Why are you using

[jira] [Updated] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-611: --- Attachment: YARN-611.2.patch Add an AM retry count reset window to YARN RM

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055109#comment-14055109 ] Xuan Gong commented on YARN-2208: - bq. RM_AMRM_TOKEN_MASTER_KEY_ROLLING_INTERVAL_SECS -

[jira] [Commented] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055111#comment-14055111 ] Hadoop QA commented on YARN-2254: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2259) NM-Local dir cleanup failing when Resourcemanager switches

2014-07-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055114#comment-14055114 ] Sunil G commented on YARN-2259: --- Hi [~nishan] could you please grep the NMLogs with this

[jira] [Updated] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2208: Attachment: YARN-2208.4.patch AMRMTokenManager need to have a way to roll over AMRMToken

[jira] [Commented] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-07-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055138#comment-14055138 ] Karthik Kambatla commented on YARN-2110: +1. Committing this.

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055143#comment-14055143 ] Hadoop QA commented on YARN-1680: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-07-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055146#comment-14055146 ] Karthik Kambatla commented on YARN-2026: Can we follow up on the first patch in

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-07-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055142#comment-14055142 ] Karthik Kambatla commented on YARN-2026: Yes. Per discussions with [~sandyr] and

[jira] [Commented] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-07-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055166#comment-14055166 ] Karthik Kambatla commented on YARN-2254: I wonder if we should make the test

[jira] [Commented] (YARN-2110) TestAMRestart#testAMRestartWithExistingContainers assumes CapacityScheduler

2014-07-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055162#comment-14055162 ] Karthik Kambatla commented on YARN-2110: [~airbots] - thanks for updating the

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055191#comment-14055191 ] Sunil G commented on YARN-2069: --- Hi [~mayank_bansal] I have a doubt here. preemptFrom is

[jira] [Commented] (YARN-1366) AM should implement Resync with the ApplicationMasterService instead of shutting down

2014-07-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055200#comment-14055200 ] Jian He commented on YARN-1366: --- lgtm AM should implement Resync with the

[jira] [Updated] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2242: Attachment: YARN-2242-070814.patch New patch to add the swallowed diagnostics information back, also reformatted

[jira] [Commented] (YARN-2255) YARN Audit logging not added to log4j.properties

2014-07-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055212#comment-14055212 ] Sunil G commented on YARN-2255: --- HADOOP-8392 also reports the same, but not resolved yet.

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055211#comment-14055211 ] Hadoop QA commented on YARN-611: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2261) YARN should have a way to run post-application cleanup

2014-07-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055231#comment-14055231 ] Bikas Saha commented on YARN-2261: -- +1 for having the control/responsibility in YARN An

[jira] [Updated] (YARN-1857) CapacityScheduler headroom doesn't account for other AM's running

2014-07-08 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-1857: -- Attachment: YARN-1857.patch trigger QA CapacityScheduler headroom doesn't account for other AM's running

[jira] [Commented] (YARN-2147) client lacks delegation token exception details when application submit fails

2014-07-08 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055269#comment-14055269 ] Chen He commented on YARN-2147: --- all tests in this class has timeout, just to make it

[jira] [Assigned] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-08 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch reassigned YARN-1994: - Assignee: Craig Welch Expose YARN/MR endpoints on multiple interfaces

[jira] [Updated] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-611: --- Attachment: YARN-611.3.patch FIX Add an AM retry count reset window to YARN RM

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-08 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055314#comment-14055314 ] Craig Welch commented on YARN-1994: --- We plan for our approach to be similar to the hdfs

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055320#comment-14055320 ] Xuan Gong commented on YARN-611: fix -1 on javadoc and release audit. All the testcases can

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-07-08 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055326#comment-14055326 ] Ashwin Shankar commented on YARN-2026: -- [~sandyr],[~kasha] Sure, we can incorporate

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-07-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055343#comment-14055343 ] Karthik Kambatla commented on YARN-2026: bq. Confusion/Debugging inconvenience :

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055373#comment-14055373 ] Vinod Kumar Vavilapalli commented on YARN-611: -- Scanned through the patch,

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055402#comment-14055402 ] Hadoop QA commented on YARN-611: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-08 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1994: -- Attachment: YARN-1994.0.patch Expose YARN/MR endpoints on multiple interfaces

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-08 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055562#comment-14055562 ] Craig Welch commented on YARN-1994: --- Note: The contributors for this patch are Milan

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Robert Joseph Evans (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055588#comment-14055588 ] Robert Joseph Evans commented on YARN-611: -- Why is the reset policy created on a

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055592#comment-14055592 ] Jian He commented on YARN-2208: --- In which case this if condition can happen? {code} if

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-08 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055598#comment-14055598 ] Mayank Bansal commented on YARN-2069: - Hi [~wangda], Good point , I missed it. I have

[jira] [Commented] (YARN-611) Add an AM retry count reset window to YARN RM

2014-07-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055602#comment-14055602 ] Vinod Kumar Vavilapalli commented on YARN-611: -- Hey, I updated the JIRA with a

[jira] [Updated] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-08 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2069: Attachment: YARN-2069-trunk-4.patch CS queue level preemption should respect user-limits

[jira] [Updated] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2242: Attachment: YARN-2242-070814-1.patch Make patch with latest trunk Improve exception information on AM launch

[jira] [Updated] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-08 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1994: -- Attachment: YARN-1994.1.patch Add informational property entries in the yarn-default.xml Expose

[jira] [Updated] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2242: Attachment: (was: YARN-2242-070115.patch) Improve exception information on AM launch crashes

[jira] [Updated] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2242: Attachment: (was: YARN-2242-070114.patch) Improve exception information on AM launch crashes

[jira] [Updated] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2242: Attachment: (was: YARN-2242-070114-1.patch) Improve exception information on AM launch crashes

[jira] [Updated] (YARN-2242) Improve exception information on AM launch crashes

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2242: Attachment: (was: YARN-2242-070115-1.patch) Improve exception information on AM launch crashes

[jira] [Created] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-08 Thread Siddharth Seth (JIRA)
Siddharth Seth created YARN-2264: Summary: Race in DrainDispatcher can cause random test failures Key: YARN-2264 URL: https://issues.apache.org/jira/browse/YARN-2264 Project: Hadoop YARN

[jira] [Assigned] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-2264: --- Assignee: Li Lu Race in DrainDispatcher can cause random test failures

[jira] [Updated] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2264: Attachment: YARN-2264-070814.patch The inconsistent state of the DrainDispatcher is generated since atomicity is

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055701#comment-14055701 ] Wangda Tan commented on YARN-2069: -- Hi [~mayank_bansal], I looked at your updated patch, I

[jira] [Assigned] (YARN-1524) Make aggregated logs of completed containers available via REST API

2014-07-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-1524: --- Assignee: Robert Kanter Make aggregated logs of completed containers available via REST API

[jira] [Commented] (YARN-570) Time strings are formated in different timezone

2014-07-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055751#comment-14055751 ] Akira AJISAKA commented on YARN-570: The patch needs no tests. I verified that date was

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055753#comment-14055753 ] Jian He commented on YARN-1408: --- seems one race condition that if container is preempted

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055787#comment-14055787 ] Wangda Tan commented on YARN-1408: -- Thanks [~jianhe] for this commit, maybe a possible

[jira] [Created] (YARN-2265) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-08 Thread Junping Du (JIRA)
Junping Du created YARN-2265: Summary: ShuffleHandler DB schema should be versioned with compatible/incompatible changes Key: YARN-2265 URL: https://issues.apache.org/jira/browse/YARN-2265 Project:

[jira] [Commented] (YARN-2265) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055798#comment-14055798 ] Junping Du commented on YARN-2265: -- Actually, this need to be moved to MAPREDUCE

[jira] [Updated] (YARN-2265) ShuffleHandler DB schema should be versioned with compatible/incompatible changes

2014-07-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2265: - Issue Type: New Feature (was: Sub-task) Parent: (was: YARN-666) ShuffleHandler DB schema

[jira] [Commented] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055852#comment-14055852 ] Sunil G commented on YARN-1408: --- Thanks [~jianhe] for the comment. {code} // Remove from the

[jira] [Commented] (YARN-2026) Fair scheduler : Fair share for inactive queues causes unfair allocation in some scenarios

2014-07-08 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055861#comment-14055861 ] Ashwin Shankar commented on YARN-2026: -- [~kasha], I see your point. I had a quick chat