[jira] [Created] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2304: Summary: TestRMWebServices* fails intermittently Key: YARN-2304 URL: https://issues.apache.org/jira/browse/YARN-2304 Project: Hadoop YARN Issue Type: Test

[jira] [Updated] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2304: - Attachment: test-failure-log-RMWeb.txt > TestRMWebServices* fails intermittently > ---

[jira] [Created] (YARN-2303) TestAMWebServices* fails intermittently

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2303: Summary: TestAMWebServices* fails intermittently Key: YARN-2303 URL: https://issues.apache.org/jira/browse/YARN-2303 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064603#comment-14064603 ] Tsuyoshi OZAWA commented on YARN-2229: -- The test failures looks not related to the pat

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064599#comment-14064599 ] Hadoop QA commented on YARN-2208: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064597#comment-14064597 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064571#comment-14064571 ] Xuan Gong commented on YARN-2208: - OK. This does not sound right... Try again with the same

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064569#comment-14064569 ] Chris Nauroth commented on YARN-2219: - Thanks for the quick response, Jian and Tsuyoshi

[jira] [Updated] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2208: Attachment: YARN-2208.8.patch > AMRMTokenManager need to have a way to roll over AMRMToken > ---

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064565#comment-14064565 ] Hadoop QA commented on YARN-2302: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.10.patch > ContainerId can overflow with RM restart > --

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064563#comment-14064563 ] Hadoop QA commented on YARN-2208: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064556#comment-14064556 ] Tsuyoshi OZAWA commented on YARN-2219: -- Great! > AMs and NMs can get exceptions after

[jira] [Updated] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2302: -- Attachment: YARN-2302.1.patch Kick the jenkins again > Refactor TimelineWebServices > -

[jira] [Updated] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2302: -- Attachment: (was: YARN-2302.1.patch) > Refactor TimelineWebServices > >

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064547#comment-14064547 ] Tsuyoshi OZAWA commented on YARN-2229: -- The compile error is caused by YARN-2219. I'll

[jira] [Resolved] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-2219. --- Resolution: Fixed Thanks Chris for reporting the issue! > AMs and NMs can get exceptions after recovery but b

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064546#comment-14064546 ] Jian He commented on YARN-2219: --- [~ozawa], thanks. I already fixed this. Surprised jenkins d

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064545#comment-14064545 ] Tsuyoshi OZAWA commented on YARN-2219: -- [~jianhe], feel free to use the patch if there

[jira] [Updated] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2219: - Attachment: YARN-2219-fix-compilation-failure.txt This compile failure is caused by test code - Fa

[jira] [Updated] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2208: Attachment: YARN-2208.8.patch > AMRMTokenManager need to have a way to roll over AMRMToken > ---

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064538#comment-14064538 ] Hudson commented on YARN-2219: -- FAILURE: Integrated in Hadoop-trunk-Commit #5897 (See [https:

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064533#comment-14064533 ] Zhijie Shen commented on YARN-2302: --- Compilation failure is caused by YARN-2219. Will re-

[jira] [Commented] (YARN-668) TokenIdentifier serialization should consider Unknown fields

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064530#comment-14064530 ] Junping Du commented on YARN-668: - Hi [~vinodkv], I think here we are talking about to handl

[jira] [Reopened] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened YARN-2219: --- > AMs and NMs can get exceptions after recovery but before scheduler knowns > apps and app-attempts > ---

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064528#comment-14064528 ] Hadoop QA commented on YARN-2302: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2302: -- Attachment: YARN-2302.1.patch Upload the patch of the code refactoring. The logic for the web services i

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064520#comment-14064520 ] Jian He commented on YARN-2219: --- investigating > AMs and NMs can get exceptions after recov

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064519#comment-14064519 ] Chris Nauroth commented on YARN-2219: - Trunk compilation fails after this patch. See b

[jira] [Updated] (YARN-2285) Capacity scheduler root queue usage can show above 100% due to reserved container.

2014-07-16 Thread Tassapol Athiapinya (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tassapol Athiapinya updated YARN-2285: -- Summary: Capacity scheduler root queue usage can show above 100% due to reserved contain

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064511#comment-14064511 ] Hadoop QA commented on YARN-2208: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064512#comment-14064512 ] Wangda Tan commented on YARN-2257: -- Hi [~sandyr], I agree we should have an existing libra

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064510#comment-14064510 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2302: - Summary: Refactor TimelineWebServices Key: YARN-2302 URL: https://issues.apache.org/jira/browse/YARN-2302 Project: Hadoop YARN Issue Type: Sub-task Compo

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.10.patch Rebased on trunk. > ContainerId can overflow with RM restart > ---

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064502#comment-14064502 ] Xuan Gong commented on YARN-2208: - bq. This is a micro-optimization. Let's get rid of cachi

[jira] [Updated] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2208: Attachment: YARN-2208.8.patch > AMRMTokenManager need to have a way to roll over AMRMToken > ---

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064492#comment-14064492 ] Wangda Tan commented on YARN-2285: -- I've verified this will still happen even if preemptio

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2277: -- Assignee: Jonathan Eagles > Add Cross-Origin support to the ATS REST API > -

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064483#comment-14064483 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], bq. Since every RMAppAttemptImpl object ha

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2247: -- Priority: Blocker (was: Major) Target Version/s: 2.5.0 > Allow RM web services users to aut

[jira] [Commented] (YARN-2252) Intermittent failure for testcase TestFairScheduler.testContinuousScheduling

2014-07-16 Thread Ratandeep Ratti (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064467#comment-14064467 ] Ratandeep Ratti commented on YARN-2252: --- Thanks Wei! > Intermittent failure for test

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064445#comment-14064445 ] Junping Du commented on YARN-2242: -- +1. Latest patch LGTM. > Improve exception informatio

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064440#comment-14064440 ] Hadoop QA commented on YARN-2229: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064441#comment-14064441 ] Hadoop QA commented on YARN-2045: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.9.patch Thank you for the comments. Updated a patch to address comments as f

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064428#comment-14064428 ] Hadoop QA commented on YARN-1341: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064427#comment-14064427 ] Junping Du commented on YARN-1341: -- Agree. The test failure shouldn't be related to the la

[jira] [Commented] (YARN-2045) Data persisted in NM should be versioned

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064420#comment-14064420 ] Hadoop QA commented on YARN-2045: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2045) Data persisted in NM should be versioned

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2045: - Attachment: YARN-2045-v5.patch Thanks [~jlowe] for comments! Sorry. I forget to update visibility after r

[jira] [Commented] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064410#comment-14064410 ] Hadoop QA commented on YARN-2244: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-07-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064409#comment-14064409 ] Tsuyoshi OZAWA commented on YARN-2298: -- looks good to me(non-binding) > Move Timeline

[jira] [Commented] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064406#comment-14064406 ] Hadoop QA commented on YARN-2244: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2219) AMs and NMs can get exceptions after recovery but before scheduler knowns apps and app-attempts

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064397#comment-14064397 ] Hudson commented on YARN-2219: -- FAILURE: Integrated in Hadoop-trunk-Commit #5895 (See [https:

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064361#comment-14064361 ] Jian He commented on YARN-2238: --- I'll take a look. > filtering on UI sticks even if I move a

[jira] [Updated] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2244: Attachment: YARN-2244.004.patch Merged code across schedulers > FairScheduler missing handling of c

[jira] [Updated] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2244: Attachment: YARN-2244.003.patch > FairScheduler missing handling of containers for unknown applicati

[jira] [Commented] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064305#comment-14064305 ] Anubhav Dhoot commented on YARN-2244: - Uploading a new patch with code merged across th

[jira] [Commented] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064285#comment-14064285 ] Karthik Kambatla commented on YARN-2244: bq. Right now the containerLaunchedOnNode

[jira] [Commented] (YARN-2244) FairScheduler missing handling of containers for unknown application attempts

2014-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064275#comment-14064275 ] Anubhav Dhoot commented on YARN-2244: - Fixed other issues except >Can we use AbstractY

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-07-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064268#comment-14064268 ] Jason Lowe commented on YARN-2238: -- It's clearly a bug, and I agree YARN-237 is likely wha

[jira] [Commented] (YARN-2208) AMRMTokenManager need to have a way to roll over AMRMToken

2014-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064260#comment-14064260 ] Vinod Kumar Vavilapalli commented on YARN-2208: --- bq. Should we cache the am t

[jira] [Updated] (YARN-2301) Improve yarn container command

2014-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2301: -- Labels: usability (was: ) > Improve yarn container command > --

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064047#comment-14064047 ] Vinod Kumar Vavilapalli commented on YARN-2069: --- I had a long look at over th

[jira] [Updated] (YARN-2301) Improve yarn container command

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2301: -- Issue Type: Improvement (was: Bug) > Improve yarn container command > -- > >

[jira] [Created] (YARN-2301) Improve yarn container command

2014-07-16 Thread Jian He (JIRA)
Jian He created YARN-2301: - Summary: Improve yarn container command Key: YARN-2301 URL: https://issues.apache.org/jira/browse/YARN-2301 Project: Hadoop YARN Issue Type: Bug Reporter: Jian

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-16 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064026#comment-14064026 ] Chen He commented on YARN-1680: --- Hi [~cwelch], I am working on this. Thank you and [~jlowe] f

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-07-16 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14064012#comment-14064012 ] Craig Welch commented on YARN-1680: --- [~airbots] did you want to switch over to using a bl

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063981#comment-14063981 ] Jason Lowe commented on YARN-1341: -- I believe the test failures are unrelated. All of the

[jira] [Updated] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-16 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-2300: Component/s: documentation > Document better sample requests for RM web services for submitting apps

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063922#comment-14063922 ] Hadoop QA commented on YARN-2247: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063908#comment-14063908 ] Hudson commented on YARN-2264: -- FAILURE: Integrated in Hadoop-trunk-Commit #5893 (See [https:

[jira] [Commented] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063859#comment-14063859 ] Jian He commented on YARN-2264: --- Committed to trunk and branch-2. thanks Li ! > Race in Drai

[jira] [Commented] (YARN-2275) When log aggregation not enabled, message should point to NM HTTP port, not IPC port

2014-07-16 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063852#comment-14063852 ] Ray Chiang commented on YARN-2275: -- It seems like there is no solution that would satisfy

[jira] [Commented] (YARN-2252) Intermittent failure for testcase TestFairScheduler.testContinuousScheduling

2014-07-16 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063846#comment-14063846 ] Wei Yan commented on YARN-2252: --- [~rdsr], sorry for later reply. the patch looks good to me.

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063835#comment-14063835 ] Jason Lowe commented on YARN-1198: -- bq. The question is really "is this worth doing in ad

[jira] [Commented] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063818#comment-14063818 ] Varun Vasudev commented on YARN-2300: - Patch is a documentation patch so no test cases.

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1408: -- Target Version/s: 2.5.0 (was: 2.5.0, 2.6.0) Fix Version/s: (was: 2.6.

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2247: Attachment: apache-yarn-2247.2.patch Upload correct patch file. > Allow RM web services users to au

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2247: Attachment: (was: apache-yarn-2247.2.patch) > Allow RM web services users to authenticate using

[jira] [Commented] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063800#comment-14063800 ] Hadoop QA commented on YARN-2300: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063791#comment-14063791 ] Hadoop QA commented on YARN-2247: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2247: Attachment: apache-yarn-2247.2.patch Uploaded new patch with fixes for build issues. Test failures a

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-16 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063785#comment-14063785 ] Craig Welch commented on YARN-1198: --- [~jlowe] Right, this isn't a replacement for the oth

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063783#comment-14063783 ] Sunil G commented on YARN-796: -- 2. Regarding reservations, how about introducing node-label res

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063774#comment-14063774 ] Hadoop QA commented on YARN-2247: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2293) Scoring for NMs to identify a better candidate to launch AMs

2014-07-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063772#comment-14063772 ] Sunil G commented on YARN-2293: --- Thank you [~jlowe] for update. Yes, it generically coming un

[jira] [Commented] (YARN-2264) Race in DrainDispatcher can cause random test failures

2014-07-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063757#comment-14063757 ] Jian He commented on YARN-2264: --- committing this. > Race in DrainDispatcher can cause random

[jira] [Updated] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2300: Attachment: apache-yarn-2300.0.patch Attached patch with a more realistic example(distributed shell)

[jira] [Created] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-16 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2300: --- Summary: Document better sample requests for RM web services for submitting apps Key: YARN-2300 URL: https://issues.apache.org/jira/browse/YARN-2300 Project: Hadoop YAR

[jira] [Updated] (YARN-1408) Preemption caused Invalid State Event: ACQUIRED at KILLED and caused a task timeout for 30mins

2014-07-16 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-1408: Fix Version/s: 2.6.0 2.5.0 > Preemption caused Invalid State Event: ACQUIRED at K

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063749#comment-14063749 ] Sandy Ryza commented on YARN-2257: -- [~wangda] I agree with you that expecting admins to re

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063725#comment-14063725 ] Wangda Tan commented on YARN-2285: -- Thanks comments from Vinod and Sunil, bq. From the lo

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063721#comment-14063721 ] Wangda Tan commented on YARN-2257: -- Hi [~sandyr], Thanks for pointing me this, I have a qu

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063710#comment-14063710 ] Sunil G commented on YARN-2285: --- I also got 106% in root queue with user-factor configured as

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063704#comment-14063704 ] Hadoop QA commented on YARN-1341: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063700#comment-14063700 ] Varun Vasudev commented on YARN-2247: - Uploaded new patch addressing review comments.

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2247: Attachment: apache-yarn-2247.1.patch > Allow RM web services users to authenticate using delegation

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063679#comment-14063679 ] Vinod Kumar Vavilapalli commented on YARN-2285: --- >From the look of it, it sou

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063665#comment-14063665 ] Hadoop QA commented on YARN-1994: - {color:red}-1 overall{color}. Here are the results of t

  1   2   >