[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-09-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119728#comment-14119728 ] Tsuyoshi OZAWA commented on YARN-1879: -- Hi [~vinodkv], could you take a look? > Mark

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2014-09-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119708#comment-14119708 ] Tsuyoshi OZAWA commented on YARN-2306: -- s/directory/directly/ > leak of reservation m

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2014-09-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119707#comment-14119707 ] Tsuyoshi OZAWA commented on YARN-2306: -- Thanks for your updating, [~zhiguohong]. The t

[jira] [Updated] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-09-03 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2130: - Attachment: YARN-2130.9.patch Refreshed a patch. > Cleanup: Adding getRMAppManager, getQueueACLsMa

[jira] [Commented] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-09-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14119450#comment-14119450 ] Tsuyoshi OZAWA commented on YARN-2404: -- The test failure looks not related to patch, a

[jira] [Updated] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-09-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2404: - Attachment: YARN-2404.3.patch Jian, thanks for your review. Updated a patch to address your comment

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.14.patch Updated to pass tests and use getContainerId in ContainerId#equals a

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-09-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.13.patch Updated a patch to use getContainerId() in compareTo and equals. >

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-09-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117327#comment-14117327 ] Tsuyoshi OZAWA commented on YARN-1879: -- A latest patch is ready for review. I also con

[jira] [Commented] (YARN-2422) yarn.scheduler.maximum-allocation-mb should not be hard-coded in yarn-default.xml

2014-08-31 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14117012#comment-14117012 ] Tsuyoshi OZAWA commented on YARN-2422: -- {quote} I think it's weird to have a nodemanag

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-31 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.13.patch The test failure is caused when rm.stop() is called before the state

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-31 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.12.patch Updated a patch to fix the test failure. > Mark Idempotent/AtMostO

[jira] [Updated] (YARN-2484) FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2484: - Attachment: YARN-2484.1.patch In this case, we should use close() methods directory instead of IOU

[jira] [Created] (YARN-2484) FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
Tsuyoshi OZAWA created YARN-2484: Summary: FileSystemRMStateStore#readFile/writeFile should close FSData(In|Out)putStream in final block Key: YARN-2484 URL: https://issues.apache.org/jira/browse/YARN-2484

[jira] [Commented] (YARN-2483) TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails due to incorrect AppAttempt state

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116455#comment-14116455 ] Tsuyoshi OZAWA commented on YARN-2483: -- Maybe the test failure is because of following

[jira] [Commented] (YARN-2483) TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails due to incorrect AppAttempt state

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116436#comment-14116436 ] Tsuyoshi OZAWA commented on YARN-2483: -- Hmm, I misread the log. SCHEDULED is before AL

[jira] [Commented] (YARN-2483) TestAMRestart#testShouldNotCountFailureToMaxAttemptRetry fails due to incorrect AppAttempt state

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116431#comment-14116431 ] Tsuyoshi OZAWA commented on YARN-2483: -- Thanks for reporting, Ted. It looks a timing p

[jira] [Commented] (YARN-2476) Apps are scheduled in random order after RM failover

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14116368#comment-14116368 ] Tsuyoshi OZAWA commented on YARN-2476: -- Thanks for your report, Santosh. IIUC, it's be

[jira] [Updated] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-08-30 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2404: - Attachment: YARN-2404.2.patch Thanks for review, Jian. I agree with you. Updated a patch to rename

[jira] [Updated] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-08-29 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2404: - Attachment: YARN-2404.1.patch Attached a first patch. > Remove ApplicationAttemptState and Appli

[jira] [Commented] (YARN-2406) Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto

2014-08-29 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114977#comment-14114977 ] Tsuyoshi OZAWA commented on YARN-2406: -- Thanks Jian for reviewing and updating! > Mov

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock

2014-08-29 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114972#comment-14114972 ] Tsuyoshi OZAWA commented on YARN-2405: -- Thanks Maysam, Gera, and Karthik for review!

[jira] [Commented] (YARN-2406) Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto

2014-08-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114779#comment-14114779 ] Tsuyoshi OZAWA commented on YARN-2406: -- [~jianhe], just a reminder - let me know if we

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114747#comment-14114747 ] Tsuyoshi OZAWA commented on YARN-2405: -- I see. In this case, I think we can show the e

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.4.patch Thanks for the review, Karthik. Updated a patch to add the javadoc a

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-28 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14114332#comment-14114332 ] Tsuyoshi OZAWA commented on YARN-2405: -- Thanks for your review, [~jira.shegalov]. I th

[jira] [Commented] (YARN-2461) Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113439#comment-14113439 ] Tsuyoshi OZAWA commented on YARN-2461: -- It looks good to me(non-binding). > Fix PROCF

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.11.patch > Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtoc

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113240#comment-14113240 ] Tsuyoshi OZAWA commented on YARN-2405: -- [~kkambatl], could you reivew a latest patch?

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113192#comment-14113192 ] Tsuyoshi OZAWA commented on YARN-2454: -- Thanks for your updating, [~yxls123123]. It so

[jira] [Commented] (YARN-2182) Update ContainerId#toString() to avoid conflicts before and after RM restart

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14113180#comment-14113180 ] Tsuyoshi OZAWA commented on YARN-2182: -- Thanks for your review, Jian! > Update Contai

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.3.patch Thanks for your suggestion, Maysam. Updated a patch to handle except

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112139#comment-14112139 ] Tsuyoshi OZAWA commented on YARN-1879: -- Investigating why the test fails. > Mark Idem

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.2.patch It seems build process is killed. Let me try attaching a patch again

[jira] [Updated] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2405: - Attachment: YARN-2405.1.patch Attached a first patch. > NPE in FairSchedulerAppsBlock (scheduler

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14112044#comment-14112044 ] Tsuyoshi OZAWA commented on YARN-2405: -- Thanks for your comment, Gera. Yes, I'm creati

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-27 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111952#comment-14111952 ] Tsuyoshi OZAWA commented on YARN-1326: -- Thanks for your review, Karthik :-) > RM shou

[jira] [Assigned] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA reassigned YARN-2405: Assignee: Tsuyoshi OZAWA > NPE in FairSchedulerAppsBlock (scheduler page) >

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111761#comment-14111761 ] Tsuyoshi OZAWA commented on YARN-2405: -- [~maysamyabandeh], It's a bit tricky to throw

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111757#comment-14111757 ] Tsuyoshi OZAWA commented on YARN-2405: -- [~maysamyabandeh], [~hex108], I got the proble

[jira] [Commented] (YARN-2405) NPE in FairSchedulerAppsBlock (scheduler page)

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14111710#comment-14111710 ] Tsuyoshi OZAWA commented on YARN-2405: -- Hi [~maysamyabandeh], could you tell us the ve

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110483#comment-14110483 ] Tsuyoshi OZAWA commented on YARN-2454: -- [~yxls123123], please generate your patch at r

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110415#comment-14110415 ] Tsuyoshi OZAWA commented on YARN-2454: -- Also, the first testCompareToWithNoneResource

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-26 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110413#comment-14110413 ] Tsuyoshi OZAWA commented on YARN-2454: -- Oops, you're right. Could you update it? > Th

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110404#comment-14110404 ] Tsuyoshi OZAWA commented on YARN-2454: -- sorry, testCompareToWithNoneResource is wrong.

[jira] [Commented] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110402#comment-14110402 ] Tsuyoshi OZAWA commented on YARN-2454: -- Thanks for your contribution, [~beckham007]. T

[jira] [Updated] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2454: - Assignee: (was: Tsuyoshi OZAWA) > The function compareTo of variable UNBOUNDED in > org.apach

[jira] [Assigned] (YARN-2454) The function compareTo of variable UNBOUNDED in org.apache.hadoop.yarn.util.resource.Resources is definited wrong.

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA reassigned YARN-2454: Assignee: Tsuyoshi OZAWA > The function compareTo of variable UNBOUNDED in > org.apache.had

[jira] [Commented] (YARN-2452) TestRMApplicationHistoryWriter is failed for FairScheduler

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110378#comment-14110378 ] Tsuyoshi OZAWA commented on YARN-2452: -- Thanks for your explanation. I don't know why

[jira] [Commented] (YARN-2452) TestRMApplicationHistoryWriter is failed for FairScheduler

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110340#comment-14110340 ] Tsuyoshi OZAWA commented on YARN-2452: -- Thanks for your contribution, [~zxu]. This is

[jira] [Commented] (YARN-2406) Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14110269#comment-14110269 ] Tsuyoshi OZAWA commented on YARN-2406: -- The test failure looks not related to a patch.

[jira] [Assigned] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA reassigned YARN-2404: Assignee: Tsuyoshi OZAWA > Remove ApplicationAttemptState and ApplicationState class in RMSt

[jira] [Updated] (YARN-2406) Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2406: - Attachment: YARN-2406.1.patch > Move RM recovery related proto to yarn_server_resourcemanager_reco

[jira] [Assigned] (YARN-2406) Move RM recovery related proto to yarn_server_resourcemanager_recovery.proto

2014-08-25 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA reassigned YARN-2406: Assignee: Tsuyoshi OZAWA > Move RM recovery related proto to yarn_server_resourcemanager_rec

[jira] [Commented] (YARN-2427) Add support for moving apps between queues in RM web services

2014-08-24 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14108787#comment-14108787 ] Tsuyoshi OZAWA commented on YARN-2427: -- Hi [~vvasudev], how about calling rm.stop in t

[jira] [Updated] (YARN-2182) Update ContainerId#toString() to avoid conflicts before and after RM restart

2014-08-23 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2182: - Attachment: YARN-2182.2.patch Updated to address Jian's comment. > Update ContainerId#toString()

[jira] [Commented] (YARN-2182) Update ContainerId#toString() to avoid conflicts before and after RM restart

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107893#comment-14107893 ] Tsuyoshi OZAWA commented on YARN-2182: -- s/Changed to prefix epoch to ContainerId#toStr

[jira] [Updated] (YARN-2182) Update ContainerId#toString() to avoid conflicts before and after RM restart

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2182: - Attachment: YARN-2182.1.patch Changed to prefix epoch to ContainerId#toString(). > Update Contain

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.9.patch Refreshed a patch. > Mark Idempotent/AtMostOnce annotations to Appl

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14107823#comment-14107823 ] Tsuyoshi OZAWA commented on YARN-1326: -- A patch is ready for review. [~kkambatl], . co

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.4.patch Fixed failures of TestRMWebServices. > RM should log using RMStore

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.3.patch Thanks for your review, Karthik. I confirmed that we can do it witho

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105292#comment-14105292 ] Tsuyoshi OZAWA commented on YARN-1879: -- Thank you for pinging, [~rohithsharma]. I'm re

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105215#comment-14105215 ] Tsuyoshi OZAWA commented on YARN-1326: -- demo.png shows how the Web UI changes with the

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.2.patch Updated to address Karthik's comment: 1. Updated to log in RMStateS

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-21 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: demo.png > RM should log using RMStore at startup time > -

[jira] [Commented] (YARN-1919) Potential NPE in EmbeddedElectorService#stop

2014-08-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104696#comment-14104696 ] Tsuyoshi OZAWA commented on YARN-1919: -- Thanks Jian and Karthik for your review. > Po

[jira] [Commented] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104661#comment-14104661 ] Tsuyoshi OZAWA commented on YARN-2035: -- Hi [~jeagles], how about adding tests as follo

[jira] [Commented] (YARN-1919) Log yarn.resourcemanager.cluster-id is required for HA instead of throwing NPE

2014-08-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14104464#comment-14104464 ] Tsuyoshi OZAWA commented on YARN-1919: -- [~kkambatl], could you take a look, please? >

[jira] [Commented] (YARN-2345) yarn rmadmin -report

2014-08-19 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14103237#comment-14103237 ] Tsuyoshi OZAWA commented on YARN-2345: -- [~haogao], yes, it's all yours. > yarn rmadmi

[jira] [Updated] (YARN-1514) Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HA

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1514: - Attachment: YARN-1514.5.patch > Utility to benchmark ZKRMStateStore#loadState for ResourceManager-

[jira] [Updated] (YARN-1514) Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HA

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1514: - Attachment: YARN-1514.4.patch Fixed the test failure. > Utility to benchmark ZKRMStateStore#loadS

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14100444#comment-14100444 ] Tsuyoshi OZAWA commented on YARN-1326: -- Thanks for your review, Karthik and Vinod. I'l

[jira] [Updated] (YARN-1514) Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HA

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1514: - Attachment: YARN-1514.4.patch Forgot to add YarnTestDriver.java. This patch includes it. > Utilit

[jira] [Commented] (YARN-1348) Batching optimization for ZKRMStateStore

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14100394#comment-14100394 ] Tsuyoshi OZAWA commented on YARN-1348: -- This ticket looks deprecated and has been impl

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Affects Version/s: 2.5.0 > RM should log using RMStore at startup time > -

[jira] [Resolved] (YARN-1348) Batching optimization for ZKRMStateStore

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA resolved YARN-1348. -- Resolution: Fixed > Batching optimization for ZKRMStateStore > -

[jira] [Updated] (YARN-1514) Utility to benchmark ZKRMStateStore#loadState for ResourceManager-HA

2014-08-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1514: - Attachment: YARN-1514.3.patch Refreshed the v2 patch on trunk. > Utility to benchmark ZKRMStateSt

[jira] [Updated] (YARN-1919) Log yarn.resourcemanager.cluster-id is required for HA instead of throwing NPE

2014-08-17 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1919: - Attachment: YARN-1919.2.patch Refreshed a patch on trunk. > Log yarn.resourcemanager.cluster-id i

[jira] [Updated] (YARN-1919) Log yarn.resourcemanager.cluster-id is required for HA instead of throwing NPE

2014-08-17 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1919: - Affects Version/s: 2.5.0 > Log yarn.resourcemanager.cluster-id is required for HA instead of throw

[jira] [Updated] (YARN-2077) JobImpl#makeUberDecision doesn't log that Uber mode is disabled because of too much CPUs

2014-08-17 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2077: - Affects Version/s: 2.5.0 > JobImpl#makeUberDecision doesn't log that Uber mode is disabled because

[jira] [Commented] (YARN-2422) yarn.scheduler.maximum-allocation-mb should not be hard-coded in yarn-default.xml

2014-08-16 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099752#comment-14099752 ] Tsuyoshi OZAWA commented on YARN-2422: -- This change looks reasonable to me. +1(non-bin

[jira] [Commented] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14099255#comment-14099255 ] Tsuyoshi OZAWA commented on YARN-659: - Thanks for you comment, Jian. I agree with you. I

[jira] [Updated] (YARN-1156) Change NodeManager AllocatedGB and AvailableGB metrics to show decimal values

2014-08-15 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1156: - Attachment: YARN-1156.2.patch Refreshed a patch. > Change NodeManager AllocatedGB and AvailableGB

[jira] [Updated] (YARN-2229) ContainerId can overflow with RM restart

2014-08-14 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2229: - Attachment: YARN-2229.12.patch Thanks for your notification, Jian. Refreshed a patch. > Container

[jira] [Commented] (YARN-1918) Typo in description and error message for 'yarn.resourcemanager.cluster-id'

2014-08-14 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14097951#comment-14097951 ] Tsuyoshi OZAWA commented on YARN-1918: -- Thanks for your review, Allen. > Typo in desc

[jira] [Commented] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094958#comment-14094958 ] Tsuyoshi OZAWA commented on YARN-659: - [~jianhe] [~kkambatl] could you take a look, plea

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094957#comment-14094957 ] Tsuyoshi OZAWA commented on YARN-2229: -- Thanks for your review, Jian. OK, it sounds re

[jira] [Commented] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14094882#comment-14094882 ] Tsuyoshi OZAWA commented on YARN-659: - The test failure is not related to this patch, an

[jira] [Updated] (YARN-659) RMStateStore's removeApplication APIs should just take an applicationId

2014-08-12 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-659: Attachment: YARN-659.5.patch Rebased on trunk. > RMStateStore's removeApplication APIs should just t

[jira] [Updated] (YARN-1813) Better error message for "yarn logs" when permission denied

2014-08-11 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1813: - Attachment: YARN-1813.4.patch Refreshed the latest patch. > Better error message for "yarn logs"

[jira] [Commented] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-08-10 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14092425#comment-14092425 ] Tsuyoshi OZAWA commented on YARN-1954: -- Thank you for your review and comments, Zhijie

[jira] [Updated] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-08-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1954: - Attachment: YARN-1954.7.patch > Add waitFor to AMRMClient(Async) > ---

[jira] [Updated] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-08-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1954: - Attachment: YARN-1954.7.patch > Add waitFor to AMRMClient(Async) > ---

[jira] [Updated] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-08-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1954: - Attachment: (was: YARN-1954.7.patch) > Add waitFor to AMRMClient(Async) >

[jira] [Updated] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-08-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1954: - Attachment: (was: YARN-1954.6.patch) > Add waitFor to AMRMClient(Async) >

[jira] [Updated] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-08-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1954: - Attachment: YARN-1954.6.patch Thanks for your review, Zhijie. Updated: 1. Removed AMRMClient(Async

[jira] [Commented] (YARN-2130) Cleanup: Adding getRMAppManager, getQueueACLsManager, getApplicationACLsManager to RMContext

2014-08-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087851#comment-14087851 ] Tsuyoshi OZAWA commented on YARN-2130: -- [~kkambatl], could you check the latest patch?

[jira] [Commented] (YARN-2359) Application is hung without timeout and retry after DNS/network is down.

2014-08-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087848#comment-14087848 ] Tsuyoshi OZAWA commented on YARN-2359: -- +1(non-binding), it looks good to me. Also ran

[jira] [Commented] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

2014-08-06 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14087827#comment-14087827 ] Tsuyoshi OZAWA commented on YARN-2352: -- I found same test failure by "java.net.Unknown

<    4   5   6   7   8   9   10   11   12   13   >