[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v2.patch The findbug issue is not related to this patch. However, fix it in v2 patch

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072946#comment-14072946 ] Hadoop QA commented on YARN-2347: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2172) Suspend/Resume Hadoop Jobs

2014-07-24 Thread Richard Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Richard Chen updated YARN-2172: --- Attachment: Hadoop Job Suspend Resume Design.docx Design Document for Hadoop Job Suspend/Resume Implem

[jira] [Updated] (YARN-1063) Winutils needs ability to create task as domain user

2014-07-24 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated YARN-1063: --- Attachment: (was: YARN-1063.5.patch) > Winutils needs ability to create task as domain user >

[jira] [Updated] (YARN-1063) Winutils needs ability to create task as domain user

2014-07-24 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated YARN-1063: --- Attachment: YARN-1063.5.patch I have reloaded patch .5. The previous upload had a whitespace diff that

[jira] [Commented] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

2014-07-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072986#comment-14072986 ] Akira AJISAKA commented on YARN-2336: - The patch looks mostly good. I built a pseudo-di

[jira] [Commented] (YARN-1050) Document the Fair Scheduler REST API

2014-07-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14072990#comment-14072990 ] Akira AJISAKA commented on YARN-1050: - [~kj-ki], thank you for filing a JIRA and creati

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073008#comment-14073008 ] Hadoop QA commented on YARN-1063: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-24 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073030#comment-14073030 ] Tsuyoshi OZAWA commented on YARN-2229: -- [~sseth], thanks for your comment. [~jianhe],

[jira] [Commented] (YARN-2313) Livelock can occur in FairScheduler when there are lots of running apps

2014-07-24 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073031#comment-14073031 ] Tsuyoshi OZAWA commented on YARN-2313: -- [~kkambatl], thank you for your suggestion. It

[jira] [Updated] (YARN-1063) Winutils needs ability to create task as domain user

2014-07-24 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Remus Rusanu updated YARN-1063: --- Attachment: YARN-1063.6.patch patch .6 fixes the extra warning. the IPC test failure I believe is infr

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073094#comment-14073094 ] Hudson commented on YARN-1342: -- FAILURE: Integrated in Hadoop-Yarn-trunk #622 (See [https://b

[jira] [Commented] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073100#comment-14073100 ] Hudson commented on YARN-2300: -- FAILURE: Integrated in Hadoop-Yarn-trunk #622 (See [https://b

[jira] [Commented] (YARN-2147) client lacks delegation token exception details when application submit fails

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073098#comment-14073098 ] Hudson commented on YARN-2147: -- FAILURE: Integrated in Hadoop-Yarn-trunk #622 (See [https://b

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v3.patch Sync patch with latest trunk. > Consolidate RMStateVersion and NMDBSchemaV

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073115#comment-14073115 ] Junping Du commented on YARN-1354: -- Just like [~devaraj.k]'s above comments, [~jlowe], wou

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073123#comment-14073123 ] Hadoop QA commented on YARN-1063: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-07-24 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073143#comment-14073143 ] Remus Rusanu commented on YARN-1063: TestIPC.testRetryProxy passes for me locally with

[jira] [Commented] (YARN-2349) InvalidStateTransitonException after RM switch

2014-07-24 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073158#comment-14073158 ] Rohith commented on YARN-2349: -- This is basically configurations in capacity-scheduler.xml of

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073161#comment-14073161 ] Hadoop QA commented on YARN-2347: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2147) client lacks delegation token exception details when application submit fails

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073209#comment-14073209 ] Hudson commented on YARN-2147: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1814 (See [https://

[jira] [Commented] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073211#comment-14073211 ] Hudson commented on YARN-2300: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1814 (See [https://

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073205#comment-14073205 ] Hudson commented on YARN-1342: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1814 (See [https://

[jira] [Created] (YARN-2350) TestApplicationMasterServiceOnHA fails with InvalidToken exception

2014-07-24 Thread Ted Yu (JIRA)
Ted Yu created YARN-2350: Summary: TestApplicationMasterServiceOnHA fails with InvalidToken exception Key: YARN-2350 URL: https://issues.apache.org/jira/browse/YARN-2350 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-2348) ResourceManager web UI should display locale time instead of UTC time

2014-07-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073218#comment-14073218 ] Allen Wittenauer commented on YARN-2348: -1 as written. Properly set up servers ty

[jira] [Comment Edited] (YARN-2348) ResourceManager web UI should display locale time instead of UTC time

2014-07-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073218#comment-14073218 ] Allen Wittenauer edited comment on YARN-2348 at 7/24/14 2:07 PM:

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073263#comment-14073263 ] Hudson commented on YARN-1342: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1841 (See [htt

[jira] [Commented] (YARN-2300) Document better sample requests for RM web services for submitting apps

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073269#comment-14073269 ] Hudson commented on YARN-2300: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1841 (See [htt

[jira] [Commented] (YARN-2147) client lacks delegation token exception details when application submit fails

2014-07-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073267#comment-14073267 ] Hudson commented on YARN-2147: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1841 (See [htt

[jira] [Created] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-07-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2351: - Summary: YARN CLI should provide a command to list the configurations in use Key: YARN-2351 URL: https://issues.apache.org/jira/browse/YARN-2351 Project: Hadoop YARN

[jira] [Commented] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-07-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073324#comment-14073324 ] Allen Wittenauer commented on YARN-2351: hdfs already has getconf, so this should b

[jira] [Commented] (YARN-2348) ResourceManager web UI should display locale time instead of UTC time

2014-07-24 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073328#comment-14073328 ] Alejandro Abdelnur commented on YARN-2348: -- Allen suggestion of making selectable

[jira] [Commented] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-07-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073334#comment-14073334 ] Zhijie Shen commented on YARN-2351: --- Noticed that. Agree that we can do the similar thing

[jira] [Commented] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-07-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073348#comment-14073348 ] Allen Wittenauer commented on YARN-2351: The big thing is consistency... so you're

[jira] [Commented] (YARN-2313) Livelock can occur in FairScheduler when there are lots of running apps

2014-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073455#comment-14073455 ] Karthik Kambatla commented on YARN-2313: [~ozawa] - thanks. I have started looking

[jira] [Commented] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

2014-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073467#comment-14073467 ] Karthik Kambatla commented on YARN-2352: Once this is done, we can look into gettin

[jira] [Created] (YARN-2352) FairScheduler: Collect metrics on duration of critical methods that affect performance

2014-07-24 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2352: -- Summary: FairScheduler: Collect metrics on duration of critical methods that affect performance Key: YARN-2352 URL: https://issues.apache.org/jira/browse/YARN-2352

[jira] [Created] (YARN-2353) FairScheduler: Update demand asynchronously instead of in the Update Thread

2014-07-24 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-2353: -- Summary: FairScheduler: Update demand asynchronously instead of in the Update Thread Key: YARN-2353 URL: https://issues.apache.org/jira/browse/YARN-2353 Project:

[jira] [Assigned] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-24 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chang li reassigned YARN-2308: -- Assignee: chang li > NPE happened when RM restart after CapacityScheduler queue configuration > changed

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073550#comment-14073550 ] Jian He commented on YARN-2211: --- - This code not needed? may remove the newInstance() method

[jira] [Created] (YARN-2354) DistributedShell may allocate more containers than client specified after it restarts

2014-07-24 Thread Jian He (JIRA)
Jian He created YARN-2354: - Summary: DistributedShell may allocate more containers than client specified after it restarts Key: YARN-2354 URL: https://issues.apache.org/jira/browse/YARN-2354 Project: Hadoop Y

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-24 Thread chang li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073574#comment-14073574 ] chang li commented on YARN-2308: I am working on it > NPE happened when RM restart after C

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073577#comment-14073577 ] Xuan Gong commented on YARN-2211: - bq. This code not needed? may remove the newInstance() m

[jira] [Updated] (YARN-1336) Work-preserving nodemanager restart

2014-07-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1336: - Attachment: YARN-1336-rollup-v2.patch Refreshing the rollup patch to latest trunk so it's easier for peopl

[jira] [Commented] (YARN-2328) FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped

2014-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073687#comment-14073687 ] Karthik Kambatla commented on YARN-2328: As per the discussion on YARN-2313, it mig

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-24 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073727#comment-14073727 ] Mayank Bansal commented on YARN-2069: - Thanks [~vinodkv] for the review. I have change

[jira] [Updated] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-24 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2069: Attachment: YARN-2069-trunk-6.patch > CS queue level preemption should respect user-limits > ---

[jira] [Updated] (YARN-1354) Recover applications upon nodemanager restart

2014-07-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1354: - Attachment: YARN-1354-v4.patch Thanks for the interest, Devaraj and Junping! I updated patch to trunk. >

[jira] [Assigned] (YARN-2354) DistributedShell may allocate more containers than client specified after it restarts

2014-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-2354: --- Assignee: Li Lu > DistributedShell may allocate more containers than client specified after it > restarts > -

[jira] [Updated] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-24 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-415: Attachment: YARN-415.201407242148.txt [~leftnoteasy] Thank you very much for helping me review this. {quote

[jira] [Updated] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-24 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-2069: Attachment: YARN-2069-trunk-7.patch Updated patch Thanks, Mayank > CS queue level preemption shoul

[jira] [Updated] (YARN-2328) FairScheduler: Verify update and continuous scheduling threads are stopped when the scheduler is stopped

2014-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2328: --- Attachment: yarn-2328-preview.patch Here is a preview patch that introduces FSBackgroundTasksR

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.7.patch > RMStateStore needs to save AMRMToken master key for recovery when RM > rest

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073791#comment-14073791 ] Xuan Gong commented on YARN-2211: - new patch addressed all latest comments > RMStateStore

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073874#comment-14073874 ] Hadoop QA commented on YARN-2211: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2211: Attachment: YARN-2211.7.1.patch > RMStateStore needs to save AMRMToken master key for recovery when RM > re

[jira] [Commented] (YARN-2335) Annotate all hadoop-sls APIs as @Private

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073896#comment-14073896 ] Hadoop QA commented on YARN-2335: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073899#comment-14073899 ] Wangda Tan commented on YARN-2308: -- [~lichangleo], thanks for working on it! Looking forwa

[jira] [Updated] (YARN-2209) Replace allocate#resync command with ApplicationMasterNotRegisteredException to indicate AM to re-register on RM restart

2014-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2209: -- Attachment: YARN-2209.2.patch Patch rebased on trunk > Replace allocate#resync command with ApplicationMasterNo

[jira] [Updated] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-24 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-1994: -- Attachment: YARN-1994.7.patch Remove file which has no actual changes, which also seems to be breaking J

[jira] [Commented] (YARN-2209) Replace allocate#resync command with ApplicationMasterNotRegisteredException to indicate AM to re-register on RM restart

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073918#comment-14073918 ] Hadoop QA commented on YARN-2209: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

2014-07-24 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073921#comment-14073921 ] Karthik Kambatla commented on YARN-2214: Patch looks mostly good. One nit: can we m

[jira] [Updated] (YARN-2209) Replace allocate#resync command with ApplicationMasterNotRegisteredException to indicate AM to re-register on RM restart

2014-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2209: -- Attachment: YARN-2209.3.patch > Replace allocate#resync command with ApplicationMasterNotRegisteredException >

[jira] [Commented] (YARN-2211) RMStateStore needs to save AMRMToken master key for recovery when RM restart/failover happens

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073940#comment-14073940 ] Hadoop QA commented on YARN-2211: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2338) service assemble so complex

2014-07-24 Thread dingjiaqi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dingjiaqi updated YARN-2338: Priority: Critical (was: Major) > service assemble so complex > --- > >

[jira] [Updated] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

2014-07-24 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenji Kikushima updated YARN-2336: -- Attachment: YARN-2336-3.patch Thanks for review, [~ajisakaa]. Updated for comments. - Removed un

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073967#comment-14073967 ] Hadoop QA commented on YARN-1994: - {color:green}+1 overall{color}. Here are the results of

[jira] [Assigned] (YARN-2349) InvalidStateTransitonException after RM switch

2014-07-24 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2349: Assignee: Rohith > InvalidStateTransitonException after RM switch >

[jira] [Commented] (YARN-2350) TestApplicationMasterServiceOnHA fails with InvalidToken exception

2014-07-24 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073973#comment-14073973 ] Rohith commented on YARN-2350: -- This issue is because of YARN-2208 check in. As a wholse solut

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073981#comment-14073981 ] Zhijie Shen commented on YARN-2247: --- +1 except some nits: 1. I meant RM has the same pro

[jira] [Commented] (YARN-2209) Replace allocate#resync command with ApplicationMasterNotRegisteredException to indicate AM to re-register on RM restart

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073999#comment-14073999 ] Hadoop QA commented on YARN-2209: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Created] (YARN-2355) MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container

2014-07-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2355: - Summary: MAX_APP_ATTEMPTS_ENV may no longer be a useful env var for a container Key: YARN-2355 URL: https://issues.apache.org/jira/browse/YARN-2355 Project: Hadoop YARN

[jira] [Commented] (YARN-1336) Work-preserving nodemanager restart

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074010#comment-14074010 ] Junping Du commented on YARN-1336: -- Good work, [~jlowe]! Thanks for sharing. > Work-prese

[jira] [Commented] (YARN-2313) Livelock can occur in FairScheduler when there are lots of running apps

2014-07-24 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074018#comment-14074018 ] Tsuyoshi OZAWA commented on YARN-2313: -- Great. I'll check it. > Livelock can occur in

[jira] [Commented] (YARN-2336) Fair scheduler REST api returns a missing '[' bracket JSON for deep queue tree

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074033#comment-14074033 ] Hadoop QA commented on YARN-2336: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

2014-07-24 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashwin Shankar updated YARN-2214: - Attachment: YARN-2214-v2.txt > preemptContainerPreCheck() in FSParentQueue delays convergence towa

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

2014-07-24 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074039#comment-14074039 ] Ashwin Shankar commented on YARN-2214: -- Thanks [~kasha] ! Patch refreshed. > preemptC

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2247: Attachment: apache-yarn-2247.5.patch {quote} 1. I meant RM has the same problem, and we need to do n

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074063#comment-14074063 ] Jian He commented on YARN-2229: --- bq. ContainerTokenIdentifier serializes a long (getContainer

[jira] [Commented] (YARN-2214) preemptContainerPreCheck() in FSParentQueue delays convergence towards fairness

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074073#comment-14074073 ] Hadoop QA commented on YARN-2214: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074082#comment-14074082 ] Hadoop QA commented on YARN-2247: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074094#comment-14074094 ] Wangda Tan commented on YARN-415: - Hi Eric, Thanks for updating your patch again, *To your

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074104#comment-14074104 ] Jian He commented on YARN-2298: --- Maybe it's better to add dependency on yarn-client module in

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-07-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074145#comment-14074145 ] Zhijie Shen commented on YARN-2298: --- I agree this is not an idea solution to split a pack