[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

2013-12-02 Thread qingwu.fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836372#comment-13836372 ] qingwu.fu commented on YARN-1458: - We have test our suspicious of points, and it doesn't

[jira] [Updated] (YARN-1019) YarnConfiguration validation for local disk path and http addresses.

2013-12-02 Thread Rekha Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rekha Joshi updated YARN-1019: -- Attachment: YARN-1019.0.patch YarnConfiguration validation for local disk path and http addresses.

[jira] [Commented] (YARN-1019) YarnConfiguration validation for local disk path and http addresses.

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836397#comment-13836397 ] Hadoop QA commented on YARN-1019: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1390) Provide a way to capture source of an application to be queried through REST or Java Client APIs

2013-12-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836410#comment-13836410 ] Steve Loughran commented on YARN-1390: -- # Some limits on tag size is going to be

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2013-12-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836701#comment-13836701 ] Zhijie Shen commented on YARN-1445: --- 1. I agree on the most plans about dealing with

[jira] [Assigned] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang reassigned YARN-1463: --- Assignee: Binglin Chang TestContainerManagerSecurity#testContainerManager fails

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836713#comment-13836713 ] Binglin Chang commented on YARN-1463: - HDFS-5545 introduced this bug: when decide

[jira] [Updated] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Binglin Chang updated YARN-1463: Attachment: YARN-1463.v1.patch Attach patch with simple fix, the test can succeed now.

[jira] [Commented] (YARN-1390) Provide a way to capture source of an application to be queried through REST or Java Client APIs

2013-12-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836723#comment-13836723 ] Alejandro Abdelnur commented on YARN-1390: -- Agree with Steve, we should limit the

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836734#comment-13836734 ] Hadoop QA commented on YARN-1463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

2013-12-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836740#comment-13836740 ] Zhijie Shen commented on YARN-1446: --- Hm... I see. The patch is generally good. I've the

[jira] [Commented] (YARN-1458) hadoop2.2.0 fairscheduler ResourceManager Event Processor thread blocked

2013-12-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836747#comment-13836747 ] Sandy Ryza commented on YARN-1458: -- If size based weight is turned on and an app has 0

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2013-12-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1458: - Summary: In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely (was:

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2013-12-02 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1458: - Description: The ResourceManager$SchedulerEventDispatcher$EventProcessor blocked when clients submit

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836804#comment-13836804 ] Zhijie Shen commented on YARN-967: -- The aforementioned issues are fixed in the last patch

[jira] [Updated] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1462: --- Summary: AHS API and other AHS changes to handle tags for completed MR jobs (was: AHS API

[jira] [Created] (YARN-1465) define and add shared constants and utilities for the shared cache

2013-12-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1465: - Summary: define and add shared constants and utilities for the shared cache Key: YARN-1465 URL: https://issues.apache.org/jira/browse/YARN-1465 Project: Hadoop YARN

[jira] [Commented] (YARN-1390) Provide a way to capture source of an application to be queried through REST or Java Client APIs

2013-12-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836823#comment-13836823 ] Steve Loughran commented on YARN-1390: -- oh and restrict the tag names to stuff that

[jira] [Created] (YARN-1466) implement the cleaner service for the shared cache

2013-12-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1466: - Summary: implement the cleaner service for the shared cache Key: YARN-1466 URL: https://issues.apache.org/jira/browse/YARN-1466 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-1467) implement checksum verification for resource localization service for the shared cache

2013-12-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1467: - Summary: implement checksum verification for resource localization service for the shared cache Key: YARN-1467 URL: https://issues.apache.org/jira/browse/YARN-1467

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836829#comment-13836829 ] Karthik Kambatla commented on YARN-1399: From discussion on YARN-1390: The tags

[jira] [Commented] (YARN-1390) Provide a way to capture source of an application to be queried through REST or Java Client APIs

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836831#comment-13836831 ] Karthik Kambatla commented on YARN-1390: Agree with Steve and Alejandro. Copied the

[jira] [Updated] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1445: Attachment: YARN-1445.3.patch Separate FINISHING and FINISHED state in YarnApplicationState

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836841#comment-13836841 ] Xuan Gong commented on YARN-1445: - bq. I've the different opinion here. RMAppImpl actually

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2013-12-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836847#comment-13836847 ] Zhijie Shen commented on YARN-1399: --- I agree we should have the limits for the number of

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836857#comment-13836857 ] Jian He commented on YARN-1446: --- Thanks zhijie for the review. bq. Ago, app can be killed at

[jira] [Updated] (YARN-1446) Change killing application to wait until state store is done

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1446: -- Attachment: YARN-1446.2.patch Change killing application to wait until state store is done

[jira] [Commented] (YARN-291) [Umbrella] Dynamic resource configuration

2013-12-02 Thread Cindy Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836883#comment-13836883 ] Cindy Li commented on YARN-291: --- Junping, just saw your comments on YARN-999 . I can help on

[jira] [Commented] (YARN-1287) Consolidate MockClocks

2013-12-02 Thread Sebastian Wong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836892#comment-13836892 ] Sebastian Wong commented on YARN-1287: -- Where should the new MockClock class be placed

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836894#comment-13836894 ] Xuan Gong commented on YARN-1028: - bq. It might appear so, but the actual wait time is

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836918#comment-13836918 ] Hadoop QA commented on YARN-1446: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1442) change yarn minicluster base directory via system property

2013-12-02 Thread Mark Miller (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836941#comment-13836941 ] Mark Miller commented on YARN-1442: --- +1 - The Apache Solr project runs Yarn in it's tests

[jira] [Updated] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-895: - Summary: RM crashes if it restarts while the state-store is down (was: RM crashes

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836960#comment-13836960 ] Hadoop QA commented on YARN-1445: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1459) Handle supergroups, usergroups and ACLs across RMs during failover

2013-12-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836966#comment-13836966 ] Vinod Kumar Vavilapalli commented on YARN-1459: --- As I was trying to indicate

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836975#comment-13836975 ] Karthik Kambatla commented on YARN-1399: bq. Moreover, in general, IMHO, user

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2013-12-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836980#comment-13836980 ] Alejandro Abdelnur commented on YARN-1399: -- What is the concern for a tag being a

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836987#comment-13836987 ] Haohui Mai commented on YARN-1463: -- Can you please explain why it is broken? -- Jenkins

[jira] [Commented] (YARN-1318) Promote AdminService to an Always-On service and merge in RMHAProtocolService

2013-12-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13836999#comment-13836999 ] Hudson commented on YARN-1318: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4817 (See

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837002#comment-13837002 ] Mayank Bansal commented on YARN-967: [~vinodkv] sorry missed your comments Attaching

[jira] [Updated] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-967: --- Attachment: YARN-967-12.patch [YARN-321] Command Line Interface(CLI) for Reading Application History

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837011#comment-13837011 ] Hadoop QA commented on YARN-967: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2013-12-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837020#comment-13837020 ] Zhijie Shen commented on YARN-1399: --- bq. What is the concern for a tag being a valid

[jira] [Commented] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837027#comment-13837027 ] Jian He commented on YARN-895: -- Fixed the comments bq. Test: In the HDFS test, you don't wait

[jira] [Updated] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-895: - Attachment: YARN-895.4.patch RM crashes if it restarts while the state-store is down

[jira] [Assigned] (YARN-1147) Add end-to-end tests for HA

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1147: --- Assignee: Xuan Gong Add end-to-end tests for HA --- Key:

[jira] [Assigned] (YARN-1459) Handle supergroups, usergroups and ACLs across RMs during failover

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1459: --- Assignee: Xuan Gong Handle supergroups, usergroups and ACLs across RMs during failover

[jira] [Assigned] (YARN-1325) RMHAProtocolService#serviceInit should check configuration contains multiple RM

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1325: --- Assignee: Xuan Gong RMHAProtocolService#serviceInit should check configuration contains multiple

[jira] [Assigned] (YARN-1410) Handle client failover during 2 step client API's like app submission

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1410: --- Assignee: Xuan Gong Handle client failover during 2 step client API's like app submission

[jira] [Assigned] (YARN-1125) Add shutdown support to non-service RM components

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-1125: --- Assignee: Xuan Gong Add shutdown support to non-service RM components

[jira] [Commented] (YARN-1399) Allow users to annotate an application with multiple tags

2013-12-02 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837031#comment-13837031 ] Alejandro Abdelnur commented on YARN-1399: -- I would stick to exact tag match. Case

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837040#comment-13837040 ] Vinod Kumar Vavilapalli commented on YARN-1463: --- After YARN-1318, the

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2013-12-02 Thread qingwu.fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837050#comment-13837050 ] qingwu.fu commented on YARN-1458: - Thanks Sandy. We were confused by your point that If

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837051#comment-13837051 ] Karthik Kambatla commented on YARN-1181: The failing tests are unrelated -

[jira] [Updated] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-895: - Attachment: YARN-895.4.patch Missed the change in yarn-default.xml RM crashes if it restarts while the

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837054#comment-13837054 ] Mayank Bansal commented on YARN-967: Thanks [~vinodkv] for review. Updated the java

[jira] [Updated] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-967: --- Attachment: YARN-967-13.patch [YARN-321] Command Line Interface(CLI) for Reading Application History

[jira] [Commented] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837059#comment-13837059 ] Hadoop QA commented on YARN-895: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-967) [YARN-321] Command Line Interface(CLI) for Reading Application History Storage Data

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837057#comment-13837057 ] Hadoop QA commented on YARN-967: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837064#comment-13837064 ] Haohui Mai commented on YARN-1463: -- After the discussion with [~vinodkv], this is due to

[jira] [Commented] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837082#comment-13837082 ] Hadoop QA commented on YARN-895: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated YARN-1463: - Attachment: YARN-1463.000.patch TestContainerManagerSecurity#testContainerManager fails

[jira] [Updated] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-895: - Attachment: YARN-895.5.patch Misundertood the comment. Update the patch to sleep some time for client to get

[jira] [Updated] (YARN-1181) Augment MiniYARNCluster to support HA mode

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1181: --- Attachment: yarn-1181-4.patch Rebased on trunk post YARN-1318. Augment MiniYARNCluster to

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837144#comment-13837144 ] Karthik Kambatla commented on YARN-1028: In RMProxy, we build an exceptionPolicyMap

[jira] [Commented] (YARN-1125) Add shutdown support to non-service RM components

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837179#comment-13837179 ] Tsuyoshi OZAWA commented on YARN-1125: -- [~xgong], could you wait for taking this?

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837183#comment-13837183 ] Hadoop QA commented on YARN-1181: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837185#comment-13837185 ] Hadoop QA commented on YARN-1463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1301) Need to log the blacklist additions/removals when YarnSchedule#allocate

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1301: - Attachment: YARN-1301.5.patch Sorry for delay, updated a patch to check whether blacklist

[jira] [Commented] (YARN-1307) Rethink znode structure for RM HA

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837200#comment-13837200 ] Tsuyoshi OZAWA commented on YARN-1307: -- *ping* any comments are welcome. Rethink

[jira] [Commented] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837201#comment-13837201 ] Hadoop QA commented on YARN-895: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837211#comment-13837211 ] Jian He commented on YARN-1028: --- The assumption was to retry some connection related

[jira] [Commented] (YARN-895) RM crashes if it restarts while the state-store is down

2013-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837212#comment-13837212 ] Jian He commented on YARN-895: -- test failure not related RM crashes if it restarts while the

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837218#comment-13837218 ] Xuan Gong commented on YARN-1028: - Yes, I agree with [~jianhe]. We did make such

[jira] [Commented] (YARN-1301) Need to log the blacklist additions/removals when YarnSchedule#allocate

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837222#comment-13837222 ] Hadoop QA commented on YARN-1301: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-291) [Umbrella] Dynamic resource configuration

2013-12-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837238#comment-13837238 ] Junping Du commented on YARN-291: - Junping, just saw your comments on YARN-999 . I can help

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2013-12-02 Thread qingwu.fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qingwu.fu updated YARN-1458: Attachment: YARN-1458.patch In the Fair Scheduler, if size based weight is turned on, it will lead to

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837251#comment-13837251 ] Binglin Chang commented on YARN-1463: - Hi Haohui, I originally did the same as your

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837257#comment-13837257 ] Binglin Chang commented on YARN-1463: - Detail log: 2013-12-03 10:30:44,577 WARN

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2013-12-02 Thread qingwu.fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837255#comment-13837255 ] qingwu.fu commented on YARN-1458: - Hi Sandy, We have submitted the patch: YARN-1458.patch .

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837258#comment-13837258 ] Binglin Chang commented on YARN-1463: - We can see from the code, HttpServer does not

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837264#comment-13837264 ] Haohui Mai commented on YARN-1463: -- Based on the stack traces, it seems to me that

[jira] [Commented] (YARN-1301) Need to log the blacklist additions/removals when YarnSchedule#allocate

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837269#comment-13837269 ] Tsuyoshi OZAWA commented on YARN-1301: -- [~zjshen], a patch is ready now. Could you

[jira] [Commented] (YARN-321) Generic application history service

2013-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837276#comment-13837276 ] Jeff Zhang commented on YARN-321: - Will this jira been included in the next release ?

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837278#comment-13837278 ] Binglin Chang commented on YARN-1463: - bq. Webapps enables spnego authentication when

[jira] [Commented] (YARN-321) Generic application history service

2013-12-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837281#comment-13837281 ] Jeff Zhang commented on YARN-321: - Another question about this jira. I found that the

[jira] [Created] (YARN-1468) TestRMRestart.testRMRestartWaitForPreviousAMToFinish get failed.

2013-12-02 Thread Junping Du (JIRA)
Junping Du created YARN-1468: Summary: TestRMRestart.testRMRestartWaitForPreviousAMToFinish get failed. Key: YARN-1468 URL: https://issues.apache.org/jira/browse/YARN-1468 Project: Hadoop YARN

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837303#comment-13837303 ] Haohui Mai commented on YARN-1463: -- This is fine with me, but the test is broken then.

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Binglin Chang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837310#comment-13837310 ] Binglin Chang commented on YARN-1463: - bq. but the test is broken then I am sorry. What

[jira] [Commented] (YARN-1468) TestRMRestart.testRMRestartWaitForPreviousAMToFinish get failed.

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837312#comment-13837312 ] Tsuyoshi OZAWA commented on YARN-1468: -- Maybe this is a timing bug: I cannot reproduce

[jira] [Updated] (YARN-1468) TestRMRestart.testRMRestartWaitForPreviousAMToFinish get failed.

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1468: - Description: Log is as following: {code} Tests run: 13, Failures: 1, Errors: 0, Skipped: 0, Time

[jira] [Updated] (YARN-1468) TestRMRestart.testRMRestartWaitForPreviousAMToFinish get failed.

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1468: - Description: Log is as following: {code} Tests run: 13, Failures: 1, Errors: 0, Skipped: 0, Time

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837320#comment-13837320 ] Haohui Mai commented on YARN-1463: -- I looked into TestContainerManagerSecurity. I'm not

[jira] [Commented] (YARN-126) yarn rmadmin help message contains reference to hadoop cli and JT

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837333#comment-13837333 ] Hadoop QA commented on YARN-126: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-862) ResourceManager and NodeManager versions should match on node registration or error out

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837330#comment-13837330 ] Hadoop QA commented on YARN-862: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837337#comment-13837337 ] Karthik Kambatla commented on YARN-1028: Verified on a cluster, writing a unit test

[jira] [Updated] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1028: --- Attachment: yarn-1028-2.patch Here is a new patch that introduces a pluggable failover model

[jira] [Commented] (YARN-1301) Need to log the blacklist additions/removals when YarnSchedule#allocate

2013-12-02 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837352#comment-13837352 ] Tsuyoshi OZAWA commented on YARN-1301: -- Do you mean we should record the number of

[jira] [Commented] (YARN-1463) TestContainerManagerSecurity#testContainerManager fails

2013-12-02 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837360#comment-13837360 ] Haohui Mai commented on YARN-1463: -- Just to clarify, I think we can fix the unit test in a

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

2013-12-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837359#comment-13837359 ] Hadoop QA commented on YARN-1028: - {color:red}-1 overall{color}. Here are the results of

  1   2   >