[jira] [Updated] (YARN-1478) It would be great if we can know which host(IP) the client submitted job in jobhistory web UI

[ https://issues.apache.org/jira/browse/YARN-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yangping wu updated YARN-1478: -- Remaining Estimate: 480h (was: 8h) Original Estimate: 480h (was: 8h) It would be great if we

[jira] [Created] (YARN-1478) It would be great if we can know which host(IP) the client submitted job in jobhistory web UI

yangping wu created YARN-1478: - Summary: It would be great if we can know which host(IP) the client submitted job in jobhistory web UI Key: YARN-1478 URL: https://issues.apache.org/jira/browse/YARN-1478

[jira] [Commented] (YARN-546) Allow disabling the Fair Scheduler event log

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841185#comment-13841185 ] Hudson commented on YARN-546: - FAILURE: Integrated in Hadoop-Yarn-trunk #413 (See

[jira] [Commented] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841182#comment-13841182 ] Hudson commented on YARN-1438: -- FAILURE: Integrated in Hadoop-Yarn-trunk #413 (See

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841186#comment-13841186 ] Hudson commented on YARN-1181: -- FAILURE: Integrated in Hadoop-Yarn-trunk #413 (See

[jira] [Commented] (YARN-1447) Common PB type definitions for container resizing

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841178#comment-13841178 ] Hudson commented on YARN-1447: -- FAILURE: Integrated in Hadoop-Yarn-trunk #413 (See

[jira] [Commented] (YARN-1473) Exception from container-launch(Apache Hadoop 2.2.0)

[ https://issues.apache.org/jira/browse/YARN-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841189#comment-13841189 ] Joy Xu commented on YARN-1473: -- actually，I have mailed it to user@maillist. but there is no

[jira] [Commented] (YARN-546) Allow disabling the Fair Scheduler event log

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841252#comment-13841252 ] Hudson commented on YARN-546: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #1630 (See

[jira] [Commented] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841249#comment-13841249 ] Hudson commented on YARN-1438: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1630 (See

[jira] [Commented] (YARN-1447) Common PB type definitions for container resizing

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841245#comment-13841245 ] Hudson commented on YARN-1447: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1630 (See

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841253#comment-13841253 ] Hudson commented on YARN-1181: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1630 (See

[jira] [Commented] (YARN-1447) Common PB type definitions for container resizing

[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841262#comment-13841262 ] Hudson commented on YARN-1447: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1604 (See

[jira] [Commented] (YARN-546) Allow disabling the Fair Scheduler event log

[ https://issues.apache.org/jira/browse/YARN-546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841269#comment-13841269 ] Hudson commented on YARN-546: - SUCCESS: Integrated in Hadoop-Hdfs-trunk #1604 (See

[jira] [Commented] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841266#comment-13841266 ] Hudson commented on YARN-1438: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1604 (See

[jira] [Commented] (YARN-1181) Augment MiniYARNCluster to support HA mode

[ https://issues.apache.org/jira/browse/YARN-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841270#comment-13841270 ] Hudson commented on YARN-1181: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1604 (See

[jira] [Commented] (YARN-1478) It would be great if we can know which host(IP) the client submitted job in jobhistory web UI

[ https://issues.apache.org/jira/browse/YARN-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841294#comment-13841294 ] Jason Lowe commented on YARN-1478: -- Note that while this is not available on the front

[jira] [Commented] (YARN-1438) When a container fails, the text of the exception isn't included in the diagnostics

[ https://issues.apache.org/jira/browse/YARN-1438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841299#comment-13841299 ] Steve Loughran commented on YARN-1438: -- [~ozawa] I'll put up a trace the next time i

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841369#comment-13841369 ] Wei Yan commented on YARN-1471: --- Sure. Thanks, [~curino]. Just let me know if I can help.

[jira] [Commented] (YARN-1450) TestUnmanagedAMLauncher#testDSShell fails on trunk

[ https://issues.apache.org/jira/browse/YARN-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841487#comment-13841487 ] Hudson commented on YARN-1450: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4845 (See

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841541#comment-13841541 ] Carlo Curino commented on YARN-1471: Wei, I posted a patch that implements the change

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1471: --- Attachment: YARN-1471.patch Patch implementing proposed change. The SLS simulator is not running

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841559#comment-13841559 ] Wei Yan commented on YARN-1471: --- Thanks, [~curino]. I'll test it locally. The SLS simulator

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated YARN-1471: - Attachment: SLSCapacityScheduler.java [~curino], how about the attached alternate impl

[jira] [Updated] (YARN-1446) Change killing application to wait until state store is done

[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1446: -- Attachment: YARN-1446.4.patch Change killing application to wait until state store is done

[jira] [Commented] (YARN-1023) [YARN-321] Webservices REST API's support for Application History

[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841591#comment-13841591 ] Mayank Bansal commented on YARN-1023: - Some Comments bq . testAppsQuery() How its

[jira] [Commented] (YARN-1405) RM should crash and print permission error for nonwritable/readable local path in yarn.resourcemanager.fs.state-store.uri

[ https://issues.apache.org/jira/browse/YARN-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841621#comment-13841621 ] Jian He commented on YARN-1405: --- The reason RM hangs on shutdown is because of the following

[jira] [Updated] (YARN-1405) RM should crash and print permission error for nonwritable/readable local path in yarn.resourcemanager.fs.state-store.uri

[ https://issues.apache.org/jira/browse/YARN-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1405: -- Attachment: rm-threaddump.out upload rm thread dump RM should crash and print permission error for

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841640#comment-13841640 ] Hadoop QA commented on YARN-1446: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1446) Change killing application to wait until state store is done

[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1446: -- Attachment: YARN-1446.5.patch The test failure is unrelated to this patch, but fixed it in this patch Change

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841660#comment-13841660 ] Jian He commented on YARN-1446: --- bq. Is it safe to mark it @Stable now? leave it as stable to

[jira] [Commented] (YARN-1139) [Umbrella] Convert all RM components to Services

[ https://issues.apache.org/jira/browse/YARN-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841672#comment-13841672 ] Vinod Kumar Vavilapalli commented on YARN-1139: --- bq. My primary rationale for

[jira] [Updated] (YARN-1325) Enabling HA should check Configuration contains multiple RMs

[ https://issues.apache.org/jira/browse/YARN-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1325: Attachment: YARN-1325.1.patch 1. should set at least two RM ids for YarnConfiguration.RM_IDs if HA is

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841708#comment-13841708 ] Hadoop QA commented on YARN-1446: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1325) Enabling HA should check Configuration contains multiple RMs

[ https://issues.apache.org/jira/browse/YARN-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841753#comment-13841753 ] Hadoop QA commented on YARN-1325: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841766#comment-13841766 ] Carlo Curino commented on YARN-1471: Mmh... The problem is that you are creating a

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841835#comment-13841835 ] Karthik Kambatla commented on YARN-807: --- Thanks Sandy. The latest patch looks good to

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1471: --- Attachment: YARN-1471.patch.2 The SLS simulator is not running the preemption policy for

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841849#comment-13841849 ] Carlo Curino commented on YARN-1471: Alejandro, I tried the second version of what you

[jira] [Moved] (YARN-1479) Invalid NaN values in Hadoop REST API JSON response

[ https://issues.apache.org/jira/browse/YARN-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He moved HADOOP-10123 to YARN-1479: Affects Version/s: (was: 2.0.4-alpha) (was: 0.23.6)

[jira] [Updated] (YARN-1023) [YARN-321] Webservices REST API's support for Application History

[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1023: -- Attachment: YARN-1023.3.patch @Mayank bansal, thanks for the review. I've updated the patch, which

[jira] [Commented] (YARN-1023) [YARN-321] Webservices REST API's support for Application History

[ https://issues.apache.org/jira/browse/YARN-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841860#comment-13841860 ] Hadoop QA commented on YARN-1023: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI list command

Zhijie Shen created YARN-1480: - Summary: RM web services getApps() accepts many more filters than ApplicationCLI list command Key: YARN-1480 URL: https://issues.apache.org/jira/browse/YARN-1480 Project:

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841873#comment-13841873 ] Sandy Ryza commented on YARN-807: - Thanks Karthik, will commit this tomorrow if there are no

[jira] [Commented] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI list command

[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841872#comment-13841872 ] Sandy Ryza commented on YARN-1480: -- I think it definitely make sense to add the missing

[jira] [Commented] (YARN-1325) Enabling HA should check Configuration contains multiple RMs

[ https://issues.apache.org/jira/browse/YARN-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841894#comment-13841894 ] Karthik Kambatla commented on YARN-1325: Comments: # 2 might be easier to

[jira] [Updated] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1028: --- Attachment: yarn-1028-3.patch Posting a patch that adds a test that verifies ClientRMProxy

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841934#comment-13841934 ] Hadoop QA commented on YARN-1028: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1139) [Umbrella] Convert all RM components to Services

[ https://issues.apache.org/jira/browse/YARN-1139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841973#comment-13841973 ] Karthik Kambatla commented on YARN-1139: bq. For now, are we good with the

[jira] [Commented] (YARN-1172) Convert *SecretManagers in the RM to services

[ https://issues.apache.org/jira/browse/YARN-1172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13841975#comment-13841975 ] Karthik Kambatla commented on YARN-1172: Per discussion on YARN-1139, it seems

[jira] [Updated] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1028: --- Attachment: yarn-1028-4.patch My bad - was setting rm-ids even for non-HA cases. Fixed that.

[jira] [Commented] (YARN-1029) Allow embedding leader election into the RM

[ https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842020#comment-13842020 ] Xuan Gong commented on YARN-1029: - [~kkambatl] I have time to do this ticket. Can I take

[jira] [Commented] (YARN-1028) Add FailoverProxyProvider like capability to RMProxy

[ https://issues.apache.org/jira/browse/YARN-1028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842021#comment-13842021 ] Hadoop QA commented on YARN-1028: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1029) Allow embedding leader election into the RM

[ https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842022#comment-13842022 ] Karthik Kambatla commented on YARN-1029: [~xgong]: I am actively working on this,

[jira] [Commented] (YARN-1029) Allow embedding leader election into the RM

[ https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842023#comment-13842023 ] Xuan Gong commented on YARN-1029: - [~kkambatl] Or if YARN-1177 is our first step, I can do

[jira] [Updated] (YARN-1448) Protocol changes in RM side to support change container resources

[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1448: - Attachment: yarn-1448.2.patch Attached patch updated according to finalized YARN-1447 Protocol changes

[jira] [Updated] (YARN-1449) Protocol changes in NM side to support change container resource

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Attachment: yarn-1449.3.patch Attached patch updated according to finalized YARN-1447. I also found it's

[jira] [Updated] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Summary: Protocol changes and implementations in NM side to support change container resource (was:

[jira] [Commented] (YARN-1446) Change killing application to wait until state store is done

[ https://issues.apache.org/jira/browse/YARN-1446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842028#comment-13842028 ] Jian He commented on YARN-1446: --- Yes, all the async APIs should share the same config

[jira] [Updated] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Description: As described in YARN-1197, we need add API/implementation changes, 1) Add a

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842030#comment-13842030 ] Wangda Tan commented on YARN-1197: -- Guys, I attached patch for YARN-1448 and YARN-1449 for

[jira] [Updated] (YARN-1405) RM should crash and print permission error for nonwritable/readable local path in yarn.resourcemanager.fs.state-store.uri

[ https://issues.apache.org/jira/browse/YARN-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-1405: -- Attachment: YARN-1405.1.patch upload a patch to throw exception directly instead of calling sys exit RM

[jira] [Commented] (YARN-1405) RM should crash and print permission error for nonwritable/readable local path in yarn.resourcemanager.fs.state-store.uri

[ https://issues.apache.org/jira/browse/YARN-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842039#comment-13842039 ] Jian He commented on YARN-1405: --- The test passed with the core code change, and failed

[jira] [Commented] (YARN-1029) Allow embedding leader election into the RM

[ https://issues.apache.org/jira/browse/YARN-1029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842051#comment-13842051 ] Karthik Kambatla commented on YARN-1029: [~xgong]: YARN-1177 and this JIRA are

[jira] [Commented] (YARN-1405) RM should crash and print permission error for nonwritable/readable local path in yarn.resourcemanager.fs.state-store.uri

[ https://issues.apache.org/jira/browse/YARN-1405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842053#comment-13842053 ] Hadoop QA commented on YARN-1405: - {color:green}+1 overall{color}. Here are the results of