[jira] [Commented] (YARN-3730) scheduler reserve more resource than required

2015-05-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566130#comment-14566130 ] Naganarasimha G R commented on YARN-3730: - hi [~gu chi], Which version did you

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-05-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566095#comment-14566095 ] Zhijie Shen commented on YARN-1462: --- If there's no more concern, I'll commit the patch

[jira] [Updated] (YARN-3748) Cleanup Findbugs volatile warnings

2015-05-30 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3748: --- Attachment: YARN-3748.2.patch Cleanup Findbugs volatile warnings --

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-05-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566132#comment-14566132 ] Hadoop QA commented on YARN-3045: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

2015-05-30 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.003.patch Moved common classes into common package to separate

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

2015-05-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3534: --- Description: YARN should be aware of the resource utilization of the nodes when scheduling

[jira] [Updated] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-05-30 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3045: Attachment: YARN-3045-YARN-2928.003.patch hi [~zjshen],[~djp] [~sjlee0] Based on the

[jira] [Updated] (YARN-3748) Cleanup Findbugs volatile warnings

2015-05-30 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Liptak updated YARN-3748: --- Attachment: YARN-3748.3.patch Cleanup Findbugs volatile warnings --

[jira] [Commented] (YARN-3748) Cleanup Findbugs volatile warnings

2015-05-30 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566115#comment-14566115 ] Gabor Liptak commented on YARN-3748: [~busbey] Updated patch to make variables final.

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566182#comment-14566182 ] Karthik Kambatla commented on YARN-3467: The test failure looks unrelated, and I am

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566188#comment-14566188 ] Hudson commented on YARN-3467: -- FAILURE: Integrated in Hadoop-trunk-Commit #7932 (See

[jira] [Commented] (YARN-3748) Cleanup Findbugs volatile warnings

2015-05-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566151#comment-14566151 ] Hadoop QA commented on YARN-3748: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-05-30 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566326#comment-14566326 ] Chun Chen commented on YARN-3749: - Upload a patch to fix it. We should make a copy of

[jira] [Commented] (YARN-2674) Distributed shell AM may re-launch containers if RM work preserving restart happens

2015-05-30 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566327#comment-14566327 ] Chun Chen commented on YARN-2674: - Thanks for the comments [~vinodkv]. Will upload a new

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-30 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566294#comment-14566294 ] Mit Desai commented on YARN-2900: - looks good to me. Thanks [~zjshen] for your looking into

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566334#comment-14566334 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-trunk-Commit #7933 (See

[jira] [Commented] (YARN-3748) Cleanup Findbugs volatile warnings

2015-05-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566229#comment-14566229 ] Hadoop QA commented on YARN-3748: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-05-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566283#comment-14566283 ] Karthik Kambatla commented on YARN-3534: Thanks for working on this, Inigo. Few

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-05-30 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Summary: We should make a copy of configuration when init MiniYARNCluster with multiple RMs (was: We should

[jira] [Created] (YARN-3749) We should make a copy of config MiniYARNCluster

2015-05-30 Thread Chun Chen (JIRA)
Chun Chen created YARN-3749: --- Summary: We should make a copy of config MiniYARNCluster Key: YARN-3749 URL: https://issues.apache.org/jira/browse/YARN-3749 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-05-30 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Description: When I was trying to write a test case for YARN-2674, I found DS client trying to connect to

[jira] [Assigned] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-05-30 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen reassigned YARN-3749: --- Assignee: Chun Chen We should make a copy of configuration when init MiniYARNCluster with multiple

[jira] [Updated] (YARN-2716) Refactor ZKRMStateStore retry code with Apache Curator

2015-05-30 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2716: --- Attachment: yarn-2716-super-prelim.patch Had some time today to look at this again. Here is a

[jira] [Updated] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-05-30 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chun Chen updated YARN-3749: Attachment: YARN-3749.patch We should make a copy of configuration when init MiniYARNCluster with

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566354#comment-14566354 ] Xuan Gong commented on YARN-2900: - [~zjshen] I have committed the patch into

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566363#comment-14566363 ] Anubhav Dhoot commented on YARN-3467: - Thanks [~kasha] for review and commit! Expose

[jira] [Created] (YARN-3750) yarn.log.server.url is not documented in yarn-default.xml

2015-05-30 Thread Dmitry Sivachenko (JIRA)
Dmitry Sivachenko created YARN-3750: --- Summary: yarn.log.server.url is not documented in yarn-default.xml Key: YARN-3750 URL: https://issues.apache.org/jira/browse/YARN-3750 Project: Hadoop YARN

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566351#comment-14566351 ] Xuan Gong commented on YARN-2900: - +1. Check this in Application (Attempt and Container)

[jira] [Commented] (YARN-2900) Application (Attempt and Container) Not Found in AHS results in Internal Server Error (500)

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566355#comment-14566355 ] Hudson commented on YARN-2900: -- FAILURE: Integrated in Hadoop-trunk-Commit #7934 (See

[jira] [Updated] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3508: --- Attachment: YARN-3508.02.patch Preemption processing occuring on the main RM dispatcher

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565934#comment-14565934 ] Hudson commented on YARN-3547: -- FAILURE: Integrated in Hadoop-Yarn-trunk #943 (See

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565936#comment-14565936 ] Hudson commented on YARN-3713: -- FAILURE: Integrated in Hadoop-Yarn-trunk #943 (See

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565937#comment-14565937 ] Hudson commented on YARN-3740: -- FAILURE: Integrated in Hadoop-Yarn-trunk #943 (See

[jira] [Updated] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3467: Attachment: YARN-3467.002.patch Fixed checkstyle issue Expose allocatedMB, allocatedVCores, and

[jira] [Commented] (YARN-3508) Preemption processing occuring on the main RM dispatcher

2015-05-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565929#comment-14565929 ] Hadoop QA commented on YARN-3508: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565959#comment-14565959 ] Hudson commented on YARN-3547: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #213 (See

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565961#comment-14565961 ] Hudson commented on YARN-3713: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #213 (See

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14565962#comment-14565962 ] Hudson commented on YARN-3740: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #213 (See

[jira] [Updated] (YARN-3630) YARN should suggest a heartbeat interval for applications

2015-05-30 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-3630: -- Attachment: YARN-3630.003.patch Upload a patch, adding a configured hard heartbeat interval upper limit,

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566007#comment-14566007 ] Hudson commented on YARN-3547: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2141 (See

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566009#comment-14566009 ] Hudson commented on YARN-3713: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2141 (See

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566010#comment-14566010 ] Hudson commented on YARN-3740: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2141 (See

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566018#comment-14566018 ] Hudson commented on YARN-3713: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #202 (See

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566019#comment-14566019 ] Hudson commented on YARN-3740: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #202 (See

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566016#comment-14566016 ] Hudson commented on YARN-3547: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk-Java8 #202 (See

[jira] [Commented] (YARN-3467) Expose allocatedMB, allocatedVCores, and runningContainers metrics on running Applications in RM Web UI

2015-05-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566015#comment-14566015 ] Hadoop QA commented on YARN-3467: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566046#comment-14566046 ] Hudson commented on YARN-3740: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #211 (See

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566045#comment-14566045 ] Hudson commented on YARN-3713: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #211 (See

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566043#comment-14566043 ] Hudson commented on YARN-3547: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #211 (See

[jira] [Commented] (YARN-3547) FairScheduler: Apps that have no resource demand should not participate scheduling

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566054#comment-14566054 ] Hudson commented on YARN-3547: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2159 (See

[jira] [Commented] (YARN-3713) Remove duplicate function call storeContainerDiagnostics in ContainerDiagnosticsUpdateTransition

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566056#comment-14566056 ] Hudson commented on YARN-3713: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2159 (See

[jira] [Commented] (YARN-3740) Fixed the typo with the configuration name: APPLICATION_HISTORY_PREFIX_MAX_APPS

2015-05-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14566057#comment-14566057 ] Hudson commented on YARN-3740: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2159 (See