[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388118#comment-14388118 ] Hadoop QA commented on YARN-3258: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3248) Display count of nodes blacklisted by apps in the web UI

2015-03-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388097#comment-14388097 ] Varun Vasudev commented on YARN-3248: - Test failures are unrelated. Display count of

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388262#comment-14388262 ] Hadoop QA commented on YARN-3415: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3423) RM HA setup, cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Aroop Maliakkal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aroop Maliakkal updated YARN-3423: -- Description: RM HA setup ( e.g.

[jira] [Created] (YARN-3423) RM HA setup, cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Aroop Maliakkal (JIRA)
Aroop Maliakkal created YARN-3423: - Summary: RM HA setup, cluster tab links populated with AM hostname instead of RM Key: YARN-3423 URL: https://issues.apache.org/jira/browse/YARN-3423 Project:

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388275#comment-14388275 ] Craig Welch commented on YARN-3318: --- Hi Wangda, I have changed the patch a bit in the

[jira] [Updated] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Aroop Maliakkal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aroop Maliakkal updated YARN-3423: -- Description: In RM HA setup ( e.g.

[jira] [Commented] (YARN-3406) Add a numUsedContainer for RM Web UI and REST API

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388176#comment-14388176 ] Hadoop QA commented on YARN-3406: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2901) Add errors and warning stats to RM, NM web UI

2015-03-31 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2901: Attachment: apache-yarn-2901.4.patch Uploaded a new patch with class marked as Private and Unstable.

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388245#comment-14388245 ] Tsuyoshi Ozawa commented on YARN-3258: -- The intermittent failure of

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388178#comment-14388178 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2901) Add errors and warning stats to RM, NM web UI

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388200#comment-14388200 ] Hadoop QA commented on YARN-2901: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3415: Attachment: YARN-3415.001.patch Non-AM containers can be counted towards amResourceUsage of a fairscheduler

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.35.patch Create Initial OrderingPolicy Framework, integrate with

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388266#comment-14388266 ] Hudson commented on YARN-3258: -- FAILURE: Integrated in Hadoop-trunk-Commit #7474 (See

[jira] [Updated] (YARN-3319) Implement a Fair SchedulerOrderingPolicy

2015-03-31 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.35.patch Apply after applying YARN-3318.35.patch Implement a Fair

[jira] [Updated] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Aroop Maliakkal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aroop Maliakkal updated YARN-3423: -- Summary: RM HA setup, Cluster tab links populated with AM hostname instead of RM (was: RM HA

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388285#comment-14388285 ] zhihai xu commented on YARN-3415: - [~sandyr], that is a very good idea to move the call to

[jira] [Updated] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2666: Attachment: YARN-2666.000.patch TestFairScheduler.testContinuousScheduling fails Intermittently

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388370#comment-14388370 ] Hadoop QA commented on YARN-3304: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388372#comment-14388372 ] Hadoop QA commented on YARN-3423: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388352#comment-14388352 ] zhihai xu commented on YARN-2666: - Hi [~ywskycn], Could you assign this JIRA to me? I think

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388361#comment-14388361 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3418) AM to be able to set/update web URL and IPC ports post-registration

2015-03-31 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388380#comment-14388380 ] Rohith commented on YARN-3418: -- Before going to implementation, I would like to hear from the

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388387#comment-14388387 ] Hadoop QA commented on YARN-3415: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388399#comment-14388399 ] Varun Saxena commented on YARN-2962: Thanks [~asuresh] for the review. bq. minor

[jira] [Commented] (YARN-2901) Add errors and warning stats to RM, NM web UI

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388341#comment-14388341 ] Hadoop QA commented on YARN-2901: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated YARN-3423: --- Attachment: YARN-3423.patch When yarn.resourcemanager.webapp.https.address=0.0.0.0:8090

[jira] [Commented] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Aroop Maliakkal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388307#comment-14388307 ] Aroop Maliakkal commented on YARN-3423: --- Why we have observed this issue only in HA

[jira] [Updated] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3415: Attachment: (was: YARN-3415.001.patch) Non-AM containers can be counted towards amResourceUsage of a

[jira] [Updated] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3415: Attachment: YARN-3415.001.patch Non-AM containers can be counted towards amResourceUsage of a fairscheduler

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388421#comment-14388421 ] Hudson commented on YARN-3258: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #149 (See

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388420#comment-14388420 ] Hudson commented on YARN-2495: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #149 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388411#comment-14388411 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #149 (See

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388443#comment-14388443 ] Varun Saxena commented on YARN-2962: bq. Also was wondering, should we hard code the

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388454#comment-14388454 ] Hadoop QA commented on YARN-2666: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388461#comment-14388461 ] Hadoop QA commented on YARN-3304: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3304: - Attachment: YARN-3304-appendix-v2.patch appendix-v2 suppress the warning of calling deprecated methods.

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388441#comment-14388441 ] Hudson commented on YARN-3258: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #883 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388431#comment-14388431 ] Hudson commented on YARN-3304: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #883 (See

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388440#comment-14388440 ] Hudson commented on YARN-2495: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #883 (See

[jira] [Updated] (YARN-3374) Collector's web server should randomly bind an available port

2015-03-31 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3374: -- Attachment: YARN-3347.1.patch With the discovery service, the collector doesn't need to bind a

[jira] [Commented] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389975#comment-14389975 ] Hadoop QA commented on YARN-3423: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389822#comment-14389822 ] Hadoop QA commented on YARN-2729: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3127) Apphistory url crashes when RM switches with ATS enabled

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389877#comment-14389877 ] Hadoop QA commented on YARN-3127: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken from appattempt_1427804754787_0001_000001

2015-03-31 Thread zhihai xu (JIRA)
zhihai xu created YARN-3429: --- Summary: TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken from appattempt_1427804754787_0001_01 Key: YARN-3429 URL:

[jira] [Commented] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-03-31 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1438#comment-1438 ] Rohith commented on YARN-3416: -- bq. there are only 4 NodeManagers in cluster, so it is

[jira] [Updated] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread zhaoyunjiong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhaoyunjiong updated YARN-3423: --- Attachment: YARN-3423.patch Update patch, the previous patch is not right. Below are configs from our

[jira] [Commented] (YARN-3127) Apphistory url crashes when RM switches with ATS enabled

2015-03-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389988#comment-14389988 ] Naganarasimha G R commented on YARN-3127: - TestFairScheduler is not related to this

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388634#comment-14388634 ] Hudson commented on YARN-2495: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #140 (See

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388718#comment-14388718 ] Varun Saxena commented on YARN-3051: bq. We do not require the full context for

[jira] [Updated] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3429: Summary: TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (was:

[jira] [Commented] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390015#comment-14390015 ] zhihai xu commented on YARN-3429: - To fix this issue, we can set

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

2015-03-31 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390026#comment-14390026 ] Rohith commented on YARN-3404: -- +1lgtm(non-binding) View the queue name to YARN Application

[jira] [Commented] (YARN-3418) AM to be able to set/update web URL and IPC ports post-registration

2015-03-31 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390006#comment-14390006 ] Rohith commented on YARN-3418: -- Thinking instead of supporting new AM-RM IPC call,

[jira] [Commented] (YARN-3429) TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken from appattempt_1427804754787_0001_000001

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390005#comment-14390005 ] zhihai xu commented on YARN-3429: - I find out the test failure reason is because the

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390002#comment-14390002 ] Hadoop QA commented on YARN-3404: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1621) Add CLI to list rows of task attempt ID, container ID, host of container, state of container

2015-03-31 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bartosz Ługowski updated YARN-1621: --- Attachment: (was: YARN-1621.6.patch) Add CLI to list rows of task attempt ID, container

[jira] [Updated] (YARN-1621) Add CLI to list rows of task attempt ID, container ID, host of container, state of container

2015-03-31 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bartosz Ługowski updated YARN-1621: --- Attachment: YARN-1621.6.patch Add CLI to list rows of task attempt ID, container ID, host of

[jira] [Commented] (YARN-3412) RM tests should use MockRM where possible

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388799#comment-14388799 ] Hudson commented on YARN-3412: -- FAILURE: Integrated in Hadoop-trunk-Commit #7477 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388817#comment-14388817 ] Hitesh Shah commented on YARN-3304: --- [~kasha] 3.0.0 is a major release. I would assume

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388824#comment-14388824 ] Karthik Kambatla commented on YARN-3304: [~hitesh] - thanks for okay their removal

[jira] [Updated] (YARN-3416) deadlock in a job between map and reduce cores allocation

2015-03-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3416: --- Priority: Critical (was: Major) deadlock in a job between map and reduce cores allocation

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388802#comment-14388802 ] Karthik Kambatla commented on YARN-3304: [~djp] - just to be clear, we are adding a

[jira] [Updated] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3334: - Attachment: YARN-3334-v4.patch Update the patch to address major comments above, except ContainerEntity

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388749#comment-14388749 ] Varun Saxena commented on YARN-3051: Sorry for the mistake. Last 2 APIs' are as under :

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388748#comment-14388748 ] Varun Saxena commented on YARN-3051: I will explain the APIs' added and use cases it

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388755#comment-14388755 ] Varun Saxena commented on YARN-3051: Some use case scenarios which are pending. # To

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388820#comment-14388820 ] Allen Wittenauer commented on YARN-3304: 3.0.0 will likely release by the end of

[jira] [Comment Edited] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388824#comment-14388824 ] Karthik Kambatla edited comment on YARN-3304 at 3/31/15 4:54 PM:

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388611#comment-14388611 ] Hudson commented on YARN-2495: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2081 (See

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388612#comment-14388612 ] Hudson commented on YARN-3258: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2081 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388602#comment-14388602 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2081 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388624#comment-14388624 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #140 (See

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388635#comment-14388635 ] Hudson commented on YARN-3258: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #140 (See

[jira] [Updated] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3051: --- Attachment: YARN-3051_temp.patch [Storage abstraction] Create backing storage read interface for ATS

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-31 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388721#comment-14388721 ] Varun Saxena commented on YARN-3051: I have added a temporary patch. Will upload a full

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389156#comment-14389156 ] Hudson commented on YARN-3258: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2099 (See

[jira] [Updated] (YARN-3424) Reduce log for ContainerMonitorImpl resoure monitoring from info to debug

2015-03-31 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3424: Attachment: YARN-3424.001.patch Reduce log for ContainerMonitorImpl resoure monitoring from info to

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389155#comment-14389155 ] Hudson commented on YARN-2495: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2099 (See

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389144#comment-14389144 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2099 (See

[jira] [Commented] (YARN-2175) Container localization has no timeouts and tasks can be stuck there for a long time

2015-03-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389173#comment-14389173 ] Karthik Kambatla commented on YARN-2175: In our testing, we see this issue with the

[jira] [Updated] (YARN-3424) Reduce log for ContainerMonitorImpl resoure monitoring from info to debug

2015-03-31 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3424: Description: Today we log the memory usage of process at info level which spams the log with

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389166#comment-14389166 ] Wangda Tan commented on YARN-3318: -- bq. Well, I'm certainly open to other name options,

[jira] [Created] (YARN-3424) Reduce log for ContainerMonitorImpl resoure monitoring from info to debug

2015-03-31 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-3424: --- Summary: Reduce log for ContainerMonitorImpl resoure monitoring from info to debug Key: YARN-3424 URL: https://issues.apache.org/jira/browse/YARN-3424 Project: Hadoop

[jira] [Updated] (YARN-3225) New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

2015-03-31 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3225: Attachment: YARN-3225-2.patch New parameter or CLI for decommissioning node gracefully in RMAdmin CLI

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388929#comment-14388929 ] Vinod Kumar Vavilapalli commented on YARN-3304: --- Interesting discussion. The

[jira] [Updated] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3318: -- Attachment: YARN-3318.36.patch Fixes for release audit warnings Create Initial OrderingPolicy

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389102#comment-14389102 ] zhihai xu commented on YARN-2666: - Thanks [~ywskycn] to assign this JIRA to me. I uploaded

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-03-31 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389105#comment-14389105 ] Wei Yan commented on YARN-2666: --- Hey, [~zxu], I'll take a look of your patch later today.

[jira] [Commented] (YARN-3304) ResourceCalculatorProcessTree#getCpuUsagePercent default return value is inconsistent with other getters

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389077#comment-14389077 ] Hudson commented on YARN-3304: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #149 (See

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389086#comment-14389086 ] Hudson commented on YARN-2495: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #149 (See

[jira] [Commented] (YARN-3258) FairScheduler: Need to add more logging to investigate allocations

2015-03-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389087#comment-14389087 ] Hudson commented on YARN-3258: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #149 (See

[jira] [Commented] (YARN-2666) TestFairScheduler.testContinuousScheduling fails Intermittently

2015-03-31 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389111#comment-14389111 ] zhihai xu commented on YARN-2666: - thanks [~ywskycn].

[jira] [Commented] (YARN-3423) RM HA setup, Cluster tab links populated with AM hostname instead of RM

2015-03-31 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388857#comment-14388857 ] Karthik Kambatla commented on YARN-3423: [~aroop] - this code has been updated

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

2015-03-31 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388937#comment-14388937 ] Sangjin Lee commented on YARN-2902: --- Sorry it took me a while to get to this. Here is an

[jira] [Updated] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

2015-03-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3425: - Summary: NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed (was: NPE

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-03-31 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389392#comment-14389392 ] Yongjun Zhang commented on YARN-3021: - HI [~vinodkv], Seems [~jianhe] is not

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework, integrate with CapacityScheduler LeafQueue supporting present behavior

2015-03-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14389315#comment-14389315 ] Hadoop QA commented on YARN-3318: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3425) NPE during resourcemanager shutdown with node label with out datanode started

2015-03-31 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3425: -- Summary: NPE during resourcemanager shutdown with node label with out datanode started Key: YARN-3425 URL: https://issues.apache.org/jira/browse/YARN-3425

  1   2   >