[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-10 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680176#comment-13680176 ] Bikas Saha commented on YARN-569: - Sorry for the delayed response. This doesnt seem to affe

[jira] [Commented] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680163#comment-13680163 ] Sandy Ryza commented on YARN-795: - +1 > Fair scheduler queue metrics should

[jira] [Commented] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680150#comment-13680150 ] Hadoop QA commented on YARN-782: {color:red}-1 overall{color}. Here are the results of test

[jira] [Commented] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680149#comment-13680149 ] Hadoop QA commented on YARN-795: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Attachment: YARN-795-2.patch Thanks, Sandy. Here is the patch that removes the unnecessary whitespace.

[jira] [Commented] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680114#comment-13680114 ] Sandy Ryza commented on YARN-795: - Thanks for working on this, Wei. The patch looks good.

[jira] [Commented] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680109#comment-13680109 ] Sandy Ryza commented on YARN-782: - My opinion is that it would be best to remove the propert

[jira] [Updated] (YARN-782) vcores-pcores ratio functions differently from vmem-pmem ratio in misleading way

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-782: Attachment: YARN-782.patch > vcores-pcores ratio functions differently from vmem-pmem ratio in misleading

[jira] [Commented] (YARN-731) RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680102#comment-13680102 ] Hadoop QA commented on YARN-731: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-731) RPCUtil.unwrapAndThrowException should unwrap remote RuntimeExceptions

2013-06-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-731: - Attachment: YARN-731.1.patch Added the block in RPCUtil#unwrapAndThrowException to handle the runtime exce

[jira] [Updated] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2013-06-10 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated YARN-796: --- Description: It will be useful for admins to specify labels for nodes. Examples of labels are OS, proc

[jira] [Created] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2013-06-10 Thread Arun C Murthy (JIRA)
Arun C Murthy created YARN-796: -- Summary: Allow for (admin) labels on nodes and resource-requests Key: YARN-796 URL: https://issues.apache.org/jira/browse/YARN-796 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13680028#comment-13680028 ] Hadoop QA commented on YARN-795: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Attachment: YARN-795.patch Uploaded patch that subtracts allocated vcores from available vcores in QueueMetrics.

[jira] [Commented] (YARN-502) RM crash with NPE on NODE_REMOVED event

2013-06-10 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679982#comment-13679982 ] Mayank Bansal commented on YARN-502: By Looking at the code looks like if there is race

[jira] [Commented] (YARN-502) RM crash with NPE on NODE_REMOVED event

2013-06-10 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679941#comment-13679941 ] Mayank Bansal commented on YARN-502: Thanks [~sandyr] I did not reprduce it. As no bod

[jira] [Commented] (YARN-299) Node Manager throws org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: RESOURCE_FAILED at DONE

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679940#comment-13679940 ] Hadoop QA commented on YARN-299: {color:green}+1 overall{color}. Here are the results of te

[jira] [Assigned] (YARN-502) RM crash with NPE on NODE_REMOVED event

2013-06-10 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal reassigned YARN-502: -- Assignee: Mayank Bansal > RM crash with NPE on NODE_REMOVED event > -

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores, causing

[jira] [Updated] (YARN-795) Fair scheduler queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Summary: Fair scheduler queue metrics should subtract allocated vCores from available vCores (was: Fair scheduler

[jira] [Updated] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The root queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores, cau

[jira] [Updated] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The root queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores, cau

[jira] [Updated] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-795: - Description: The root queue metrics of fair scheduler doesn't subtract allocated vCores from available vCores, cau

[jira] [Created] (YARN-795) Fair scheduler root queue metrics should subtract allocated vCores from available vCores

2013-06-10 Thread Wei Yan (JIRA)
Wei Yan created YARN-795: Summary: Fair scheduler root queue metrics should subtract allocated vCores from available vCores Key: YARN-795 URL: https://issues.apache.org/jira/browse/YARN-795 Project: Hadoop YA

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679915#comment-13679915 ] Hadoop QA commented on YARN-752: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679912#comment-13679912 ] Hadoop QA commented on YARN-791: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-299) Node Manager throws org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: RESOURCE_FAILED at DONE

2013-06-10 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated YARN-299: --- Attachment: YARN-299-trunk-1.patch Adding patch. Thanks, Mayank > Node Manager throws

[jira] [Updated] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-752: Attachment: YARN-752-5.patch > In AMRMClient, automatically add corresponding rack requests for requested

[jira] [Commented] (YARN-612) Cleanup BuilderUtils

2013-06-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679902#comment-13679902 ] Jian He commented on YARN-612: -- Hi [~kkambatl], we have already added built-in factory method f

[jira] [Commented] (YARN-752) In AMRMClient, automatically add corresponding rack requests for requested nodes

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679899#comment-13679899 ] Sandy Ryza commented on YARN-752: - [~bikassaha], your updated patch looks good to me. Notic

[jira] [Commented] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679884#comment-13679884 ] Sandy Ryza commented on YARN-791: - Uploading a patch that does the latter. It also refactor

[jira] [Updated] (YARN-791) Ensure that RM RPC APIs that return nodes are consistent with /nodes REST API

2013-06-10 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-791: Attachment: YARN-791.patch > Ensure that RM RPC APIs that return nodes are consistent with /nodes REST AP

[jira] [Commented] (YARN-612) Cleanup BuilderUtils

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679805#comment-13679805 ] Hadoop QA commented on YARN-612: {color:green}+1 overall{color}. Here are the results of te

[jira] [Updated] (YARN-612) Cleanup BuilderUtils

2013-06-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-612: -- Attachment: yarn-612-2.patch Uploading a patch that cleans up BuilderUtils further. [~vinodkv],

[jira] [Commented] (YARN-767) Initialize Application status metrics when QueueMetrics is initialized

2013-06-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679763#comment-13679763 ] Jian He commented on YARN-767: -- we cannot put the initAppStatusMetrics immediately after forQue

[jira] [Commented] (YARN-641) Make AMLauncher in RM Use NMClient

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679733#comment-13679733 ] Hadoop QA commented on YARN-641: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-766) TestNodeManagerShutdown should use Shell to form the output path

2013-06-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679703#comment-13679703 ] Chris Nauroth commented on YARN-766: Hi Sid, There are a couple of other minor differen

[jira] [Updated] (YARN-641) Make AMLauncher in RM Use NMClient

2013-06-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-641: - Attachment: YARN-641.1.patch In the patch, ApplicationMasterLauncher is changed to extends NMClientAsync,

[jira] [Commented] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

2013-06-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679544#comment-13679544 ] Junping Du commented on YARN-18: The findbugs warning seems to be unrelated. [~vicaya] and [~

[jira] [Commented] (YARN-427) Coverage fix for org.apache.hadoop.yarn.server.api.*

2013-06-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679444#comment-13679444 ] Hadoop QA commented on YARN-427: {color:green}+1 overall{color}. Here are the results of te

[jira] [Commented] (YARN-427) Coverage fix for org.apache.hadoop.yarn.server.api.*

2013-06-10 Thread Aleksey Gorshkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13679439#comment-13679439 ] Aleksey Gorshkov commented on YARN-427: --- Thanks for review, Jonathan. I've updated tes

[jira] [Updated] (YARN-427) Coverage fix for org.apache.hadoop.yarn.server.api.*

2013-06-10 Thread Aleksey Gorshkov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksey Gorshkov updated YARN-427: -- Attachment: YARN-427-trunk-c.patch YARN-427-branch-0.23-c.patch > Coverage fi

[jira] [Resolved] (YARN-794) YarnClientImpl.submitApplication() to add a timeout

2013-06-10 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved YARN-794. - Resolution: Duplicate Fix Version/s: 3.0.0 2.1.0-beta > YarnClientImp

[jira] [Updated] (YARN-18) Make locatlity in YARN's container assignment and task scheduling pluggable for other deployment topology

2013-06-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-18: --- Attachment: YARN-18-v7.3.patch > Make locatlity in YARN's container assignment and task scheduling pluggable