[jira] [Commented] (YARN-379) yarn [node,application] command print logger info messages

2013-05-15 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658403#comment-13658403 ] Ravi Prakash commented on YARN-379: --- I recant my recant. So many options. We probably

[jira] [Commented] (YARN-366) Add a tracing async dispatcher to simplify debugging

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658480#comment-13658480 ] Hadoop QA commented on YARN-366: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-684) ContainerManager.startContainer needs to only have ContainerTokenIdentifier instead of the whole Container

2013-05-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658558#comment-13658558 ] Bikas Saha commented on YARN-684: - I would suggest continuing to pass Container to the

[jira] [Updated] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-638: - Attachment: YARN-638.10.patch The newest patch adds several API for RM use to persists delegation tokens, and

[jira] [Commented] (YARN-613) Create NM proxy per NM instead of per container

2013-05-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658604#comment-13658604 ] Omkar Vinit Joshi commented on YARN-613: This was discussed offline with [~vinodkv],

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

2013-05-15 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658637#comment-13658637 ] Alejandro Abdelnur commented on YARN-624: - As pointed out, supporting gang at

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658705#comment-13658705 ] Hadoop QA commented on YARN-638: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-613) Create NM proxy per NM instead of per container

2013-05-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658763#comment-13658763 ] Omkar Vinit Joshi commented on YARN-613: One addition .. good suggestion

[jira] [Created] (YARN-686) Flatten NodeReport

2013-05-15 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-686: --- Summary: Flatten NodeReport Key: YARN-686 URL: https://issues.apache.org/jira/browse/YARN-686 Project: Hadoop YARN Issue Type: Sub-task Components: api

[jira] [Updated] (YARN-686) Flatten NodeReport

2013-05-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-686: Description: The NodeReport returned by getClusterNodes or given to AMs in heartbeat responses includes both

[jira] [Updated] (YARN-686) Flatten NodeReport

2013-05-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-686: Description: The NodeReport returned by getClusterNodes or given to AMs in heartbeat responses includes

[jira] [Commented] (YARN-662) Enforce required parameters for all the protocols

2013-05-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658795#comment-13658795 ] Bikas Saha commented on YARN-662: - Does this include making null checks etc on all incoming

[jira] [Updated] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-638: - Attachment: YARN-638.11.patch The newest patch revert all hdfs changes except moving addPersistedToken method to

[jira] [Commented] (YARN-617) In unsercure mode, AM can fake resource requirements

2013-05-15 Thread Omkar Vinit Joshi (JIRA)
.patch, YARN-617-20130507.patch, YARN-617.20130508.patch, YARN-617-20130513.patch, YARN-617-20130515.patch Without security, it is impossible to completely avoid AMs faking resources. We can at the least make it as difficult as possible by using the same container tokens and the RM-NM shared

[jira] [Updated] (YARN-617) In unsercure mode, AM can fake resource requirements

2013-05-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-617: --- Attachment: YARN-617-20130515.patch In unsercure mode, AM can fake resource requirements

[jira] [Commented] (YARN-613) Create NM proxy per NM instead of per container

2013-05-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658816#comment-13658816 ] Bikas Saha commented on YARN-613: - To be clear, on the AM the behavior is always to take the

[jira] [Commented] (YARN-366) Add a tracing async dispatcher to simplify debugging

2013-05-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658836#comment-13658836 ] Sandy Ryza commented on YARN-366: - Uploading a patch to address the findbugs warnings.

[jira] [Updated] (YARN-366) Add a tracing async dispatcher to simplify debugging

2013-05-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-366: Attachment: YARN-366-4.patch Add a tracing async dispatcher to simplify debugging

[jira] [Updated] (YARN-656) In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity.

2013-05-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-656: Summary: In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity.

[jira] [Commented] (YARN-687) TestNMAuditLogger hang

2013-05-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658843#comment-13658843 ] Steve Loughran commented on YARN-687: - thread dump {code} Running

[jira] [Created] (YARN-687) TestNMAuditLogger hang

2013-05-15 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-687: --- Summary: TestNMAuditLogger hang Key: YARN-687 URL: https://issues.apache.org/jira/browse/YARN-687 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-617) In unsercure mode, AM can fake resource requirements

2013-05-15 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12583375/YARN-617-20130515.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include

[jira] [Commented] (YARN-366) Add a tracing async dispatcher to simplify debugging

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658867#comment-13658867 ] Hadoop QA commented on YARN-366: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-530) Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services

2013-05-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-530: Attachment: YARN-530-005.patch Define Service model strictly, implement AbstractService for

[jira] [Commented] (YARN-530) Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services

2013-05-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658961#comment-13658961 ] Steve Loughran commented on YARN-530: - h3. Service bq. {{start()}} doesn't use

[jira] [Updated] (YARN-117) Enhance YARN service model

2013-05-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-117: Attachment: YARN-117-007.patch patch in sync with with {{YARN-530-005.patch}} #adapts to the new

[jira] [Commented] (YARN-117) Enhance YARN service model

2013-05-15 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658977#comment-13658977 ] Milind Bhandarkar commented on YARN-117: Hi, This is an automated message. Please

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658989#comment-13658989 ] Hadoop QA commented on YARN-638: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-530) Define Service model strictly, implement AbstractService for robust subclassing, migrate yarn-common services

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13658997#comment-13658997 ] Hadoop QA commented on YARN-530: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-666) [Umbrella] Support rolling upgrades in YARN

2013-05-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659024#comment-13659024 ] Carlo Curino commented on YARN-666: --- Hi Vinod, I will give you some numbers but bare in

[jira] [Updated] (YARN-117) Enhance YARN service model

2013-05-15 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-117: Attachment: YARN-117-008.patch build diff from root of repository, so patch can apply it

[jira] [Updated] (YARN-688) Containers not cleaned up when NM received SHUTDOWN event from NodeStatusUpdater

2013-05-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-688: - Attachment: YARN-688.1.patch This patch basically creates a new thread on handling shutdown event from

[jira] [Commented] (YARN-117) Enhance YARN service model

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659136#comment-13659136 ] Hadoop QA commented on YARN-117: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-628) Fix YarnException unwrapping

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659225#comment-13659225 ] Hadoop QA commented on YARN-628: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-688) Containers not cleaned up when NM received SHUTDOWN event from NodeStatusUpdater

2013-05-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659227#comment-13659227 ] Hadoop QA commented on YARN-688: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-628) Fix YarnException unwrapping

2013-05-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13659251#comment-13659251 ] Vinod Kumar Vavilapalli commented on YARN-628: -- This looks perfect. Will run