[jira] [Commented] (YARN-613) Create NM proxy per NM instead of per container

2013-05-13 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656029#comment-13656029 ] Daryn Sharp commented on YARN-613: -- Agreed that a rogue NM is impossible to prevent

[jira] [Commented] (YARN-422) Add NM client library

2013-05-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656127#comment-13656127 ] Zhijie Shen commented on YARN-422: -- {quote} Why is TestAMRMClient being removed? {quote}

[jira] [Assigned] (YARN-662) Enforce required parameters for all the protocols

2013-05-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-662: Assignee: Zhijie Shen Enforce required parameters for all the protocols

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656207#comment-13656207 ] Bikas Saha commented on YARN-638: - I think the second operation will cover the first one

[jira] [Commented] (YARN-614) Retry attempts automatically for hardware failures or YARN issues and set default app retries to 1

2013-05-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656211#comment-13656211 ] Bikas Saha commented on YARN-614: - To be clear, it would be great if we can simplify the

[jira] [Commented] (YARN-666) [Umbrella] Support rolling upgrades in YARN

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656331#comment-13656331 ] Siddharth Seth commented on YARN-666: - bq. Steps to upgrade a YARN cluster: do you think

[jira] [Commented] (YARN-673) Remove yarn-default.xml

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656343#comment-13656343 ] Siddharth Seth commented on YARN-673: - The documentation will be part of the source

[jira] [Commented] (YARN-672) Consider Localizing Resources within the NM process itself in non-secure deployments

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656344#comment-13656344 ] Siddharth Seth commented on YARN-672: - bq. Should be careful while doing this. What I'd

[jira] [Commented] (YARN-673) Remove yarn-default.xml

2013-05-13 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656348#comment-13656348 ] Hitesh Shah commented on YARN-673: -- How about: {code} ---

[jira] [Assigned] (YARN-667) Data persisted by YARN daemons should be versioned

2013-05-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-667: Assignee: Vinod Kumar Vavilapalli So in summary, we will need to version -

[jira] [Assigned] (YARN-668) TokenIdentifier serialization should consider Unknown fields

2013-05-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-668: Assignee: Vinod Kumar Vavilapalli +1 for doing this. Overall, we need this

[jira] [Assigned] (YARN-669) ContainerTokens sent from the RM to NM via the AM should be a byte field

2013-05-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned YARN-669: Assignee: Vinod Kumar Vavilapalli As I noted elsewhere, ContainerToken is

[jira] [Commented] (YARN-613) Create NM proxy per NM instead of per container

2013-05-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656390#comment-13656390 ] Vinod Kumar Vavilapalli commented on YARN-613: -- Till now, NMs have always been

[jira] [Updated] (YARN-535) TestUnmanagedAMLauncher can corrupt target/test-classes/yarn-site.xml during write phase, breaks later test runs

2013-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-535: Attachment: YARN-535-02.patch Updated version with the same logic added to {{TestDistributedShell}},

[jira] [Resolved] (YARN-356) Add YARN_NODEMANAGER_OPTS and YARN_RESOURCEMANAGER_OPTS to yarn.env

2013-05-13 Thread Lohit Vijayarenu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lohit Vijayarenu resolved YARN-356. --- Resolution: Invalid Add YARN_NODEMANAGER_OPTS and YARN_RESOURCEMANAGER_OPTS to yarn.env

[jira] [Commented] (YARN-356) Add YARN_NODEMANAGER_OPTS and YARN_RESOURCEMANAGER_OPTS to yarn.env

2013-05-13 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/YARN-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656454#comment-13656454 ] Harsh J commented on YARN-356: -- Hey Lohit, I think we can doc these on the yarn-env.sh

[jira] [Reopened] (YARN-356) Add YARN_NODEMANAGER_OPTS and YARN_RESOURCEMANAGER_OPTS to yarn.env

2013-05-13 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/YARN-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J reopened YARN-356: -- Add YARN_NODEMANAGER_OPTS and YARN_RESOURCEMANAGER_OPTS to yarn.env

[jira] [Commented] (YARN-617) In unsercure mode, AM can fake resource requirements

2013-05-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656490#comment-13656490 ] Omkar Vinit Joshi commented on YARN-617: [~vinodkv] Fixed. [~daryn] bq.

[jira] [Commented] (YARN-673) Remove yarn-default.xml

2013-05-13 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/YARN-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656498#comment-13656498 ] Alejandro Abdelnur commented on YARN-673: - Currently the default.xml files are XSDed

[jira] [Moved] (YARN-677) Add test methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler

2013-05-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli moved HDFS-4536 to YARN-677: Affects Version/s: (was: 0.23.6)

[jira] [Updated] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-638: - Attachment: YARN-638.7.patch The new patch moved addPersistedToken updatePersistedKey in hdfs DTsecretManager to

[jira] [Commented] (YARN-677) Add test methods in org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairScheduler

2013-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656518#comment-13656518 ] Hadoop QA commented on YARN-677: {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-678) Delete FilterService

2013-05-13 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-678: --- Summary: Delete FilterService Key: YARN-678 URL: https://issues.apache.org/jira/browse/YARN-678 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656527#comment-13656527 ] Hadoop QA commented on YARN-638: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-638: - Attachment: YARN-638.8.patch fixed javac -1 Restore RMDelegationTokens after RM Restart

[jira] [Created] (YARN-679) add an entry point that can start any Yarn service

2013-05-13 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-679: --- Summary: add an entry point that can start any Yarn service Key: YARN-679 URL: https://issues.apache.org/jira/browse/YARN-679 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2013-05-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: YARN-679-001.patch This is to show Vinod why {{Service.waitForServiceToStop()}} is

[jira] [Created] (YARN-680) Cleanup package dependecies

2013-05-13 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-680: --- Summary: Cleanup package dependecies Key: YARN-680 URL: https://issues.apache.org/jira/browse/YARN-680 Project: Hadoop YARN Issue Type: Bug Reporter:

[jira] [Resolved] (YARN-680) Cleanup package dependecies

2013-05-13 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved YARN-680. - Resolution: Invalid Wrong Project Cleanup package dependecies

[jira] [Commented] (YARN-642) Fix up /nodes REST API to have 1 param and be consistent with the Java API

2013-05-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656582#comment-13656582 ] Sandy Ryza commented on YARN-642: - [~vinodkv], your proposal sounds good to me. Uploading a

[jira] [Updated] (YARN-642) Fix up /nodes REST API to have 1 param and be consistent with the Java API

2013-05-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-642: Attachment: YARN-642-2.patch Fix up /nodes REST API to have 1 param and be consistent with the Java API

[jira] [Commented] (YARN-680) Cleanup package dependecies

2013-05-13 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656584#comment-13656584 ] Vinod Kumar Vavilapalli commented on YARN-680: -- bq. Wrong Project Hehe, you

[jira] [Updated] (YARN-656) In scheduler UI, including reserved memory Memory Total can make it exceed cluster capacity.

2013-05-13 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-656: Summary: In scheduler UI, including reserved memory Memory Total can make it exceed cluster capacity. (was:

[jira] [Commented] (YARN-642) Fix up /nodes REST API to have 1 param and be consistent with the Java API

2013-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656599#comment-13656599 ] Hadoop QA commented on YARN-642: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-615) ContainerLaunchContext.containerTokens should simply be called tokens

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656631#comment-13656631 ] Siddharth Seth commented on YARN-615: - +1. Will commit this in a bit.

[jira] [Commented] (YARN-673) Remove yarn-default.xml

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656641#comment-13656641 ] Siddharth Seth commented on YARN-673: - [~hitesh] That works as well. We can then defer

[jira] [Commented] (YARN-638) Restore RMDelegationTokens after RM Restart

2013-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656646#comment-13656646 ] Hadoop QA commented on YARN-638: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-617) In unsercure mode, AM can fake resource requirements

2013-05-13 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-617: --- Attachment: YARN-617-20130513.patch In unsercure mode, AM can fake resource requirements

[jira] [Commented] (YARN-617) In unsercure mode, AM can fake resource requirements

2013-05-13 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12583066/YARN-617-20130513.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include

[jira] [Assigned] (YARN-628) Fix YarnException unwrapping

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned YARN-628: --- Assignee: Siddharth Seth Fix YarnException unwrapping

[jira] [Updated] (YARN-628) Fix YarnException unwrapping

2013-05-13 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated YARN-628: Attachment: YARN-628.txt The patch makes the following changes - Changes

[jira] [Commented] (YARN-628) Fix YarnException unwrapping

2013-05-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13656718#comment-13656718 ] Hadoop QA commented on YARN-628: {color:green}+1 overall{color}. Here are the results of