[jira] [Updated] (YARN-363) yarn proxyserver fails to find webapps/proxy directory on startup

2013-04-22 Thread Kenji Kikushima (JIRA)
[ https://issues.apache.org/jira/browse/YARN-363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenji Kikushima updated YARN-363: - Attachment: YARN-363.patch I confirmed same exception on 0.23.7. Creating webapp/proxy directory

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2013-04-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638209#comment-13638209 ] Karthik Kambatla commented on YARN-596: --- Looks like we need preemptContainer() that

[jira] [Commented] (YARN-597) TestFSDownload fails on Windows because of dependencies on tar/gzip/jar tools

2013-04-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638225#comment-13638225 ] Chris Nauroth commented on YARN-597: +1 for the patch. I ran this successfully on Mac

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2013-04-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638229#comment-13638229 ] Sandy Ryza commented on YARN-596: - Agreed In fair scheduler,

[jira] [Updated] (YARN-583) Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache

2013-04-22 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-583: --- Attachment: yarn-583-20130422.patch Application cache files should be localized under

[jira] [Commented] (YARN-571) User should not be part of ContainerLaunchContext

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638234#comment-13638234 ] Hadoop QA commented on YARN-571: {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-598) Add virtual cores to queue metrics

2013-04-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-598: --- Summary: Add virtual cores to queue metrics Key: YARN-598 URL: https://issues.apache.org/jira/browse/YARN-598 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-583) Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache

2013-04-22 Thread Hadoop QA (JIRA)
of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12579864/yarn-583-20130422.patch against trunk revision . {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears to include 1

[jira] [Commented] (YARN-549) Asynchronous application submission

2013-04-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638266#comment-13638266 ] Zhijie Shen commented on YARN-549: -- Thanks @Bikas for the comments. {quote} The new thread

[jira] [Commented] (YARN-549) Asynchronous application submission

2013-04-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638327#comment-13638327 ] Bikas Saha commented on YARN-549: - The sleep/blocking is already happening inside

[jira] [Commented] (YARN-562) NM should reject containers allocated by previous RM

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638431#comment-13638431 ] Hadoop QA commented on YARN-562: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-571) User should not be part of ContainerLaunchContext

2013-04-22 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638434#comment-13638434 ] Siddharth Seth commented on YARN-571: - Vinod, looks like the patch is out of sync again.

[jira] [Updated] (YARN-549) Asynchronous application submission

2013-04-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-549: - Attachment: YARN-549.3.patch In the newest patch, the most significant change is that I've removed the

[jira] [Updated] (YARN-581) Test and verify that app delegation tokens are restored after RM restart

2013-04-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-581: - Attachment: YARN-581.1.patch This patch add test to verify delegation tokens are restored after RM restart

[jira] [Commented] (YARN-549) Asynchronous application submission

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638476#comment-13638476 ] Hadoop QA commented on YARN-549: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-571) User should not be part of ContainerLaunchContext

2013-04-22 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638481#comment-13638481 ] Vinod Kumar Vavilapalli commented on YARN-571: -- bq. Also, the user could be

[jira] [Commented] (YARN-562) NM should reject containers allocated by previous RM

2013-04-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638480#comment-13638480 ] Bikas Saha commented on YARN-562: - Please define a YARN constant or something instead of

[jira] [Commented] (YARN-581) Test and verify that app delegation tokens are restored after RM restart

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638482#comment-13638482 ] Hadoop QA commented on YARN-581: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-549) Asynchronous application submission

2013-04-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638498#comment-13638498 ] Bikas Saha commented on YARN-549: - Looks good. +1. The simpler test made it a cheaper to

[jira] [Updated] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-549: Summary: YarnClient.submitApplication should wait for application to be accepted by the RM (was:

[jira] [Updated] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-549: Description: Currently, when submitting an application, storeApplication will be called for recovery.

[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638504#comment-13638504 ] Bikas Saha commented on YARN-549: - Can you please update the patch to add javadoc to the

[jira] [Created] (YARN-599) Refactoring submitApplication in ClientRMService and RMAppManager

2013-04-22 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-599: Summary: Refactoring submitApplication in ClientRMService and RMAppManager Key: YARN-599 URL: https://issues.apache.org/jira/browse/YARN-599 Project: Hadoop YARN

[jira] [Commented] (YARN-583) Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache

2013-04-22 Thread Omkar Vinit Joshi (JIRA)
, yarn-583-20130417.patch, yarn-583-20130419.patch, yarn-583-20130422.patch Currently application cache files are getting localized under local-dir/usercache/userid/appcache/appid/. however they should be localized under filecache sub directory. -- This message is automatically generated by JIRA

[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638513#comment-13638513 ] Zhijie Shen commented on YARN-549: -- {code} Is there a jira opened to track the server side

[jira] [Updated] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-549: - Attachment: YARN-549.4.patch Added the extra javadoc for ClientRMService in addition to fixing a typo in

[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638556#comment-13638556 ] Hadoop QA commented on YARN-549: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-562) NM should reject containers allocated by previous RM

2013-04-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638568#comment-13638568 ] Jian He commented on YARN-562: -- bq. Can we signal an object here so that we can be notified

[jira] [Updated] (YARN-599) Refactoring submitApplication in ClientRMService and RMAppManager

2013-04-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-599: - Attachment: YARN-599.1.patch Extracted the changes in YARN-549 patch, which is related to the refactoring

[jira] [Created] (YARN-600) Hook up cgroups CPU settings to the number of virtual cores allocated

2013-04-22 Thread Sandy Ryza (JIRA)
Sandy Ryza created YARN-600: --- Summary: Hook up cgroups CPU settings to the number of virtual cores allocated Key: YARN-600 URL: https://issues.apache.org/jira/browse/YARN-600 Project: Hadoop YARN

[jira] [Commented] (YARN-599) Refactoring submitApplication in ClientRMService and RMAppManager

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638596#comment-13638596 ] Hadoop QA commented on YARN-599: {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-598) Add virtual cores to queue metrics

2013-04-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-598: Attachment: YARN-598.patch Add virtual cores to queue metrics --

[jira] [Commented] (YARN-561) Nodemanager should set some key information into the environment of every container that it launches.

2013-04-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638612#comment-13638612 ] Xuan Gong commented on YARN-561: Apply the latest comments: 1. Add Local_dirs as env for

[jira] [Updated] (YARN-561) Nodemanager should set some key information into the environment of every container that it launches.

2013-04-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-561: --- Attachment: YARN-561.9.patch Nodemanager should set some key information into the environment of every

[jira] [Commented] (YARN-598) Add virtual cores to queue metrics

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638652#comment-13638652 ] Hadoop QA commented on YARN-598: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-579) Make ApplicationToken part of Container's token list to help RM-restart

2013-04-22 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-579: - Attachment: YARN-579-20130422.1.txt Here's a patch that removes it from env. It is

[jira] [Commented] (YARN-561) Nodemanager should set some key information into the environment of every container that it launches.

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638680#comment-13638680 ] Hadoop QA commented on YARN-561: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-579) Make ApplicationToken part of Container's token list to help RM-restart

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638703#comment-13638703 ] Hadoop QA commented on YARN-579: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-549) YarnClient.submitApplication should wait for application to be accepted by the RM

2013-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638742#comment-13638742 ] Hudson commented on YARN-549: - Integrated in Hadoop-trunk-Commit #3648 (See

[jira] [Commented] (YARN-583) Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache

2013-04-22 Thread Vinod Kumar Vavilapalli (JIRA)
-20130416.patch, yarn-583-20130417.patch, yarn-583-20130419.patch, yarn-583-20130422.patch Currently application cache files are getting localized under local-dir/usercache/userid/appcache/appid/. however they should be localized under filecache sub directory. -- This message is automatically

[jira] [Commented] (YARN-583) Application cache files should be localized under local-dir/usercache/userid/appcache/appid/filecache

2013-04-22 Thread Hudson (JIRA)
YARN Issue Type: Sub-task Reporter: Omkar Vinit Joshi Assignee: Omkar Vinit Joshi Fix For: 2.0.5-beta Attachments: yarn-583-20130416.1.patch, yarn-583-20130416.patch, yarn-583-20130417.patch, yarn-583-20130419.patch, yarn-583-20130422.patch

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638783#comment-13638783 ] Carlo Curino commented on YARN-45: -- Updated the protocol patch (and the implementation for

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: YARN-45.patch Scheduler feedback to AM to release containers

[jira] [Updated] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-567: -- Attachment: YARN-567.patch RM changes to support preemption for FairScheduler and CapacityScheduler

[jira] [Updated] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-567: -- Attachment: (was: common.patch) RM changes to support preemption for FairScheduler and

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-568: -- Attachment: YARN-568.patch FairScheduler: support for work-preserving preemption

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-568: -- Attachment: (was: YARN-568.patch) FairScheduler: support for work-preserving preemption

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-569: -- Attachment: YARN-569.patch CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-569: -- Attachment: (was: capacity.patch) CapacityScheduler: support for preemption (using a capacity

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-568: -- Attachment: (was: fair.patch) FairScheduler: support for work-preserving preemption

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

2013-04-22 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-568: -- Attachment: YARN-568.patch FairScheduler: support for work-preserving preemption

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13638814#comment-13638814 ] Hadoop QA commented on YARN-45: --- {color:red}-1 overall{color}. Here are the results of testing