[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708266#comment-13708266 ] Bikas Saha commented on YARN-521: - Same error and it does not look like a time out.

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708267#comment-13708267 ] Bikas Saha commented on YARN-513: - Why does YARNClient need to accept the rmaddress as a

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708278#comment-13708278 ] Sandy Ryza commented on YARN-521: - Yeah, I noticed. I'm pretty puzzled because I still

[jira] [Commented] (YARN-917) Job can fail when RM restarts after staging dir is cleaned but before MR successfully unregister with RM

2013-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708537#comment-13708537 ] Jason Lowe commented on YARN-917: - I think one way to solve this is to move the removal of

[jira] [Updated] (YARN-909) Disable TestLinuxContainerExecutorWithMocks on Windows

2013-07-15 Thread Chuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chuan Liu updated YARN-909: --- Attachment: YARN-909.2.patch Thanks for the suggestion, Chris! Attaching a new patch.

[jira] [Updated] (YARN-909) Disable TestLinuxContainerExecutorWithMocks on Windows

2013-07-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-909: --- Attachment: YARN-909.3.patch Actually, I was thinking we could put the {{assumeTrue}} call inside the

[jira] [Commented] (YARN-149) ResourceManager (RM) High-Availability (HA)

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708636#comment-13708636 ] Bikas Saha commented on YARN-149: - Thanks. I looked at the draft. Will incorporate stuff

[jira] [Updated] (YARN-909) Disable TestLinuxContainerExecutorWithMocks on Windows

2013-07-15 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated YARN-909: --- Component/s: nodemanager Target Version/s: 3.0.0, 2.1.0-beta Affects Version/s:

[jira] [Commented] (YARN-909) Disable TestLinuxContainerExecutorWithMocks on Windows

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708646#comment-13708646 ] Hadoop QA commented on YARN-909: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708652#comment-13708652 ] Sandy Ryza commented on YARN-521: - Looks like Eclipse wasn't failing on the non-JUnit

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708663#comment-13708663 ] Bikas Saha commented on YARN-521: - Diff is empty for the last 2 patches. Can you please

[jira] [Created] (YARN-924) TestNMClient.testNMClientNoCleanupOnStop frequently failing due to timeout

2013-07-15 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-924: --- Summary: TestNMClient.testNMClientNoCleanupOnStop frequently failing due to timeout Key: YARN-924 URL: https://issues.apache.org/jira/browse/YARN-924 Project: Hadoop YARN

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708676#comment-13708676 ] Hadoop QA commented on YARN-521: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-654) AMRMClient: Perform sanity checks for parameters of public methods

2013-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708680#comment-13708680 ] Hudson commented on YARN-654: - SUCCESS: Integrated in Hadoop-trunk-Commit #4082 (See

[jira] [Updated] (YARN-661) NM fails to cleanup local directories for users

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-661: --- Attachment: YARN-661-20130715.1.patch NM fails to cleanup local directories for users

[jira] [Commented] (YARN-909) Disable TestLinuxContainerExecutorWithMocks on Windows

2013-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708689#comment-13708689 ] Hudson commented on YARN-909: - SUCCESS: Integrated in Hadoop-trunk-Commit #4083 (See

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708696#comment-13708696 ] Jian He commented on YARN-513: -- bq. Why does YARNClient need to accept the rmaddress as a

[jira] [Updated] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-521: Attachment: YARN-521-6.patch Augment AM - RM client module to be able to request containers only at

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708707#comment-13708707 ] Sandy Ryza commented on YARN-521: - (The diff you were comparing was before I had uploaded

[jira] [Commented] (YARN-149) ResourceManager (RM) High-Availability (HA)

2013-07-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708732#comment-13708732 ] Karthik Kambatla commented on YARN-149: --- Thanks Bikas. bq. 1) extra daemon to manage

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708734#comment-13708734 ] Jian He commented on YARN-353: -- Thanks for the review, Karthik bq.YarnConfiguration: how about

[jira] [Updated] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-353: - Attachment: YARN-353.6.patch Add Zookeeper-based store implementation for RMStateStore

[jira] [Commented] (YARN-661) NM fails to cleanup local directories for users

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708735#comment-13708735 ] Hadoop QA commented on YARN-661: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708750#comment-13708750 ] Hadoop QA commented on YARN-521: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-903) DistributedShell throwing Errors in logs after successfull completion

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708764#comment-13708764 ] Omkar Vinit Joshi commented on YARN-903: planning to fix this.. I am planning to

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708761#comment-13708761 ] Zhijie Shen commented on YARN-744: -- The passed in appAttemptId for an app currently seems

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708796#comment-13708796 ] Hadoop QA commented on YARN-353: {color:red}-1 overall{color}. Here are the results of

[jira] [Resolved] (YARN-924) TestNMClient.testNMClientNoCleanupOnStop frequently failing due to timeout

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-924. -- Resolution: Duplicate It is duplicate with YARN-906.

[jira] [Commented] (YARN-919) Setting default heap sizes in yarn env

2013-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13708997#comment-13708997 ] Mayank Bansal commented on YARN-919: Thanks [~hitesh] for comments The primary

[jira] [Updated] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-353: - Attachment: YARN-353.7.patch Add Zookeeper-based store implementation for RMStateStore

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Mayank Bansal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709030#comment-13709030 ] Mayank Bansal commented on YARN-321: Overall Looks good, However some points to consider

[jira] [Created] (YARN-925) Interface of HistoryStorage for AHS

2013-07-15 Thread Mayank Bansal (JIRA)
Mayank Bansal created YARN-925: -- Summary: Interface of HistoryStorage for AHS Key: YARN-925 URL: https://issues.apache.org/jira/browse/YARN-925 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-353) Add Zookeeper-based store implementation for RMStateStore

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709060#comment-13709060 ] Hadoop QA commented on YARN-353: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-513: - Attachment: YARN-513.15.patch Create common proxy client for communicating with RM

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709063#comment-13709063 ] Jian He commented on YARN-513: -- New patch removed rmaddress as a parameter from YARNClient

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709064#comment-13709064 ] Omkar Vinit Joshi commented on YARN-744: bq. BTW, is it convenient to write a test

[jira] [Commented] (YARN-914) Support graceful decommission of nodemanager

2013-07-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709067#comment-13709067 ] Aaron T. Myers commented on YARN-914: - Should we perhaps do an s/NN/NM/g in the

[jira] [Updated] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-744: --- Attachment: YARN-744-20130715.1.patch Race condition in ApplicationMasterService.allocate

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709072#comment-13709072 ] Zhijie Shen commented on YARN-744: -- bq. locking on appAttemptId in case of allocate /

[jira] [Commented] (YARN-919) Setting default heap sizes in yarn env

2013-07-15 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709088#comment-13709088 ] Hitesh Shah commented on YARN-919: -- [~mayank_bansal] Yes, that sounds good. Something

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709091#comment-13709091 ] Bikas Saha commented on YARN-744: - Why do we need a wrapper? We should not be locking on the

[jira] [Updated] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-744: Priority: Minor (was: Major) Race condition in ApplicationMasterService.allocate .. It might process

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709096#comment-13709096 ] Bikas Saha commented on YARN-744: - btw. it does not look like this is a practical problem.

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709098#comment-13709098 ] Zhijie Shen commented on YARN-321: -- bq. Is it per application or only one thread in RM? I

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709113#comment-13709113 ] Hadoop QA commented on YARN-513: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-914) Support graceful decommission of nodemanager

2013-07-15 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated YARN-914: - Description: When NNs are decommissioned for non-fault reasons (capacity change etc.), it's desirable to minimize

[jira] [Updated] (YARN-918) ApplicationMasterProtocol doesn't need ApplicationAttemptId in the payload after YARN-701

2013-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-918: - Attachment: YARN-918-20130715.txt Here's a patch that works. Needs to be applied

[jira] [Updated] (YARN-914) Support graceful decommission of nodemanager

2013-07-15 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Lu updated YARN-914: - Description: When NMs are decommissioned for non-fault reasons (capacity change etc.), it's desirable to minimize

[jira] [Created] (YARN-926) ContainerManagerProtcol APIs should take in requests for multiple containers

2013-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-926: Summary: ContainerManagerProtcol APIs should take in requests for multiple containers Key: YARN-926 URL: https://issues.apache.org/jira/browse/YARN-926

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709147#comment-13709147 ] Hadoop QA commented on YARN-744: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-914) Support graceful decommission of nodemanager

2013-07-15 Thread Luke Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709144#comment-13709144 ] Luke Lu commented on YARN-914: -- [~atm]: Nice catch! Of course :) Support

[jira] [Updated] (YARN-926) ContainerManagerProtcol APIs should take in requests for multiple containers

2013-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-926: - Priority: Blocker (was: Major) Target Version/s: 2.1.0-beta

[jira] [Commented] (YARN-912) Create exceptions package in common/api for yarn and move client facing exceptions to them

2013-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709157#comment-13709157 ] Vinod Kumar Vavilapalli commented on YARN-912: -- Can you also take care of

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709192#comment-13709192 ] Karthik Kambatla commented on YARN-321: --- Few other considerations: bq. Running as

[jira] [Commented] (YARN-906) TestNMClient.testNMClientNoCleanupOnStop fails occasionally

2013-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709195#comment-13709195 ] Zhijie Shen commented on YARN-906: -- Did some investigation in this test failure. The test

[jira] [Assigned] (YARN-306) FIFO scheduler doesn't respect changing job priority

2013-07-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-306: - Assignee: (was: Karthik Kambatla) FIFO scheduler doesn't respect changing job

[jira] [Commented] (YARN-896) Roll up for long lived YARN

2013-07-15 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/YARN-896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709242#comment-13709242 ] Thomas Weise commented on YARN-896: --- We also identified the need for token renewal (app

[jira] [Commented] (YARN-654) AMRMClient: Perform sanity checks for parameters of public methods

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709243#comment-13709243 ] Bikas Saha commented on YARN-654: - Sorry the minor change I made in the patch that changed

[jira] [Updated] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-521: Attachment: YARN-521.final.patch Augment AM - RM client module to be able to request containers only at

[jira] [Updated] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-513: - Attachment: YARN-513.16.patch Create common proxy client for communicating with RM

[jira] [Updated] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-875: --- Attachment: YARN-875.1.patch Application can hang if AMRMClientAsync callback thread has exception

[jira] [Commented] (YARN-914) Support graceful decommission of nodemanager

2013-07-15 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709255#comment-13709255 ] Aaron T. Myers commented on YARN-914: - Thanks, Luke. Support graceful

[jira] [Commented] (YARN-321) Generic application history service

2013-07-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709262#comment-13709262 ] Jason Lowe commented on YARN-321: - bq. Is there a reason to embed this inside the RM? I

[jira] [Resolved] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved YARN-521. - Resolution: Fixed Fix Version/s: 2.1.0-beta Hadoop Flags: Reviewed Committed to trunk,

[jira] [Commented] (YARN-523) Container localization failures aren't reported from NM to RM

2013-07-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709280#comment-13709280 ] Vinod Kumar Vavilapalli commented on YARN-523: -- Tx for the testing update Jian.

[jira] [Commented] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709304#comment-13709304 ] Omkar Vinit Joshi commented on YARN-744: bq. We should not be locking on the app

[jira] [Resolved] (YARN-430) Add HDFS based store for RM which manages the store using directories

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha resolved YARN-430. - Resolution: Not A Problem YARN-922 adds this to the FileSystemStateStore. HDFS retry behavior can be

[jira] [Commented] (YARN-922) Change FileSystemRMStateStore to use directories

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709311#comment-13709311 ] Jian He commented on YARN-922: -- existing test cases covers this, no need to add more tests

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709329#comment-13709329 ] Hadoop QA commented on YARN-513: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-513: - Attachment: YARN-513.17.patch rebased the patch Create common proxy client for communicating

[jira] [Updated] (YARN-922) Change FileSystemRMStateStore to use directories

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-922: - Attachment: YARN-922.1.patch Change FileSystemRMStateStore to use directories

[jira] [Created] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-15 Thread Bikas Saha (JIRA)
Bikas Saha created YARN-927: --- Summary: Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest Key: YARN-927 URL: https://issues.apache.org/jira/browse/YARN-927

[jira] [Commented] (YARN-245) Node Manager gives InvalidStateTransitonException for FINISH_APPLICATION at FINISHED

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709355#comment-13709355 ] Omkar Vinit Joshi commented on YARN-245: Thanks mayank... I just took a look at your

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709359#comment-13709359 ] Sandy Ryza commented on YARN-927: - Removing the ability to request multiple containers would

[jira] [Commented] (YARN-523) Container localization failures aren't reported from NM to RM

2013-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709366#comment-13709366 ] Hudson commented on YARN-523: - SUCCESS: Integrated in Hadoop-trunk-Commit #4086 (See

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709367#comment-13709367 ] Hudson commented on YARN-521: - SUCCESS: Integrated in Hadoop-trunk-Commit #4086 (See

[jira] [Commented] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709370#comment-13709370 ] Hadoop QA commented on YARN-875: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709380#comment-13709380 ] Bikas Saha commented on YARN-927: - IMO calling addContainerRequest(new ContainerRequest(5))

[jira] [Commented] (YARN-922) Change FileSystemRMStateStore to use directories

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709382#comment-13709382 ] Hadoop QA commented on YARN-922: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-62) AM should not be able to abuse container tokens for repetitive container launches

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-62?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709388#comment-13709388 ] Omkar Vinit Joshi commented on YARN-62: --- thanks vinod.. bq. Though it works in most

[jira] [Updated] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-875: Attachment: YARN-875.1.patch Kicking test again. Application can hang if AMRMClientAsync

[jira] [Updated] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-744: --- Description: Looks like the lock taken in this is broken. It takes a lock on lastResponse

[jira] [Updated] (YARN-744) Race condition in ApplicationMasterService.allocate .. It might process same allocate request twice resulting in additional containers getting allocated.

2013-07-15 Thread Omkar Vinit Joshi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated YARN-744: --- Description: Looks like the lock taken in this is broken. It takes a lock on lastResponse

[jira] [Commented] (YARN-521) Augment AM - RM client module to be able to request containers only at specific locations

2013-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709398#comment-13709398 ] Hudson commented on YARN-521: - SUCCESS: Integrated in Hadoop-trunk-Commit #4087 (See

[jira] [Commented] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709408#comment-13709408 ] Hadoop QA commented on YARN-875: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-927: Attachment: YARN-927.1.patch Attaching the refactoring patch. The code change in DistributedShell reflects

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-07-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709420#comment-13709420 ] Joep Rottinghuis commented on YARN-451: --- It would certainly be very useful to be able

[jira] [Updated] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bikas Saha updated YARN-513: Attachment: YARN-513.17.patch Create common proxy client for communicating with RM

[jira] [Commented] (YARN-927) Change ContainerRequest to not have more than 1 container count and remove StoreContainerRequest

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709433#comment-13709433 ] Hadoop QA commented on YARN-927: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709443#comment-13709443 ] Hadoop QA commented on YARN-513: {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-922) Change FileSystemRMStateStore to use directories

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-922: - Attachment: YARN-922.2.patch fixed test failure. Change FileSystemRMStateStore to use

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709457#comment-13709457 ] Jian He commented on YARN-513: -- The above test failures is not related to this patch,

[jira] [Commented] (YARN-922) Change FileSystemRMStateStore to use directories

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709458#comment-13709458 ] Hadoop QA commented on YARN-922: {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709461#comment-13709461 ] Xuan Gong commented on YARN-875: fix -1 on javadoc Application can hang if

[jira] [Updated] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-875: --- Attachment: YARN-875.2.patch Application can hang if AMRMClientAsync callback thread has exception

[jira] [Commented] (YARN-875) Application can hang if AMRMClientAsync callback thread has exception

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709470#comment-13709470 ] Hadoop QA commented on YARN-875: {color:green}+1 overall{color}. Here are the results of

[jira] [Moved] (YARN-928) While killing attempt for a task which got succeeded , task transition happens from SUCCEEDED to SCHEDULED and InvalidStateTransitonException is thrown

2013-07-15 Thread J.Andreina (JIRA)
[ https://issues.apache.org/jira/browse/YARN-928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina moved MAPREDUCE-5389 to YARN-928: Component/s: (was: task) applications

[jira] [Commented] (YARN-513) Create common proxy client for communicating with RM

2013-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13709480#comment-13709480 ] Hadoop QA commented on YARN-513: {color:red}-1 overall{color}. Here are the results of