[jira] [Commented] (YARN-3145) ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306796#comment-14306796 ] Hadoop QA commented on YARN-3145: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Comment Edited] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306781#comment-14306781 ] Jian He edited comment on YARN-3100 at 2/5/15 7:43 AM: --- bq. Are these

[jira] [Comment Edited] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306781#comment-14306781 ] Jian He edited comment on YARN-3100 at 2/5/15 7:32 AM: --- bq. Are these

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306781#comment-14306781 ] Jian He commented on YARN-3100: --- bq. Are these pluggable types? Are there other, future enti

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306748#comment-14306748 ] Sunil G commented on YARN-3136: --- Hi [~rohithsharma] *getLiveContainers()* is giving a copy a

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306740#comment-14306740 ] Jonathan Eagles commented on YARN-3144: --- In a secure environment with kerberos enable

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306738#comment-14306738 ] Chris Douglas commented on YARN-3100: - Motivation for the conversion from {{QueueACL}}

[jira] [Updated] (YARN-3145) ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo

2015-02-04 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-3145: - Attachment: YARN-3145.001.patch The synchronization of childQueues looks not enough. Attaching a fi

[jira] [Commented] (YARN-3145) ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo

2015-02-04 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306726#comment-14306726 ] Rohith commented on YARN-3145: -- [~jianhe] I am looking into problem,is it from trunk version?

[jira] [Assigned] (YARN-3145) ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo

2015-02-04 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-3145: Assignee: Rohith > ConcurrentModificationException on CapacityScheduler > ParentQueue#getQueueUserAclInfo >

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2015-02-04 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306719#comment-14306719 ] Rohith commented on YARN-3142: -- [~leftnoteasy] Could you give some description about problem?

[jira] [Updated] (YARN-3145) ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3145: -- Summary: ConcurrentModificationException on CapacityScheduler ParentQueue#getQueueUserAclInfo (was: ConcurrentMo

[jira] [Created] (YARN-3145) ConcurrentModificationException on ParentQueue#getQueueUserAclInfo

2015-02-04 Thread Jian He (JIRA)
Jian He created YARN-3145: - Summary: ConcurrentModificationException on ParentQueue#getQueueUserAclInfo Key: YARN-3145 URL: https://issues.apache.org/jira/browse/YARN-3145 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306659#comment-14306659 ] Zhijie Shen commented on YARN-3144: --- bq. This allows users to evaluate the timeline histo

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306655#comment-14306655 ] Rohith commented on YARN-3136: -- I agree that synchronization is not required for getTransferre

[jira] [Commented] (YARN-3126) FairScheduler: queue's usedResource is always more than the maxResource limit

2015-02-04 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306630#comment-14306630 ] Wei Yan commented on YARN-3126: --- [~Xia Hu], does this problem still exist in trunk version?

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306627#comment-14306627 ] Sunil G commented on YARN-3136: --- Hi [~jianhe] bq. getTransferredContainers does not need to

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-02-04 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306607#comment-14306607 ] Rohith commented on YARN-3094: -- +1(non-binding) LGTM > reset timer for liveness monitors afte

[jira] [Commented] (YARN-914) Support graceful decommission of nodemanager

2015-02-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306602#comment-14306602 ] Xuan Gong commented on YARN-914: Thanks for the proposal [~djp] bq. RM in failed over (with

[jira] [Updated] (YARN-3126) FairScheduler: queue's usedResource is always more than the maxResource limit

2015-02-04 Thread Xia Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xia Hu updated YARN-3126: - Attachment: resourcelimit.patch In fact I found this issue in cdh5.1.0-hadoop2.3.0, then I read the version2.3.0 c

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306556#comment-14306556 ] Jian He commented on YARN-3136: --- bq. ApplicationMasterService#allocate sorry, I meant registe

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306555#comment-14306555 ] Jian He commented on YARN-3136: --- I think the synchronization on getTransferredContainers is n

[jira] [Commented] (YARN-3033) implement NM starting the ATS writer companion

2015-02-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306526#comment-14306526 ] Junping Du commented on YARN-3033: -- That's all good thoughts, [~sjlee0]! One quick questi

[jira] [Assigned] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-3136: - Assignee: Sunil G (was: Varun Saxena) > getTransferredContainers can be a bottleneck during AM registrati

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306500#comment-14306500 ] Sunil G commented on YARN-3136: --- 1. As you mentioned a full lock on Scheduler is grabbed for

[jira] [Commented] (YARN-3123) Make YARN CLI show a single completed container even if the app is running

2015-02-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306495#comment-14306495 ] Naganarasimha G R commented on YARN-3123: - Thanks for reviewing and committing the

[jira] [Commented] (YARN-3123) Make YARN CLI show a single completed container even if the app is running

2015-02-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306494#comment-14306494 ] Naganarasimha G R commented on YARN-3123: - Thanks for reviewing and committing the

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306483#comment-14306483 ] Hadoop QA commented on YARN-3094: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306395#comment-14306395 ] Jonathan Eagles commented on YARN-3144: --- While I agree that it eventually will be a n

[jira] [Updated] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-02-04 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3094: --- Attachment: YARN-3094.5.patch The failed test case seems unrelated. Re-submit the same patch. > reset timer fo

[jira] [Updated] (YARN-914) Support graceful decommission of nodemanager

2015-02-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-914: Attachment: Gracefully Decommission of NodeManager (v1).pdf Put a proposal of design doc for this feature afte

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306372#comment-14306372 ] Jian He commented on YARN-3100: --- Chris, thanks for your comments ! bq. What is the behavior o

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306346#comment-14306346 ] Zhijie Shen commented on YARN-3144: --- Getting the timeline delegation token is only invoke

[jira] [Commented] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

2015-02-04 Thread Yang Hao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306330#comment-14306330 ] Yang Hao commented on YARN-3141: Can you give a description > Improve locks in SchedulerAp

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306315#comment-14306315 ] Jonathan Eagles commented on YARN-3144: --- That is exactly the case. However, any conn

[jira] [Commented] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306312#comment-14306312 ] Hadoop QA commented on YARN-3143: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306290#comment-14306290 ] Zhijie Shen commented on YARN-3144: --- [~jeagles], is the timeline server not up according

[jira] [Commented] (YARN-3123) Make YARN CLI show a single completed container even if the app is running

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306288#comment-14306288 ] Hudson commented on YARN-3123: -- FAILURE: Integrated in Hadoop-trunk-Commit #7009 (See [https:

[jira] [Resolved] (YARN-332) Fix issues identified by findbugs2

2015-02-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved YARN-332. Resolution: Duplicate > Fix issues identified by findbugs2 > --- > >

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306276#comment-14306276 ] Hadoop QA commented on YARN-3144: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-332) Fix issues identified by findbugs2

2015-02-04 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306274#comment-14306274 ] Akira AJISAKA commented on YARN-332: Now Hadoop use findbugs 3.0.0 and the warnings are

[jira] [Commented] (YARN-3123) Make YARN CLI show a single completed container even if the app is running

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306271#comment-14306271 ] Zhijie Shen commented on YARN-3123: --- Thanks Naga for the patch and Varun for the review!

[jira] [Commented] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306255#comment-14306255 ] Xuan Gong commented on YARN-3143: - bq. The problem here is that we're trying to look at a p

[jira] [Commented] (YARN-3123) Make YARN CLI show a single completed container even if the app is running

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306253#comment-14306253 ] Zhijie Shen commented on YARN-3123: --- +1 LGTM, will commit the patch > Make YARN CLI show

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306230#comment-14306230 ] Jonathan Eagles commented on YARN-3144: --- [~daryn], [~zjshen], can you have a look at

[jira] [Commented] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

2015-02-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306220#comment-14306220 ] Xuan Gong commented on YARN-3089: - bq. The call of DeletionService.delete where basepaths a

[jira] [Commented] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306207#comment-14306207 ] Jonathan Eagles commented on YARN-3144: --- Corresponding stack trace {code} 15/01/22 16

[jira] [Updated] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3144: -- Attachment: YARN-3144.1.patch > Configuration for making delegation token failures to timeline se

[jira] [Created] (YARN-3144) Configuration for making delegation token failures to timeline server not-fatal

2015-02-04 Thread Jonathan Eagles (JIRA)
Jonathan Eagles created YARN-3144: - Summary: Configuration for making delegation token failures to timeline server not-fatal Key: YARN-3144 URL: https://issues.apache.org/jira/browse/YARN-3144 Project

[jira] [Updated] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3143: - Attachment: YARN-3143.001.patch Patch to skip non-existent apps as we're walking the app reports. > RM App

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306177#comment-14306177 ] Chris Douglas commented on YARN-3100: - [~aw], have you read through the patch? What it

[jira] [Commented] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306169#comment-14306169 ] Jason Lowe commented on YARN-3143: -- I think this is caused by this code in the RMWebServic

[jira] [Commented] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306163#comment-14306163 ] Jason Lowe commented on YARN-3089: -- +1 latest patch lgtm. The eclipse warnings don't appe

[jira] [Assigned] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-3143: Assignee: Jason Lowe > RM Apps REST API can return NPE or entries missing id and other fields >

[jira] [Updated] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Kendall Thrapp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kendall Thrapp updated YARN-3143: - Description: I'm seeing intermittent null pointer exceptions being returned by the YARN Apps REST A

[jira] [Created] (YARN-3143) RM Apps REST API can return NPE or entries missing id and other fields

2015-02-04 Thread Kendall Thrapp (JIRA)
Kendall Thrapp created YARN-3143: Summary: RM Apps REST API can return NPE or entries missing id and other fields Key: YARN-3143 URL: https://issues.apache.org/jira/browse/YARN-3143 Project: Hadoop YA

[jira] [Commented] (YARN-3025) Provide API for retrieving blacklisted nodes

2015-02-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306155#comment-14306155 ] Ted Yu commented on YARN-3025: -- bq. then we can see the efficient way to persist them into the

[jira] [Assigned] (YARN-3142) Improve locks in AppSchedulingInfo

2015-02-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3142: -- Assignee: Varun Saxena > Improve locks in AppSchedulingInfo > --

[jira] [Commented] (YARN-3025) Provide API for retrieving blacklisted nodes

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306139#comment-14306139 ] Zhijie Shen commented on YARN-3025: --- bq. The above is desirable. My suggestion is to wor

[jira] [Commented] (YARN-3076) YarnClient implementation to retrieve label to node mapping

2015-02-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306138#comment-14306138 ] Varun Saxena commented on YARN-3076: [~leftnoteasy], kindly review > YarnClient implem

[jira] [Commented] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306130#comment-14306130 ] Jason Lowe commented on YARN-3137: -- bq. Queue hierarchy may change at any point of time du

[jira] [Created] (YARN-3142) Improve locks in AppSchedulingInfo

2015-02-04 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3142: Summary: Improve locks in AppSchedulingInfo Key: YARN-3142 URL: https://issues.apache.org/jira/browse/YARN-3142 Project: Hadoop YARN Issue Type: Sub-task C

[jira] [Created] (YARN-3141) Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp

2015-02-04 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3141: Summary: Improve locks in SchedulerApplicationAttempt/FSAppAttempt/FiCaSchedulerApp Key: YARN-3141 URL: https://issues.apache.org/jira/browse/YARN-3141 Project: Hadoop YARN

[jira] [Created] (YARN-3140) Improve locks in AbstractCSQueue/LeafQueue/ParentQueue

2015-02-04 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3140: Summary: Improve locks in AbstractCSQueue/LeafQueue/ParentQueue Key: YARN-3140 URL: https://issues.apache.org/jira/browse/YARN-3140 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2015-02-04 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3139: Summary: Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler Key: YARN-3139 URL: https://issues.apache.org/jira/browse/YARN-3139 Project: Hadoop YARN

[jira] [Resolved] (YARN-3138) TestFairScheduler#testContinuousScheduling fails intermittently on trunk

2015-02-04 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot resolved YARN-3138. - Resolution: Duplicate > TestFairScheduler#testContinuousScheduling fails intermittently on trunk >

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306046#comment-14306046 ] Jian He commented on YARN-3100: --- bq. The authorize.* package in common provides services some

[jira] [Created] (YARN-3138) TestFairScheduler#testContinuousScheduling fails intermittently on trunk

2015-02-04 Thread Anubhav Dhoot (JIRA)
Anubhav Dhoot created YARN-3138: --- Summary: TestFairScheduler#testContinuousScheduling fails intermittently on trunk Key: YARN-3138 URL: https://issues.apache.org/jira/browse/YARN-3138 Project: Hadoop YA

[jira] [Commented] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306040#comment-14306040 ] Vinod Kumar Vavilapalli commented on YARN-3137: --- bq. At best we need to lock

[jira] [Commented] (YARN-3101) FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306037#comment-14306037 ] Hadoop QA commented on YARN-3101: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306039#comment-14306039 ] Hadoop QA commented on YARN-3089: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2896) Server side PB changes for Priority Label Manager and Admin CLI support

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305985#comment-14305985 ] Hadoop QA commented on YARN-2896: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

2015-02-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3089: - Attachment: YARN-3089.v3.txt Thanks, [~jlowe]. I have updated the patch to reflect your additional suggest

[jira] [Commented] (YARN-1723) AMRMClientAsync missing blacklist addition and removal functionality

2015-02-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305949#comment-14305949 ] Hudson commented on YARN-1723: -- FAILURE: Integrated in Hadoop-trunk-Commit #7006 (See [https:

[jira] [Commented] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2015-02-04 Thread Hadoop QA (JIRA)
s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12696524/YARN-2694-20150204-1.patch against trunk revision 064e077. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch app

[jira] [Assigned] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3137: -- Assignee: Varun Saxena > CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock >

[jira] [Assigned] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3136: -- Assignee: Varun Saxena > getTransferredContainers can be a bottleneck during AM registration > -

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305891#comment-14305891 ] Jason Lowe commented on YARN-3136: -- It appears getTransferredContainers is grabbing the lo

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3136: - Issue Type: Sub-task (was: Bug) Parent: YARN-3091 > getTransferredContainers can be a bottleneck d

[jira] [Commented] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305881#comment-14305881 ] Jason Lowe commented on YARN-3137: -- Thanks for the pointer, Wangda! I missed that JIRA wh

[jira] [Updated] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3137: - Issue Type: Sub-task (was: Bug) Parent: YARN-3091 > CapacityScheduler.checkAccess unnecessarily gr

[jira] [Updated] (YARN-3101) FairScheduler#fitInMaxShare was added to validate reservations but it does not consider it

2015-02-04 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3101: Attachment: YARN-3101.004.patch > FairScheduler#fitInMaxShare was added to validate reservations but

[jira] [Updated] (YARN-2896) Server side PB changes for Priority Label Manager and Admin CLI support

2015-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2896: -- Attachment: 0005-YARN-2896.patch Uploading pb related patch w/o priority label as discussed. > Server side PB ch

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305792#comment-14305792 ] Sunil G commented on YARN-3136: --- Yes Jason, Current lock is very big for allocate and regis

[jira] [Commented] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305763#comment-14305763 ] Wangda Tan commented on YARN-3137: -- Agree, I have noticed similar issues around this as we

[jira] [Commented] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305758#comment-14305758 ] Jason Lowe commented on YARN-3137: -- This can be aggravated by the ClientRMService.getQueue

[jira] [Created] (YARN-3137) CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock

2015-02-04 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-3137: Summary: CapacityScheduler.checkAccess unnecessarily grabs the scheduler lock Key: YARN-3137 URL: https://issues.apache.org/jira/browse/YARN-3137 Project: Hadoop YARN

[jira] [Updated] (YARN-2694) Ensure only single node labels specified in resource request / host, and node label expression only specified when resourceName=ANY

2015-02-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2694: - Attachment: YARN-2694-20150204-1.patch > Ensure only single node labels specified in resource requ

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305740#comment-14305740 ] Jason Lowe commented on YARN-3136: -- Sample stacktrace: {noformat} java.lang.Thread.Sta

[jira] [Created] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-02-04 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-3136: Summary: getTransferredContainers can be a bottleneck during AM registration Key: YARN-3136 URL: https://issues.apache.org/jira/browse/YARN-3136 Project: Hadoop YARN

[jira] [Commented] (YARN-3095) Enable DockerContainerExecutor to update Docker image

2015-02-04 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305712#comment-14305712 ] Chen He commented on YARN-3095: --- Since the RM may reports false alarm if we pull docker image

[jira] [Commented] (YARN-3031) create backing storage write interface for ATS writers

2015-02-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305691#comment-14305691 ] Zhijie Shen commented on YARN-3031: --- YARN-2517 may be different. It aims to optimize the

[jira] [Commented] (YARN-3031) create backing storage write interface for ATS writers

2015-02-04 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305652#comment-14305652 ] Vrushali C commented on YARN-3031: -- Related effort around asynchronous writes in ATSv1 h

[jira] [Commented] (YARN-3123) Make YARN CLI show a single completed container even if the app is running

2015-02-04 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305585#comment-14305585 ] Naganarasimha G R commented on YARN-3123: - Test case failures are not related to th

[jira] [Commented] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305562#comment-14305562 ] Jason Lowe commented on YARN-3089: -- Thanks for updating the patch, Eric! I have one last

[jira] [Commented] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305545#comment-14305545 ] Hadoop QA commented on YARN-3089: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3090) DeletionService can silently ignore deletion task failures

2015-02-04 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305514#comment-14305514 ] Jason Lowe commented on YARN-3090: -- Thanks for the patch, Varun! I kicked the tires on th

[jira] [Commented] (YARN-3094) reset timer for liveness monitors after RM recovery

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305482#comment-14305482 ] Hadoop QA commented on YARN-3094: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2616) Add CLI client to the registry to list/view entries

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305459#comment-14305459 ] Hadoop QA commented on YARN-2616: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2683) registry config options: document and move to core-default

2015-02-04 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14305453#comment-14305453 ] Hadoop QA commented on YARN-2683: - {color:red}-1 overall{color}. Here are the results of t

  1   2   >