[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.009.patch Updating patch addressing [~kasha]'s comments > Modify AMRMClient to

[jira] [Commented] (YARN-5176) More test cases for queuing of containers at the NM

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319139#comment-15319139 ] Arun Suresh commented on YARN-5176: --- Thanks for the patch [~kkaranasos].. and the thorough testing.. The

[jira] [Commented] (YARN-5176) More test cases for queuing of containers at the NM

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319753#comment-15319753 ] Arun Suresh commented on YARN-5176: --- +1 > More test cases for queuing of containers at the NM >

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319590#comment-15319590 ] Arun Suresh commented on YARN-5124: --- [~curino], I did infact try moving the remoteRequestTable to another

[jira] [Reopened] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5180: --- Reopening to include entry in findbugs-excludes.. > Allow ResourceRequest to specify an

[jira] [Resolved] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5180. --- Resolution: Fixed Committed addendum patch to trunk and branch-2 > Allow ResourceRequest to specify

[jira] [Commented] (YARN-4830) Add support for resource types in the nodemanager

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318694#comment-15318694 ] Arun Suresh commented on YARN-4830: --- [~vvasudev], apologize for the delay... thanks for addressing my

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2016-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318852#comment-15318852 ] Arun Suresh commented on YARN-2962: --- [~varun_saxena], apologize for the really long delay.. I am fine

[jira] [Commented] (YARN-5212) Run existing ContainerManager tests using QueuingContainerManagerImpl

2016-06-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326534#comment-15326534 ] Arun Suresh commented on YARN-5212: --- LGTM, +1 Thanks for this [~kkaranasos], Committing this shortly.. >

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15326515#comment-15326515 ] Arun Suresh commented on YARN-5124: --- Thanks for the reviews [~kasha], [~curino] and [~kkaranasos]..

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124-branch-2.addendum.patch Attaching addendum patch to fix jdk < 7 compiler issues..

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.017.patch Updating patch to add a remove method (throws unsupportedEx.. can

[jira] [Updated] (YARN-5082) Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5082: -- Summary: Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit

[jira] [Updated] (YARN-5082) Limit ContainerId increase in fair scheduler if the num of node app reserved reached the limit

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5082: -- Fix Version/s: 2.9.0 > Limit ContainerId increase in fair scheduler if the num of node app reserved >

[jira] [Created] (YARN-5238) Handle enforceExecutionType == false in AMRMClient

2016-06-10 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5238: - Summary: Handle enforceExecutionType == false in AMRMClient Key: YARN-5238 URL: https://issues.apache.org/jira/browse/YARN-5238 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.015.patch Thanks for the review [~kasha].. Uploading patch addressing your

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325584#comment-15325584 ] Arun Suresh commented on YARN-5124: --- Also, ive raised the follow up jira you requested : YARN-5238 >

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15325388#comment-15325388 ] Arun Suresh commented on YARN-5221: --- [~mding] bq. when this ticket is completed, will you be able to

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.016.patch Fixing whitespace (had included a spurious file), some of the

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.018.patch Uploading last (fingers crossed) patch.. > Modify AMRMClient to set the

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-06-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Attachment: YARN-5221.001.patch Attaching initial patch that refactors all the api. The patch does not

[jira] [Commented] (YARN-5228) TestDistributedScheduling fails intermittently

2016-06-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323873#comment-15323873 ] Arun Suresh commented on YARN-5228: --- Aah.. thanks for raising this [~leftnoteasy] and analyzing the root

[jira] [Updated] (YARN-5228) TestDistributedScheduling fails intermittently

2016-06-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5228: -- Assignee: Rohith Sharma K S (was: Arun Suresh) > TestDistributedScheduling fails intermittently >

[jira] [Assigned] (YARN-5228) TestDistributedScheduling fails intermittently

2016-06-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5228: - Assignee: Arun Suresh > TestDistributedScheduling fails intermittently >

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313859#comment-15313859 ] Arun Suresh commented on YARN-5171: --- [~elgoiri], Couple of comments, # I don't think the

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Assignee: Hitesh Sharma (was: Arun Suresh) > Modify AMRMClient to set the ExecutionType in the

[jira] [Updated] (YARN-5162) Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5162: -- Summary: Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled (was:

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301512#comment-15301512 ] Arun Suresh commented on YARN-5127: --- Thanks for the patch [~hrsharma] It looks good generally.. Couple

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301525#comment-15301525 ] Arun Suresh commented on YARN-5035: --- [~kasha], the patch looks pretty straightforward. Minor comments: #

[jira] [Commented] (YARN-5117) QueuingContainerManager does not start GUARANTEED Container even if Resources are available

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305058#comment-15305058 ] Arun Suresh commented on YARN-5117: --- Thanks for the fix [~kkaranasos] !! +1, LGTM >

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-06-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Attachment: YARN-5221.002.patch Updating patch to fix test-cases > Expose UpdateResourceRequest API to

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.019.patch Another pass at fixing javac. > Modify AMRMClient to set the

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-06-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330496#comment-15330496 ] Arun Suresh commented on YARN-4876: --- Aggregating and posting some design points on the patch based on

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-06-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330501#comment-15330501 ] Arun Suresh commented on YARN-4876: --- [~vinodkv], [~jianhe], [~vvasudev] .. would like to hear your

[jira] [Comment Edited] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-06-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330496#comment-15330496 ] Arun Suresh edited comment on YARN-4876 at 6/14/16 8:56 PM: Aggregating and

[jira] [Commented] (YARN-5252) EventDispatcher$EventProcessor.run() throws a findbugs error

2016-06-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15330599#comment-15330599 ] Arun Suresh commented on YARN-5252: --- [~sjlee0], YARN-5075 fixes this... >

[jira] [Updated] (YARN-5255) Move ResourceRequest expansion for Delay Scheduling to the Scheduler

2016-06-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5255: -- Description: YARN-4879 proposes to enhance the Allocate Request by introducing an id to explicitly

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15332035#comment-15332035 ] Arun Suresh commented on YARN-5171: --- bq. Not sure if we should introduce in this JIRA the methods

[jira] [Assigned] (YARN-5255) Move ResourceRequest expansion for Delay Scheduling to the Scheduler

2016-06-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5255: - Assignee: Arun Suresh > Move ResourceRequest expansion for Delay Scheduling to the Scheduler >

[jira] [Created] (YARN-5255) Move ResourceRequest expansion for Delay Scheduling to the Scheduler

2016-06-14 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5255: - Summary: Move ResourceRequest expansion for Delay Scheduling to the Scheduler Key: YARN-5255 URL: https://issues.apache.org/jira/browse/YARN-5255 Project: Hadoop YARN

[jira] [Commented] (YARN-5185) StageAllocaterGreedyRLE: NPE in corner case

2016-06-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317356#comment-15317356 ] Arun Suresh commented on YARN-5185: --- Makes sense.. +1 > StageAllocaterGreedyRLE: NPE in corner case >

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316147#comment-15316147 ] Arun Suresh commented on YARN-5124: --- [~kasha], thanks for the review.. I agree with 1-4 of your

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.010.patch Uploading patch addressing most of [~curino]'s feedback : bq. Can we

[jira] [Comment Edited] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317575#comment-15317575 ] Arun Suresh edited comment on YARN-5124 at 6/7/16 12:47 AM: Uploading patch

[jira] [Comment Edited] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317575#comment-15317575 ] Arun Suresh edited comment on YARN-5124 at 6/7/16 12:48 AM: Uploading patch

[jira] [Comment Edited] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316147#comment-15316147 ] Arun Suresh edited comment on YARN-5124 at 6/6/16 6:00 AM: --- [~kasha], thanks for

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.013.patch [~curino], uploading patch addressing comments.. Hope 13th one is a

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320605#comment-15320605 ] Arun Suresh commented on YARN-5124: --- [~kasha], let me know if you are ok with the latest patch.. >

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.014.patch Uploading patch 014.. included a minor optimization. > Modify

[jira] [Commented] (YARN-5179) Issue of CPU usage of containers

2016-05-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306049#comment-15306049 ] Arun Suresh commented on YARN-5179: --- [~Zhongkai], Perhaps the fix for YARN-5117 might be relevant here.

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-05-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.001.patch Attaching patch > Add ensureExecutionType boolean flag in

[jira] [Commented] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-05-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15306976#comment-15306976 ] Arun Suresh commented on YARN-5180: --- ping [~kasha], A quick review ? > Add ensureExecutionType boolean

[jira] [Moved] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-05-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh moved HADOOP-13217 to YARN-5180: Key: YARN-5180 (was: HADOOP-13217) Project: Hadoop YARN (was:

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.004.patch Attaching updated patch.. > Modify AMRMClient to set the ExecutionType

[jira] [Assigned] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5124: - Assignee: Arun Suresh (was: Hitesh Sharma) > Modify AMRMClient to set the ExecutionType in the

[jira] [Comment Edited] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301525#comment-15301525 ] Arun Suresh edited comment on YARN-5035 at 5/26/16 4:52 AM: [~kasha], the patch

[jira] [Commented] (YARN-5082) ContainerId rapidly increased in fair scheduler if the num of node app reserved reached the limit

2016-05-25 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301514#comment-15301514 ] Arun Suresh commented on YARN-5082: --- LGTM, Will commit it tomorrow if there are no objections.. >

[jira] [Commented] (YARN-5135) ContainerRequest labels ignored -broken constructor

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302598#comment-15302598 ] Arun Suresh commented on YARN-5135: --- [~steve_l], np.. like I mentioned, there are regression tests for it

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5171: -- Assignee: Inigo Goiri > Extend DistributedSchedulerProtocol to notify RM of containers allocated by >

[jira] [Created] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-05-27 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5171: - Summary: Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node Key: YARN-5171 URL: https://issues.apache.org/jira/browse/YARN-5171 Project:

[jira] [Resolved] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5127. --- Resolution: Fixed > Expose ExecutionType in Container api record >

[jira] [Reopened] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5127: --- > Expose ExecutionType in Container api record > > >

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304768#comment-15304768 ] Arun Suresh commented on YARN-5127: --- +1, Thanks for the patch [~hrsharma] Will fix the remaining

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.007.patch Thanks [~kasha] Oh well.. as per popular demand, changing the name to

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124_YARN-5180_combined.008.patch Rebasing against latest YARN-5180 patch and kicking

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.008.patch > Modify AMRMClient to set the ExecutionType in the ResourceRequest >

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312630#comment-15312630 ] Arun Suresh commented on YARN-5171: --- [~elgoiri], I don't think you are decrementing

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Summary: Allow ResourceRequest to specify enforceExecutionType flag (was: Add ensureExecutionType

[jira] [Commented] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312559#comment-15312559 ] Arun Suresh commented on YARN-5180: --- Committed this to trunk and branch-2 Thanks [~kkaranasos] and

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-4742 > Allow ResourceRequest to specify an

[jira] [Updated] (YARN-5180) Allow ResourceRequest to specify an enforceExecutionType flag

2016-06-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Summary: Allow ResourceRequest to specify an enforceExecutionType flag (was: Allow ResourceRequest to

[jira] [Commented] (YARN-5035) FairScheduler: Adjust maxAssign dynamically when assignMultiple is turned on

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15301605#comment-15301605 ] Arun Suresh commented on YARN-5035: --- bq. 1/2 + 1/4 + ... converges nicely and is somewhat easier to

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.005.patch Updating patch to fix the javadoc and some of the checkstyle warnings.

[jira] [Commented] (YARN-5162) Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302856#comment-15302856 ] Arun Suresh commented on YARN-5162: --- I think the javadoc warnings can be ignored.. since its for a

[jira] [Commented] (YARN-5127) Expose ExecutionType in Container api record

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302884#comment-15302884 ] Arun Suresh commented on YARN-5127: --- Thanks for the quick update [~hrsharma].. I guess the remain

[jira] [Commented] (YARN-5162) Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303014#comment-15303014 ] Arun Suresh commented on YARN-5162: --- The test case failures are un-related. YARN-5163 tracks some of the

[jira] [Created] (YARN-5163) Fix TestClientToAMTokens and TestClientRMTokens

2016-05-26 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5163: - Summary: Fix TestClientToAMTokens and TestClientRMTokens Key: YARN-5163 URL: https://issues.apache.org/jira/browse/YARN-5163 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5163) Fix TestClientToAMTokens and TestClientRMTokens

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5163: -- Description: The above testcases fail due to a {{NullpointerException}} and a Cannot bind to port.. Both

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124.006.patch One more crack at fixing the javadocs and increasing some test timeouts

[jira] [Comment Edited] (YARN-5162) Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15302856#comment-15302856 ] Arun Suresh edited comment on YARN-5162 at 5/26/16 9:37 PM: I think the javadoc

[jira] [Commented] (YARN-5162) Fix Exceptions thrown during registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303026#comment-15303026 ] Arun Suresh commented on YARN-5162: --- Committed to trunk and branch-2. Thanks [~hrsharma] !! > Fix

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303099#comment-15303099 ] Arun Suresh commented on YARN-5124: --- [~kkaranasos], Thanks for the review.. I was actually in quite a

[jira] [Updated] (YARN-5162) Fix Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5162: -- Summary: Fix Exceptions thrown during AM registerAM call when Distributed Scheduling is Enabled (was:

[jira] [Updated] (YARN-5162) Fix Exceptions thrown during registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5162: -- Summary: Fix Exceptions thrown during registerAM call when Distributed Scheduling is Enabled (was: Fix

[jira] [Created] (YARN-5162) Exception thrown during AM registerAM call when Distributed Scheduling is Enabled

2016-05-26 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5162: - Summary: Exception thrown during AM registerAM call when Distributed Scheduling is Enabled Key: YARN-5162 URL: https://issues.apache.org/jira/browse/YARN-5162 Project:

[jira] [Commented] (YARN-5163) Fix TestClientToAMTokens and TestClientRMTokens

2016-05-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15303693#comment-15303693 ] Arun Suresh commented on YARN-5163: --- It looks like this has been happening from

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.004.patch Uploading a patch to fix the {{TestPBImplRecords}} failure. The rest as

[jira] [Comment Edited] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310567#comment-15310567 ] Arun Suresh edited comment on YARN-5180 at 6/1/16 4:22 PM: --- Uploading a patch to

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311515#comment-15311515 ] Arun Suresh commented on YARN-5171: --- YARN-5127 exposes the ExecutionType in the Container which is

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311530#comment-15311530 ] Arun Suresh commented on YARN-5171: --- Thanks for the patch [~elgoiri].. The general approach looks good,

[jira] [Comment Edited] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311530#comment-15311530 ] Arun Suresh edited comment on YARN-5171 at 6/2/16 1:10 AM: --- Thanks for the patch

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311546#comment-15311546 ] Arun Suresh commented on YARN-5171: --- Actually... regarding the last part of my point #2 above... just

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.005.patch Updating patch.. thanks for the rev [~kasha].. bq. Can we get #2 of my

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.006.patch Updating patch with javadoc changes Konstantinos suggested. Like I

[jira] [Commented] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311392#comment-15311392 ] Arun Suresh commented on YARN-5180: --- [~kkaranasos], bq. Thinking more about it, do we want the

[jira] [Comment Edited] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-05-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15309325#comment-15309325 ] Arun Suresh edited comment on YARN-5180 at 6/1/16 5:51 AM: --- Updating patch

[jira] [Updated] (YARN-5180) Add ensureExecutionType boolean flag in ResourceRequest

2016-05-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5180: -- Attachment: YARN-5180.003.patch Updating patch addressing review comments suggestions. Thanks

[jira] [Commented] (YARN-5185) StageAllocaterGreedyRLE: NPE in corner case

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310278#comment-15310278 ] Arun Suresh commented on YARN-5185: --- [~curino], The patch looks pretty straightforward. Is it possible to

[jira] [Commented] (YARN-5165) NoOvercommitPolicy does not take advantage of RLE representation of plan

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15310272#comment-15310272 ] Arun Suresh commented on YARN-5165: --- [~curino], thanks for the patch.. the fix looks pretty

[jira] [Updated] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5124: -- Attachment: YARN-5124_YARN-5180_combined.007.patch Uploading new patch rebased against YARN-5180. This

<    1   2   3   4   5   6   7   8   9   10   >