[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263759#comment-16263759 ] Arun Suresh commented on YARN-6483: --- Committed this to trunk and branch-3.0 Will cherry-p

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Affects Version/s: (was: 3.1.0) Target Version/s: 3.1.0, 2.9.1 > Add nodes transitioning to DECO

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Summary: Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

[jira] [Created] (YARN-7559) TestNodeLabelContainerAllocation failing intermittently

2017-11-22 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7559: - Summary: TestNodeLabelContainerAllocation failing intermittently Key: YARN-7559 URL: https://issues.apache.org/jira/browse/YARN-7559 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16262983#comment-16262983 ] Arun Suresh commented on YARN-6483: --- Thanks [~juanrh]... The patch LGTM - I like the test

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261846#comment-16261846 ] Arun Suresh commented on YARN-7509: --- Good catch [~Tao Yang]. +1 > AsyncScheduleThread an

[jira] [Created] (YARN-7547) Throttle Localization for Opportunistic Containers in the NM

2017-11-21 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7547: - Summary: Throttle Localization for Opportunistic Containers in the NM Key: YARN-7547 URL: https://issues.apache.org/jira/browse/YARN-7547 Project: Hadoop YARN Iss

[jira] [Updated] (YARN-7542) NM recovers some Running Opportunistic Containers as SUSPEND

2017-11-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7542: -- Target Version/s: 2.9.1 > NM recovers some Running Opportunistic Containers as SUSPEND >

[jira] [Created] (YARN-7542) NM recovers some Running Opportunistic Containers as SUSPEND

2017-11-20 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7542: - Summary: NM recovers some Running Opportunistic Containers as SUSPEND Key: YARN-7542 URL: https://issues.apache.org/jira/browse/YARN-7542 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259749#comment-16259749 ] Arun Suresh commented on YARN-6483: --- bq. by "update type" you mean adding an additional f

[jira] [Comment Edited] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258890#comment-16258890 ] Arun Suresh edited comment on YARN-6483 at 11/20/17 7:33 AM: - T

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16258890#comment-16258890 ] Arun Suresh commented on YARN-6483: --- Thanks for working on this [~juanrh], Apart from th

[jira] [Assigned] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6483: - Assignee: Juan Rodríguez Hortalá > Add nodes transitioning to DECOMMISSIONING state to the list of

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257366#comment-16257366 ] Arun Suresh commented on YARN-7448: --- Thanks for the reviews [~kkaranasos] and [~leftnotea

[jira] [Comment Edited] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257150#comment-16257150 ] Arun Suresh edited comment on YARN-7448 at 11/17/17 3:54 PM: - [

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16257150#comment-16257150 ] Arun Suresh commented on YARN-7448: --- [~kkaranasos] bq. setSchedulingRequests seems to do

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16256514#comment-16256514 ] Arun Suresh commented on YARN-1015: --- +1, looks good. > FS should watch node resource uti

[jira] [Assigned] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7448: - Assignee: Panagiotis Garefalakis (was: Arun Suresh) > [API] Add SchedulingRequest to the Allocate

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16255698#comment-16255698 ] Arun Suresh commented on YARN-7448: --- [~pg1...@imperial.ac.uk], next time let me know befo

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7448: -- Attachment: YARN-7448-YARN-6592.002.patch Fixing checkstyle - the findbugs is extant > [API] Add Schedul

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254323#comment-16254323 ] Arun Suresh commented on YARN-7438: --- [~leftnoteasy], Some more comments: * We should chan

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254132#comment-16254132 ] Arun Suresh commented on YARN-6483: --- Left some comments on the pull request. > Add nodes

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254070#comment-16254070 ] Arun Suresh commented on YARN-7448: --- [~kkaranasos] / [~leftnoteasy] - quick rev ? > [API

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7448: -- Attachment: YARN-7448-YARN-6592.001.patch Uploading initial patch. > [API] Add SchedulingRequest to the

[jira] [Commented] (YARN-7490) ConcurrentModificationException in AMRMClient

2017-11-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250866#comment-16250866 ] Arun Suresh commented on YARN-7490: --- Hmmm... I agree, it can maybe be handled in the AMRM

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250548#comment-16250548 ] Arun Suresh commented on YARN-6595: --- Thanks [~kkaranasos] and [~leftnoteasy] for the revi

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

2017-11-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5049: -- Attachment: YARN-5049-addendum.branch-2.001.patch Attaching addendum patch for branch-2 > Extend NMState

[jira] [Reopened] (YARN-5049) Extend NMStateStore to save queued container information

2017-11-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5049: --- Assignee: Arun Suresh (was: Konstantinos Karanasos) Reopening, since during the branch-2 merge, one

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248293#comment-16248293 ] Arun Suresh commented on YARN-7438: --- Thanks for working on this [~wangda], In general I t

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Attachment: YARN-6595-YARN-6592.005.patch Thanks for the rev [~leftnoteasy], I've Updated the patch with

[jira] [Commented] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248019#comment-16248019 ] Arun Suresh commented on YARN-6102: --- Thanks for the quick turnaround [~rohithsharma] ! +1

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246313#comment-16246313 ] Arun Suresh commented on YARN-1015: --- I am fine with approach of the patch - but do give m

[jira] [Updated] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7343: -- Fix Version/s: (was: 2.9.0) > Add a junit test for ContainerScheduler recovery >

[jira] [Updated] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7343: -- Fix Version/s: 3.1.0 2.9.0 > Add a junit test for ContainerScheduler recovery > --

[jira] [Assigned] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7453: - Assignee: Rohith Sharma K S (was: Arun Suresh) > Fix issue where RM fails to switch to active aft

[jira] [Assigned] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7453: - Assignee: Arun Suresh > Fix issue where RM fails to switch to active after first successful start

[jira] [Updated] (YARN-7453) Fix issue where RM fails to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7453: -- Summary: Fix issue where RM fails to switch to active after first successful start (was: RM fail to swit

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244205#comment-16244205 ] Arun Suresh commented on YARN-7453: --- +1 for the patch. I ran the failed and timeout tests

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242855#comment-16242855 ] Arun Suresh commented on YARN-7453: --- Verified it myself on a fresh cluster running 2.9.0

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242786#comment-16242786 ] Arun Suresh commented on YARN-7453: --- Thanks [~jhung] !! > RM fail to switch to active af

[jira] [Comment Edited] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242723#comment-16242723 ] Arun Suresh edited comment on YARN-7453 at 11/7/17 7:33 PM: Loo

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242723#comment-16242723 ] Arun Suresh commented on YARN-7453: --- Looks like that is the last commit on *branch-2.9*.

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242657#comment-16242657 ] Arun Suresh commented on YARN-7453: --- [~jhung], thanks for testing.. Were you testing this

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242625#comment-16242625 ] Arun Suresh commented on YARN-7437: --- Thanks for raising this [~wangda], I like AppPlaceme

[jira] [Comment Edited] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242482#comment-16242482 ] Arun Suresh edited comment on YARN-7453 at 11/7/17 6:07 PM: Hmm

[jira] [Commented] (YARN-7453) RM fail to switch to active after first successful start

2017-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16242482#comment-16242482 ] Arun Suresh commented on YARN-7453: --- Hmmm.. that is interesting, since YARN-7053 was part

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241345#comment-16241345 ] Arun Suresh commented on YARN-6595: --- Thanks for the review [~kkaranasos] bq. Let's remov

[jira] [Comment Edited] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241212#comment-16241212 ] Arun Suresh edited comment on YARN-1015 at 11/7/17 12:09 AM: - T

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241212#comment-16241212 ] Arun Suresh commented on YARN-1015: --- Thanks for the patch [~haibochen] So couple of comm

[jira] [Created] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7448: - Summary: [API] Add SchedulingRequest to the AllocateRequest Key: YARN-7448 URL: https://issues.apache.org/jira/browse/YARN-7448 Project: Hadoop YARN Issue Type: Su

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level and SchedulingRequest to the AllocateRequest

2017-11-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Summary: [API] Add Placement Constraints at the application level and SchedulingRequest to the AllocateRe

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Summary: [API] Add Placement Constraints at the application level (was: [API] Add Placement Constraints

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Attachment: YARN-6595-YARN-6592.004.patch Minor update to previous patch > [API] Add Placement Constrain

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Attachment: YARN-6595-YARN-6592.003.patch Fixing checkstyles and findbugs > [API] Add Placement Constrai

[jira] [Updated] (YARN-5220) Scheduling of OPPORTUNISTIC containers through YARN RM

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5220: -- Fix Version/s: 3.0.0-beta1 > Scheduling of OPPORTUNISTIC containers through YARN RM > ---

[jira] [Resolved] (YARN-5220) Scheduling of OPPORTUNISTIC containers through YARN RM

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5220. --- Resolution: Fixed Fix Version/s: 2.9.0 Release Note: This extends the centralized YARN RM i

[jira] [Resolved] (YARN-5687) Refactor TestOpportunisticContainerAllocation to extend TestAMRMClient

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5687. --- Resolution: Implemented Fix Version/s: 2.9.0 This is already done > Refactor TestOpportunisticC

[jira] [Resolved] (YARN-4631) Add specialized Token support for DistributedSchedulingProtocol

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-4631. --- Resolution: Won't Fix Closing this as it is not required. > Add specialized Token support for Distribu

[jira] [Resolved] (YARN-4742) [Umbrella] Enhancements to Distributed Scheduling

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-4742. --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 2.9.0 > [Umbrella] Enhancements

[jira] [Reopened] (YARN-2877) Extend YARN to support distributed scheduling

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-2877: --- > Extend YARN to support distributed scheduling > - > >

[jira] [Resolved] (YARN-2877) Extend YARN to support distributed scheduling

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-2877. --- Resolution: Fixed > Extend YARN to support distributed scheduling > ---

[jira] [Updated] (YARN-6595) [API] Add Placement Constraints at the application level

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6595: -- Attachment: YARN-6595-YARN-6592.002.patch Updating patch based on some offline suggestions from [~kkarana

[jira] [Commented] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16239034#comment-16239034 ] Arun Suresh commented on YARN-5447: --- Looks like YARN-7371 is already handling this. > Co

[jira] [Commented] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2017-11-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16239033#comment-16239033 ] Arun Suresh commented on YARN-5447: --- Got it. To enable this though, we would also need to

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-11-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237895#comment-16237895 ] Arun Suresh commented on YARN-6596: --- [~leftnoteasy], I did start on it - Can I get back t

[jira] [Commented] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237706#comment-16237706 ] Arun Suresh commented on YARN-7343: --- Thanks for the updated patch [~sampada15]!! I really

[jira] [Commented] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16236815#comment-16236815 ] Arun Suresh commented on YARN-7431: --- Looks like the patch fixes the findbugs warning (the

[jira] [Updated] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7431: -- Attachment: YARN-7431.001.patch Attaching patch. > resource estimator has findbugs problems > --

[jira] [Assigned] (YARN-7431) resource estimator has findbugs problems

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7431: - Assignee: Arun Suresh > resource estimator has findbugs problems > ---

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235971#comment-16235971 ] Arun Suresh commented on YARN-4511: --- +1, The latest patch lgtm > Common scheduler change

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-11-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16235872#comment-16235872 ] Arun Suresh commented on YARN-7286: --- Just went thru the patch. Given the small patch size

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227648#comment-16227648 ] Arun Suresh commented on YARN-7240: --- [~andrew.wang], looks like I had already cherry-pick

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227626#comment-16227626 ] Arun Suresh commented on YARN-6940: --- bq. what is the reason to set relaxLocality to true

[jira] [Commented] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227383#comment-16227383 ] Arun Suresh commented on YARN-7240: --- Yup, I was waiting for 3.0.0-beta1 to be cut before

[jira] [Commented] (YARN-7178) Add documentation for Container Update API

2017-10-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16227306#comment-16227306 ] Arun Suresh commented on YARN-7178: --- Yup, good catch.. we don't support resizing of Opp c

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223840#comment-16223840 ] Arun Suresh commented on YARN-4511: --- Thanks for updating the patch [~haibochen]. I am abl

[jira] [Updated] (YARN-7299) Fix TestDistributedScheduler

2017-10-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7299: -- Summary: Fix TestDistributedScheduler (was: TestDistributedScheduler is failing) > Fix TestDistributedS

[jira] [Updated] (YARN-7299) TestDistributedScheduler is failing

2017-10-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7299: -- Target Version/s: 2.9.0, 3.0.0 > TestDistributedScheduler is failing > --

[jira] [Updated] (YARN-7299) TestDistributedScheduler is failing

2017-10-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7299: -- Attachment: YARN-7299.001.patch Attaching patch > TestDistributedScheduler is failing >

[jira] [Assigned] (YARN-7299) TestDistributedScheduler is failing

2017-10-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7299: - Assignee: Arun Suresh > TestDistributedScheduler is failing > ---

[jira] [Commented] (YARN-7299) TestDistributedScheduler is failing

2017-10-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222882#comment-16222882 ] Arun Suresh commented on YARN-7299: --- Ah, apologize for the delay - will try to post a pat

[jira] [Updated] (YARN-7178) Add documentation for Container Update API

2017-10-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7178: -- Attachment: YARN-7178.002.patch Updating patch (.002) based on [~leftnoteasy]'s comments. Thanks Wangda.

[jira] [Updated] (YARN-7178) Add documentation for Container Update API

2017-10-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7178: -- Attachment: YARN-7178.001.patch Attaching initial patch. > Add documentation for Container Update API >

[jira] [Commented] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2017-10-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16221447#comment-16221447 ] Arun Suresh commented on YARN-5447: --- Just noticed your comment [~jianhe]. I don't think I

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217620#comment-16217620 ] Arun Suresh commented on YARN-4511: --- So with regard to the extra synchronization in {{swa

[jira] [Comment Edited] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217620#comment-16217620 ] Arun Suresh edited comment on YARN-4511 at 10/24/17 8:18 PM: - S

[jira] [Commented] (YARN-7382) NoSuchElementException in FairScheduler after failover causes RM crash

2017-10-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16216146#comment-16216146 ] Arun Suresh commented on YARN-7382: --- Thanks for raising this [~rkanter] and for the patch

[jira] [Commented] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-10-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16215259#comment-16215259 ] Arun Suresh commented on YARN-7343: --- Thanks for the extensive testing [~sampada15]. Wonde

[jira] [Updated] (YARN-6920) Fix resource leak that happens during container re-initialization.

2017-10-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6920: -- Description: Container re-initialization can cause resource accounting leaks in the {{ContainerScheduler

[jira] [Comment Edited] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213280#comment-16213280 ] Arun Suresh edited comment on YARN-7373 at 10/20/17 9:40 PM: - [

[jira] [Commented] (YARN-7373) The atomicity of container update in RM is not clear

2017-10-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213280#comment-16213280 ] Arun Suresh commented on YARN-7373: --- [~haibochen] / [~miklos.szeg...@cloudera.com] So, l

[jira] [Commented] (YARN-7372) TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic is flaky

2017-10-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16213215#comment-16213215 ] Arun Suresh commented on YARN-7372: --- +1, Thanks [~haibochen] > TestContainerSchedulerQue

[jira] [Commented] (YARN-7372) TestContainerSchedulerQueuing.testContainerUpdateExecTypeGuaranteedToOpportunistic is flaky

2017-10-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211960#comment-16211960 ] Arun Suresh commented on YARN-7372: --- Thanks for raising [~haibochen]. [~kartheek], can yo

[jira] [Assigned] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-10-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7343: - Assignee: Sampada Dehankar (was: kartheek muthyala) > Add a junit test for ContainerScheduler rec

[jira] [Updated] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7275: -- Fix Version/s: 3.0.0 2.9.0 > NM Statestore cleanup for Container updates > ---

[jira] [Comment Edited] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206521#comment-16206521 ] Arun Suresh edited comment on YARN-4859 at 10/16/17 8:05 PM: - S

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206521#comment-16206521 ] Arun Suresh commented on YARN-4859: --- Sorry to chime in late [~yufeigu], but If you are te

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16206220#comment-16206220 ] Arun Suresh commented on YARN-7275: --- Thanks for the update [~kartheek]. +1, the latest pa

[jira] [Updated] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7327: -- Summary: CapacityScheduler: Allocate containers asynchronously by default (was: Allocate containers asyn

[jira] [Commented] (YARN-7327) Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16204337#comment-16204337 ] Arun Suresh commented on YARN-7327: --- Changed the tile : It looks like this is more relate

<    1   2   3   4   5   6   7   8   9   10   >