[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.003.patch Updating patch after rebasing with trunk. > Minor refactoring

[jira] [Updated] (YARN-5085) Add support for change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5085: -- Attachment: YARN-5085.002.patch Re-attaching again > Add support for change of container ExecutionType

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15742711#comment-15742711 ] Arun Suresh edited comment on YARN-5959 at 12/12/16 6:33 PM: - Thanks for

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743071#comment-15743071 ] Arun Suresh commented on YARN-5216: --- Just clarifying my position: * The ability to PAUSE a process is

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730322#comment-15730322 ] Arun Suresh commented on YARN-3866: --- bq. No. It is already get released in 2.7.3 .. Ah.. sorry.. was

[jira] [Updated] (YARN-2877) Extend YARN to support distributed scheduling

2017-01-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2877: -- Fix Version/s: 3.0.0-alpha2 2.9.0 > Extend YARN to support distributed scheduling >

[jira] [Updated] (YARN-6096) getCpuFrequency for windows returning incorrect value

2017-01-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6096: -- Assignee: Roni Burd > getCpuFrequency for windows returning incorrect value >

[jira] [Reopened] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2017-01-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5646: --- Reopening to add addendum patch to include changes to the site.xml file > Add documentation and update

[jira] [Updated] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2017-01-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5646: -- Attachment: YARN-5646.addendum.patch > Add documentation and update config parameter names for

[jira] [Resolved] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2017-01-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5646. --- Resolution: Fixed Committed addendum patch to trunk and branch-2 > Add documentation and update

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-01-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Attachment: YARN-5966.002.patch Updating patch. Fixing failed testcase > AMRMClient changes to support

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717931#comment-15717931 ] Arun Suresh commented on YARN-5959: --- This can actually be accomplished in a scheduler agnostic manner.

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959.combined.001.patch Since the WIP patch depends on YARN-5938, am attaching a

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Description: RM side changes to allow an AM to ask for change of ExecutionType. Currently, there are

[jira] [Comment Edited] (YARN-5087) Expose API to allow AM to request for change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717898#comment-15717898 ] Arun Suresh edited comment on YARN-5087 at 12/3/16 10:45 AM: - Closing this, as

[jira] [Resolved] (YARN-5087) Expose API to allow AM to request for change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5087. --- Resolution: Resolved Closing this, as YARN-5221 fixes this > Expose API to allow AM to request for

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Description: RM side changes to allow an AM to ask for change of ExecutionType. Currently, there are

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Summary: RM changes to support change of container ExecutionType (was: Add support for ExecutionType

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959.wip.patch Attaching a WIP patch with tests to demonstrate the proposal in the

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717931#comment-15717931 ] Arun Suresh edited comment on YARN-5959 at 12/3/16 11:21 AM: - This can actually

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717948#comment-15717948 ] Arun Suresh edited comment on YARN-5959 at 12/3/16 11:23 AM: - Attaching a WIP

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Description: RM side changes to allow an AM to ask for change of ExecutionType. Currently, there are

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717948#comment-15717948 ] Arun Suresh edited comment on YARN-5959 at 12/3/16 11:31 AM: - Attaching a WIP

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-12-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15718618#comment-15718618 ] Arun Suresh commented on YARN-5292: --- Thanks for the patch Hitesh, couple of comments: *

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.002.patch Updating patch.. moved SchedulerRequestKey to a common, so it

[jira] [Assigned] (YARN-5959) Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED

2016-12-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5959: - Assignee: Arun Suresh > Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED >

[jira] [Created] (YARN-5959) Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED

2016-12-01 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5959: - Summary: Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED Key: YARN-5959 URL: https://issues.apache.org/jira/browse/YARN-5959 Project: Hadoop YARN

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-11-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.001.patch Created new branch for YARN-5085. Updated patch to fix test

[jira] [Created] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5966: - Summary: AMRMClient changes to support ExecutionType update Key: YARN-5966 URL: https://issues.apache.org/jira/browse/YARN-5966 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Description: {{AMRMClient}} changes to support change of container ExecutionType > AMRMClient changes

[jira] [Assigned] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5966: - Assignee: Arun Suresh > AMRMClient changes to support ExecutionType update >

[jira] [Updated] (YARN-5085) Add support for change of container ExecutionType

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5085: -- Attachment: YARN-5085.001.patch Attaching a combined patch for all the subpatches to kick off Jenkins.

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959.wip.002.patch Moved out the AMRMClient changes to YARN-5966 and added more tests.

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Attachment: YARN-5966.wip.001.patch Attaching initial patch > AMRMClient changes to support

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723652#comment-15723652 ] Arun Suresh commented on YARN-5292: --- Thanks for the update [~hrsharma]. I am +1 for the latest patch.

[jira] [Commented] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802195#comment-15802195 ] Arun Suresh commented on YARN-6041: --- [~leftnoteasy], So what I plan to do was, like you mentioned,

[jira] [Commented] (YARN-6040) Remove usage of ResourceRequest from AppSchedulerInfo / SchedulerApplicationAttempt

2017-01-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15802425#comment-15802425 ] Arun Suresh commented on YARN-6040: --- Thanks for updating the patch [~leftnoteasy], # Looks like

[jira] [Updated] (YARN-6040) Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6040: -- Summary: Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler

[jira] [Updated] (YARN-6040) Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6040: -- Fix Version/s: 3.0.0-beta1 > Introduce api independent PendingAsk to replace usage of ResourceRequest >

[jira] [Commented] (YARN-6040) Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805139#comment-15805139 ] Arun Suresh commented on YARN-6040: --- Committing this shortly... > Introduce api independent PendingAsk

[jira] [Updated] (YARN-6040) Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6040: -- Fix Version/s: (was: 3.0.0-beta1) 3.0.0-alpha2 > Introduce api independent

[jira] [Commented] (YARN-6040) Introduce api independent PendingAsk to replace usage of ResourceRequest within Scheduler classes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805147#comment-15805147 ] Arun Suresh commented on YARN-6040: --- Committed this to trunk. Thanks [~leftnoteasy].. Looks like we can

[jira] [Created] (YARN-6066) Opportunistic containers: Minor fixes: API annotations and config parameter changes

2017-01-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6066: - Summary: Opportunistic containers: Minor fixes: API annotations and config parameter changes Key: YARN-6066 URL: https://issues.apache.org/jira/browse/YARN-6066 Project:

[jira] [Assigned] (YARN-6066) Opportunistic containers: Minor fixes: API annotations and config parameter changes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6066: - Assignee: Arun Suresh > Opportunistic containers: Minor fixes: API annotations and config

[jira] [Commented] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15805485#comment-15805485 ] Arun Suresh commented on YARN-6041: --- Cherry-picking the JIRAs mentioned in the description to branch-2

[jira] [Updated] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6041: -- Fix Version/s: 2.9.0 > Opportunistic containers : Combined patch for branch-2 >

[jira] [Updated] (YARN-6066) Opportunistic containers minor fixes: API annotations and config parameter changes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6066: -- Attachment: YARN-6066-branch-2.001.patch Attaching patch > Opportunistic containers minor fixes: API

[jira] [Updated] (YARN-6066) Opportunistic containers minor fixes: API annotations and config parameter changes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6066: -- Summary: Opportunistic containers minor fixes: API annotations and config parameter changes (was:

[jira] [Updated] (YARN-6066) Opportunistic containers ninor fixes: API annotations and config parameter changes

2017-01-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6066: -- Summary: Opportunistic containers ninor fixes: API annotations and config parameter changes (was:

[jira] [Updated] (YARN-5966) AMRMClient changes to support ExecutionType update

2017-01-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5966: -- Attachment: YARN-5966.001.patch Re-attaching patch, rebasing against trunk > AMRMClient changes to

[jira] [Comment Edited] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2016-12-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787934#comment-15787934 ] Arun Suresh edited comment on YARN-6041 at 12/30/16 4:17 PM: - The javac error

[jira] [Commented] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2016-12-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15787934#comment-15787934 ] Arun Suresh commented on YARN-6041: --- The javac error is from a Testcase (not included in this patch)

[jira] [Updated] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2016-12-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6041: -- Attachment: YARN-6041-branch-2.002.patch Thanks for the review [~leftnoteasy] Uploading new patch: #

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.002.patch Fixing findbugs. > RM changes to support change of container

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5985.001.patch Updating patch. * The container increase and decreases

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.001.patch Correcting name of patch file to kick of Jenkins against

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: (was: YARN-5959-YARN-5985.001.patch) > RM changes to support change of container

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15795677#comment-15795677 ] Arun Suresh commented on YARN-6022: --- [~leftnoteasy], [~kasha], do you guys want to just move this to

[jira] [Commented] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15796705#comment-15796705 ] Arun Suresh commented on YARN-6041: --- Thanks for taking a look [~kasha], bq. Assuming MRJobConfig.

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.005.patch Updating patch v005 Some minor updates: Moved

[jira] [Comment Edited] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15799772#comment-15799772 ] Arun Suresh edited comment on YARN-5959 at 1/5/17 12:06 AM: Updated patch. Do

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.004.patch Updated patch. Do give it another review [~leftnoteasy] bq.

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959.005.patch Attaching trunk patch.. Thanks for the review [~leftnoteasy]. > RM

[jira] [Updated] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6041: -- Attachment: YARN-6041-branch-2.003.patch Updating patch based on [~kasha]'s suggestions > Opportunistic

[jira] [Updated] (YARN-5959) RM changes to support change of container ExecutionType

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5959: -- Attachment: YARN-5959-YARN-5085.003.patch Updating patch. Thanks for the detailed review

[jira] [Commented] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2017-01-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15801509#comment-15801509 ] Arun Suresh commented on YARN-6041: --- As mentioned earlier, the javac, javadoc and whitespace errors are

[jira] [Commented] (YARN-6059) Update paused container state in the state store

2017-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15807913#comment-15807913 ] Arun Suresh commented on YARN-6059: --- Thanks for raising this Hitesh.. Can you also maybe also outline the

[jira] [Updated] (YARN-5823) Update NMTokens in case of requests with only opportunistic containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5823: -- Fix Version/s: 2.9.0 > Update NMTokens in case of requests with only opportunistic containers >

[jira] [Commented] (YARN-5823) Update NMTokens in case of requests with only opportunistic containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786345#comment-15786345 ] Arun Suresh commented on YARN-5823: --- Committing this to branch-2 > Update NMTokens in case of requests

[jira] [Commented] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786343#comment-15786343 ] Arun Suresh commented on YARN-5377: --- Committing this to branch-2 > Fix

[jira] [Updated] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4597: -- Fix Version/s: 2.9.0 > Introduce ContainerScheduler and a SCHEDULED state to NodeManager container >

[jira] [Updated] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6041: -- Attachment: YARN-6041-branch-2.001.patch Attaching patch > Opportunistic containers : Combined patch

[jira] [Commented] (YARN-4597) Introduce ContainerScheduler and a SCHEDULED state to NodeManager container lifecycle

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786348#comment-15786348 ] Arun Suresh commented on YARN-4597: --- Committing this to branch-2 > Introduce ContainerScheduler and a

[jira] [Commented] (YARN-5918) Handle Opportunistic scheduling allocate request failure when NM is lost

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786350#comment-15786350 ] Arun Suresh commented on YARN-5918: --- Committing this to branch-2 > Handle Opportunistic scheduling

[jira] [Updated] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5982: -- Fix Version/s: 2.9.0 > Simplify opportunistic container parameters and metrics >

[jira] [Commented] (YARN-5938) Refactoring OpportunisticContainerAllocator to use SchedulerRequestKey instead of Priority and other misc fixes

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786356#comment-15786356 ] Arun Suresh commented on YARN-5938: --- Committing this to branch-2 > Refactoring

[jira] [Commented] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786354#comment-15786354 ] Arun Suresh commented on YARN-5646: --- Committing this to branch-2 > Add documentation and update config

[jira] [Updated] (YARN-5646) Add documentation and update config parameter names for scheduling of OPPORTUNISTIC containers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5646: -- Fix Version/s: 2.9.0 > Add documentation and update config parameter names for scheduling of >

[jira] [Updated] (YARN-5918) Handle Opportunistic scheduling allocate request failure when NM is lost

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5918: -- Fix Version/s: 2.9.0 > Handle Opportunistic scheduling allocate request failure when NM is lost >

[jira] [Commented] (YARN-5982) Simplify opportunistic container parameters and metrics

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786352#comment-15786352 ] Arun Suresh commented on YARN-5982: --- Committing this to branch-2 > Simplify opportunistic container

[jira] [Updated] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5486: -- Fix Version/s: 2.9.0 > Update OpportunisticContainerAllocatorAMService::allocate method to handle >

[jira] [Commented] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786337#comment-15786337 ] Arun Suresh commented on YARN-5486: --- Committing this to branch-2. YARN-5688 can be worked on

[jira] [Updated] (YARN-5799) Fix Opportunistic Allocation to set the correct value of Node Http Address

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5799: -- Fix Version/s: 2.9.0 > Fix Opportunistic Allocation to set the correct value of Node Http Address >

[jira] [Created] (YARN-6041) Opportunistic containers : Combined patch for branch-2

2016-12-29 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6041: - Summary: Opportunistic containers : Combined patch for branch-2 Key: YARN-6041 URL: https://issues.apache.org/jira/browse/YARN-6041 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5377: -- Fix Version/s: 2.9.0 > Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers >

[jira] [Commented] (YARN-2995) Enhance UI to show cluster resource utilization of various container Execution types

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786342#comment-15786342 ] Arun Suresh commented on YARN-2995: --- Committing this to branch-2 > Enhance UI to show cluster resource

[jira] [Commented] (YARN-5799) Fix Opportunistic Allocation to set the correct value of Node Http Address

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15786339#comment-15786339 ] Arun Suresh commented on YARN-5799: --- Committing this to branch-2 > Fix Opportunistic Allocation to set

[jira] [Updated] (YARN-2995) Enhance UI to show cluster resource utilization of various container Execution types

2016-12-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-2995: -- Fix Version/s: 2.9.0 > Enhance UI to show cluster resource utilization of various container > Execution

[jira] [Commented] (YARN-6040) Remove usage of ResourceRequest from AppSchedulerInfo / SchedulerApplicationAttempt

2017-01-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798997#comment-15798997 ] Arun Suresh commented on YARN-6040: --- Thanks for the patch [~leftnoteasy], Couple of comments: # Maybe

[jira] [Commented] (YARN-6066) Opportunistic containers minor fixes: API annotations and config parameter changes

2017-01-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15809617#comment-15809617 ] Arun Suresh commented on YARN-6066: --- Committing this to branch-2 shortly since these changes have already

[jira] [Commented] (YARN-6040) Remove usage of ResourceRequest from AppSchedulerInfo / SchedulerApplicationAttempt

2017-01-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15803541#comment-15803541 ] Arun Suresh commented on YARN-6040: --- Thanks for the updated patch Wangda, The latest patch looks good to

[jira] [Commented] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15762880#comment-15762880 ] Arun Suresh commented on YARN-5938: --- Thanks for the review [~leftnoteasy] bq.

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.004.patch Updating patch based on [~leftnoteasy]'s suggestions. bq.

[jira] [Commented] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765095#comment-15765095 ] Arun Suresh commented on YARN-5938: --- Committed to branch YARN-5085 Thanks for the review [~leftnoteasy]

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Summary: Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority (was:

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15765229#comment-15765229 ] Arun Suresh commented on YARN-5959: --- Based on offline discussions with [~leftnoteasy], I will rework this

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15763587#comment-15763587 ] Arun Suresh commented on YARN-5216: --- Thanks for updating the patch [~hrsharma] Couple of comments: # In

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938.003.patch Fixing some of the checkstyle warnings. The testcase failure is not

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: (was: YARN-5938.002.patch.) > Refactoring OpportunisticContainerAllocator use

[jira] [Updated] (YARN-5938) Refactoring OpportunisticContainerAllocator use SchedulerRequestKey instead of Priority

2016-12-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938.002.patch > Refactoring OpportunisticContainerAllocator use SchedulerRequestKey

<    7   8   9   10   11   12   13   14   15   16   >