[jira] [Comment Edited] (YARN-6593) [API] Introduce Placement Constraint object

2017-05-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16021954#comment-16021954 ] Arun Suresh edited comment on YARN-6593 at 5/23/17 10:09 PM: - Given that what

[jira] [Commented] (YARN-6614) Deprecate DistributedSchedulingProtocol and add required fields directly to ApplicationMasterProtocol

2017-05-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16016761#comment-16016761 ] Arun Suresh commented on YARN-6614: --- [~leftnoteasy], thanks for chiming in. So, when we designed the

[jira] [Updated] (YARN-6614) Deprecate DistributedSchedulingProtocol and add required fields directly to ApplicationMasterProtocol

2017-05-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6614: -- Description: The {{DistributedSchedulingProtocol}} was initially designed as a wrapper protocol over

[jira] [Commented] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16041645#comment-16041645 ] Arun Suresh commented on YARN-6691: --- [~giovanni.fumarola], the patch looks generally ok, but since we are

[jira] [Updated] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

2017-06-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6355: -- Attachment: YARN-6355.002.patch Updating patch with some code cleanup, javadocs and testcases >

[jira] [Assigned] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2017-05-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5978: - Assignee: Arun Suresh > ContainerScheduler and Container state machine changes to support

[jira] [Commented] (YARN-6306) NMClient API change for container upgrade

2017-05-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001549#comment-16001549 ] Arun Suresh commented on YARN-6306: --- Thanks for the rev [~jianhe]. I agree having non-abstract methods

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2017-05-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001708#comment-16001708 ] Arun Suresh commented on YARN-1197: --- [~mingma], Even though YARN-6216 renders the feature Scheduler

[jira] [Commented] (YARN-6306) NMClient API change for container upgrade

2017-05-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999085#comment-15999085 ] Arun Suresh commented on YARN-6306: --- [~jianhe], do you want to take a quick scan ? before I post another

[jira] [Updated] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

2017-05-24 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6355: -- Attachment: YARN-6355.001.patch Attaching initial version of the patch. * I think we should stick to the

[jira] [Comment Edited] (YARN-6692) Delay pause when container is localizing

2017-06-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037865#comment-16037865 ] Arun Suresh edited comment on YARN-6692 at 6/5/17 11:53 PM: This situation

[jira] [Commented] (YARN-6692) Delay pause when container is localizing

2017-06-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037865#comment-16037865 ] Arun Suresh commented on YARN-6692: --- This situation cannot really happen, since, after YARN-4597,

[jira] [Commented] (YARN-7185) ContainerScheduler should only look at availableResource for GUARANTEED containers when opportunistic scheduling is enabled

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162456#comment-16162456 ] Arun Suresh commented on YARN-7185: --- Thanks for the patch [~wangda], In general, it LGTM. Minor nit

[jira] [Commented] (YARN-5972) Support Pausing/Freezing of opportunistic containers

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16166607#comment-16166607 ] Arun Suresh commented on YARN-5972: --- Thanks [~jlowe], cherry-picked the 3 JIRAs and committed > Support

[jira] [Comment Edited] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168375#comment-16168375 ] Arun Suresh edited comment on YARN-7199 at 9/15/17 7:12 PM: Thanks for the

[jira] [Commented] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168375#comment-16168375 ] Arun Suresh commented on YARN-7199: --- Thanks for the patch [~botong]. But I think the actual issue is that

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168397#comment-16168397 ] Arun Suresh commented on YARN-7203: --- Thanks for the patch [~botong] Some comments: * You don't need to

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.004.patch Updating patch bq. A single null check in a function consumes less CPU

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.003.patch Updated the patch. Sorry missed including the yarn-defaults-xml change

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167282#comment-16167282 ] Arun Suresh commented on YARN-7192: --- The testcase failure is tracked in YARN-7196. Think the checkstyle

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.006.patch fixing checkstyles > Add a pluggable StateMachine Listener that is

[jira] [Updated] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7196: -- Attachment: YARN-7196.002.patch Updating patch. > Fix finicky TestContainerManager tests >

[jira] [Commented] (YARN-7199) TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests is failing in trunk

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170423#comment-16170423 ] Arun Suresh commented on YARN-7199: --- +1 >

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170425#comment-16170425 ] Arun Suresh commented on YARN-7203: --- +1, will commit this shortly > Add container ExecutionType into

[jira] [Updated] (YARN-7199) Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7199: -- Summary: Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests (was:

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170529#comment-16170529 ] Arun Suresh commented on YARN-7203: --- Thanks for the update [~botong]. The latest patch lgtm. With commit

[jira] [Commented] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170313#comment-16170313 ] Arun Suresh commented on YARN-7196: --- [~djp], do you mind if I take this up ? are you fine with

[jira] [Assigned] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7196: - Assignee: Arun Suresh > Fix finicky TestContainerManager tests >

[jira] [Updated] (YARN-7199) Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7199: -- Fix Version/s: 3.1.0 > Fix TestAMRMClientContainerRequest.testOpportunisticAndGuaranteedRequests >

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170473#comment-16170473 ] Arun Suresh commented on YARN-7203: --- Actually, [~botong], just realized that we havn't added any new

[jira] [Commented] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170410#comment-16170410 ] Arun Suresh commented on YARN-7196: --- I noticed that {{testPromotionOfOpportunisticContainers}} does

[jira] [Commented] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170788#comment-16170788 ] Arun Suresh commented on YARN-7196: --- [~djp], let me know if the latest patch is fine (in which case I

[jira] [Commented] (YARN-7203) Add container ExecutionType into ContainerReport

2017-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16170857#comment-16170857 ] Arun Suresh commented on YARN-7203: --- Committing this shortly. The test failure is unrelated and the

[jira] [Commented] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172636#comment-16172636 ] Arun Suresh commented on YARN-7196: --- Thanks for the review and commit [~djp] > Fix finicky

[jira] [Commented] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172518#comment-16172518 ] Arun Suresh commented on YARN-7196: --- [~djp] / [~wangda], what do u think of the latest patch ? > Fix

[jira] [Created] (YARN-7240) Add more states and transitions to stabilize the NM Container state machine

2017-09-21 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7240: - Summary: Add more states and transitions to stabilize the NM Container state machine Key: YARN-7240 URL: https://issues.apache.org/jira/browse/YARN-7240 Project: Hadoop

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-09-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16177369#comment-16177369 ] Arun Suresh commented on YARN-4511: --- Would like to take a closer look at this at well - should be able to

[jira] [Commented] (YARN-7219) Fix AllocateRequestProto difference between branch-2/branch-2.8 and trunk

2017-09-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173450#comment-16173450 ] Arun Suresh commented on YARN-7219: --- Thanks for raising this [~rchiang]. Yeah lets update everything to

[jira] [Commented] (YARN-7229) Add the metric for size of event queue in AsyncDispatcher

2017-09-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16173773#comment-16173773 ] Arun Suresh commented on YARN-7229: --- +1 to this. Additionally, in our production clusters, we also

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168473#comment-16168473 ] Arun Suresh commented on YARN-7192: --- Thanks for the review [~miklos.szeg...@cloudera.com].. [~jlowe], are

[jira] [Commented] (YARN-7206) IllegalArgumentException in AMRMClient

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168461#comment-16168461 ] Arun Suresh commented on YARN-7206: --- This is already being tracked here : YARN-7199 >

[jira] [Commented] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168638#comment-16168638 ] Arun Suresh commented on YARN-7196: --- Thanks for looking in to it and the patch [~djp], I think a better

[jira] [Created] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-13 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7192: - Summary: Add a pluggable StateMachine Listener that is notified of NM Container State changes Key: YARN-7192 URL: https://issues.apache.org/jira/browse/YARN-7192 Project:

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.001.patch Attaching initial patch > Add a pluggable StateMachine Listener that is

[jira] [Updated] (YARN-6838) Add support to LinuxContainerExecutor to support container PAUSE

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6838: -- Target Version/s: 3.1.0 > Add support to LinuxContainerExecutor to support container PAUSE >

[jira] [Created] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-14 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7196: - Summary: Fix finicky TestContainerManager tests Key: YARN-7196 URL: https://issues.apache.org/jira/browse/YARN-7196 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167076#comment-16167076 ] Arun Suresh commented on YARN-7009: --- Thanks for the patch [~miklos.szeg...@cloudera.com]. I was thinking,

[jira] [Commented] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167028#comment-16167028 ] Arun Suresh commented on YARN-7192: --- Thanks for the detailed review [~jlowe]. bq. Would it make sense for

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.002.patch Updated the patch based on suggestions - and fixed the testcases /

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-09-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176435#comment-16176435 ] Arun Suresh commented on YARN-6623: --- Thanks for the heads up [~djp].. Kindly do push this into branch-2

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2017-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175795#comment-16175795 ] Arun Suresh commented on YARN-6595: --- [~kkaranasos], do give the latest patch a quick look. > [API] Add

[jira] [Commented] (YARN-7009) TestNMClient.testNMClientNoCleanupOnStop is flaky by design

2017-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175131#comment-16175131 ] Arun Suresh commented on YARN-7009: --- Thanks for the update [~miklos.szeg...@cloudera.com], Can we move

[jira] [Updated] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7196: -- Description: The Testcase {{testContainerUpdateExecTypeGuaranteedToOpportunistic}} seem to fail every

[jira] [Updated] (YARN-7196) Fix finicky TestContainerManager tests

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7196: -- Environment: (was: The Testcase {{testContainerUpdateExecTypeGuaranteedToOpportunistic}} seem to

[jira] [Updated] (YARN-7192) Add a pluggable StateMachine Listener that is notified of NM Container State changes

2017-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7192: -- Attachment: YARN-7192.005.patch Thanks [~jlowe] for the rev. Updating the patch (005) with a

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196102#comment-16196102 ] Arun Suresh commented on YARN-7275: --- Thanks for the patch [~kartheek] Couple of comments: * We can also

[jira] [Commented] (YARN-5978) ContainerScheduler and ContainerManager changes to support ExecType update

2017-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190934#comment-16190934 ] Arun Suresh commented on YARN-5978: --- Thanks for following up [~ajisakaa].. I had ignored the test since

[jira] [Commented] (YARN-7044) TestContainerAllocation#testAMContainerAllocationWhenDNSUnavailable fails on trunk

2017-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190932#comment-16190932 ] Arun Suresh commented on YARN-7044: --- Nice catch [~ajisakaa] !! The patch looks good. +1 pending jenkins

[jira] [Commented] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16191701#comment-16191701 ] Arun Suresh commented on YARN-7258: --- Thanks for the patch [~kartheek] Some comments: * It looks generally

[jira] [Commented] (YARN-7219) Fix AllocateRequestProto difference between branch-2/branch-2.8 and trunk

2017-10-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16190357#comment-16190357 ] Arun Suresh commented on YARN-7219: --- +1 > Fix AllocateRequestProto difference between

[jira] [Commented] (YARN-7299) TestDistributedScheduler is failing

2017-10-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197260#comment-16197260 ] Arun Suresh commented on YARN-7299: --- Thanks for raising this [~jlowe] Yeah... we changed the behavior a

[jira] [Updated] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7258: -- Fix Version/s: 2.9.0 > Add Node and Rack Hints to Opportunistic Scheduler >

[jira] [Commented] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193838#comment-16193838 ] Arun Suresh commented on YARN-7258: --- Committed this to branch-3.0 and branch-2 as well > Add Node and

[jira] [Commented] (YARN-7258) Add Node and Rack Hints to Opportunistic Scheduler

2017-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193200#comment-16193200 ] Arun Suresh commented on YARN-7258: --- +1 for the latest patch. Committed this to trunk. Thanks for the

[jira] [Commented] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206220#comment-16206220 ] Arun Suresh commented on YARN-7275: --- Thanks for the update [~kartheek]. +1, the latest patch lgtm. The

[jira] [Assigned] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-10-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7343: - Assignee: Sampada Dehankar (was: kartheek muthyala) > Add a junit test for ContainerScheduler

[jira] [Updated] (YARN-7327) Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7327: -- Summary: Allocate containers asynchronously by default (was: Launch containers asynchronously by

[jira] [Commented] (YARN-7327) Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16204337#comment-16204337 ] Arun Suresh commented on YARN-7327: --- Changed the tile : It looks like this is more related to the RM

[jira] [Updated] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-10-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7327: -- Summary: CapacityScheduler: Allocate containers asynchronously by default (was: Allocate containers

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206521#comment-16206521 ] Arun Suresh commented on YARN-4859: --- Sorry to chime in late [~yufeigu], but If you are testing this,

[jira] [Comment Edited] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206521#comment-16206521 ] Arun Suresh edited comment on YARN-4859 at 10/16/17 8:05 PM: - Sorry to chime in

[jira] [Updated] (YARN-7275) NM Statestore cleanup for Container updates

2017-10-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7275: -- Fix Version/s: 3.0.0 2.9.0 > NM Statestore cleanup for Container updates >

[jira] [Commented] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158858#comment-16158858 ] Arun Suresh commented on YARN-6849: --- +1, The test failures are unrelated. Committing this shortly.. >

[jira] [Updated] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6849: -- Issue Type: Sub-task (was: Bug) Parent: YARN-5085 > NMContainerStatus should have the Container

[jira] [Updated] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6849: -- Description: Currently only the ContainerState is sent to the RM in the NMContainerStatus. This lets the

[jira] [Resolved] (YARN-4509) Promote containers from OPPORTUNISTIC to GUARANTEED

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-4509. --- Resolution: Duplicate Target Version/s: (was: ) > Promote containers from OPPORTUNISTIC to

[jira] [Commented] (YARN-4509) Promote containers from OPPORTUNISTIC to GUARANTEED

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16158894#comment-16158894 ] Arun Suresh commented on YARN-4509: --- Marking as duplicate of YARN-5085 > Promote containers from

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Issue Type: Sub-task (was: Bug) Parent: YARN-5085 > Expose UpdateResourceRequest API to allow

[jira] [Updated] (YARN-7173) Container Update Backward compatibility fix for upgrades

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7173: -- Attachment: YARN-7173.001.patch Looks like this is required for 3.0.x / trunk as well. Attaching trunk

[jira] [Updated] (YARN-3417) AM to be able to exit with a request saying "restart me with these (possibly updated) resource requirements"

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-3417: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4726) > AM to be able to exit with a

[jira] [Updated] (YARN-1040) De-link container life cycle from an Allocation

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-1040: -- Issue Type: New Feature (was: Sub-task) Parent: (was: YARN-4726) > De-link container life

[jira] [Updated] (YARN-4876) Decoupled Init / Destroy of Containers from Start / Stop

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4876: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-4726) > Decoupled Init / Destroy

[jira] [Updated] (YARN-7173) Container Update Backward compatibility fix for upgrades

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7173: -- Summary: Container Update Backward compatibility fix for upgrades (was: Container Update Backward

[jira] [Updated] (YARN-7173) Container Update Backward compatibility fix for upgrades

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7173: -- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.9.0) > Container Update Backward compatibility fix for

[jira] [Created] (YARN-7178) Add documentation for Container Update API

2017-09-08 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7178: - Summary: Add documentation for Container Update API Key: YARN-7178 URL: https://issues.apache.org/jira/browse/YARN-7178 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7173) Container Update Backward compatibility fix for upgrades

2017-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16159345#comment-16159345 ] Arun Suresh commented on YARN-7173: --- The test failures are unrelated. I also ran

[jira] [Commented] (YARN-7117) Capacity Scheduler: Support Auto Creation of Leaf Queues While Doing Queue Mapping

2017-08-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145990#comment-16145990 ] Arun Suresh commented on YARN-7117: --- cc [~subru] and [~curino] > Capacity Scheduler: Support Auto

[jira] [Closed] (YARN-6692) Delay pause when container is localizing

2017-09-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh closed YARN-6692. - > Delay pause when container is localizing > > > Key:

[jira] [Assigned] (YARN-6059) Update paused container state in the state store

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6059: - Assignee: Arun Suresh (was: Hitesh Sharma) > Update paused container state in the state store >

[jira] [Updated] (YARN-6059) Update paused container state in the state store

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6059: -- Priority: Blocker (was: Major) > Update paused container state in the state store >

[jira] [Updated] (YARN-6059) Update paused container state in the state store

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6059: -- Fix Version/s: 3.0.0 2.9.0 > Update paused container state in the state store >

[jira] [Updated] (YARN-6059) Update paused container state in the state store

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6059: -- Attachment: YARN-6059-YARN-5972.011.patch Cleaning up and re-attaching last patch to rebased YARN-5972

[jira] [Resolved] (YARN-6692) Delay pause when container is localizing

2017-09-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-6692. --- Resolution: Invalid Closing this, since it is not a valid scenario currently. > Delay pause when

[jira] [Assigned] (YARN-6059) Update paused container state in the state store

2017-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6059: - Assignee: Hitesh Sharma (was: Arun Suresh) > Update paused container state in the state store >

[jira] [Commented] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154291#comment-16154291 ] Arun Suresh commented on YARN-7126: --- It looks like some of TBDs must must be removed. Also, I think we

[jira] [Assigned] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-09-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6849: - Assignee: kartheek muthyala (was: Atri Sharma) > NMContainerStatus should have the Container

[jira] [Commented] (YARN-6849) NMContainerStatus should have the Container ExecutionType.

2017-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157071#comment-16157071 ] Arun Suresh commented on YARN-6849: --- Thanks for the patch [~kartheek] Can we also add in the testcase a

[jira] [Commented] (YARN-6978) Add updateContainer API to NMClient.

2017-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157007#comment-16157007 ] Arun Suresh commented on YARN-6978: --- Thanks for the update patch [~kartheek], It looks mostly good to

[jira] [Created] (YARN-7173) Container Update Backward compatibility fix for upgrades from 2.8.x

2017-09-07 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7173: - Summary: Container Update Backward compatibility fix for upgrades from 2.8.x Key: YARN-7173 URL: https://issues.apache.org/jira/browse/YARN-7173 Project: Hadoop YARN

[jira] [Commented] (YARN-6978) Add updateContainer API to NMClient.

2017-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16157365#comment-16157365 ] Arun Suresh commented on YARN-6978: --- +1 Committing this shortly (will fix the minor indentation

<    11   12   13   14   15   16   17   18   19   20   >