[jira] [Commented] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725564#comment-15725564 ] Sunil G commented on YARN-5970: --- I think point 3 is handled in YARN-5965. Pls skip my 3rd comment. >

[jira] [Created] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5972: - Summary: Add Support for Pausing/Freezing of containers Key: YARN-5972 URL: https://issues.apache.org/jira/browse/YARN-5972 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5292: -- Summary: NM Container lifecycle and state transitions to support for PAUSED container state. (was:

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5292: -- Issue Type: Sub-task (was: New Feature) Parent: YARN-5972 > NM Container lifecycle and state

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725848#comment-15725848 ] Arun Suresh commented on YARN-5972: --- As per Subru's request in YARN-5292, I have moved this to an

[jira] [Commented] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725588#comment-15725588 ] Rohith Sharma K S commented on YARN-5970: - bq. Since we do not know the error offset, do we need to

[jira] [Commented] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725641#comment-15725641 ] Hadoop QA commented on YARN-5965: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725677#comment-15725677 ] Sunil G commented on YARN-5965: --- Thanks [~rohithsharma] Few minor nits: {noformat} optional

[jira] [Updated] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5972: -- Description: YARN-2877 introduced OPPORTUNISTIC containers, and YARN-5216 proposes to add capability to

[jira] [Commented] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725550#comment-15725550 ] Sunil G commented on YARN-5970: --- Thanks [~rohithsharma] 1) bq.{{throw new ParseException("Invalid input.",

[jira] [Comment Edited] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725844#comment-15725844 ] Arun Suresh edited comment on YARN-5972 at 12/6/16 3:40 PM: Created YARN-5972

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725844#comment-15725844 ] Arun Suresh commented on YARN-5972: --- Create YARN-5972 branch for this work > Add Support for

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726372#comment-15726372 ] Sangjin Lee commented on YARN-4675: --- I agree that we need to have a firm conclusion one way or another on

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726187#comment-15726187 ] Sangjin Lee commented on YARN-5739: --- I have committed the patch to YARN-5355 and YARN-5355-branch-2. I

[jira] [Commented] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726220#comment-15726220 ] Jian He commented on YARN-5932: --- bq. Could such cases be handled in next allocation / preemption cycle

[jira] [Commented] (YARN-5709) Cleanup Curator-based leader election code

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726301#comment-15726301 ] Karthik Kambatla commented on YARN-5709: [~djp] - I was really hoping to clean up the configs in

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-12-06 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726204#comment-15726204 ] Allen Wittenauer commented on YARN-5910: bq. How to maintain such an unknown list is a non-trivial

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726389#comment-15726389 ] Sangjin Lee commented on YARN-4675: --- For your reference, things that are referencing

[jira] [Commented] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727922#comment-15727922 ] Sunil G commented on YARN-5970: --- Patch looks good for me. I will commit the patch later today if there are no

[jira] [Commented] (YARN-5085) Add support for change of container ExecutionType

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728054#comment-15728054 ] Hadoop QA commented on YARN-5085: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727733#comment-15727733 ] Rohith Sharma K S commented on YARN-5932: - committed to trunk.. the patch do not apply to branch-2.

[jira] [Updated] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5965: Attachment: YARN-5965.1.patch updated patch addressing comments > Revisit ApplicationReport

[jira] [Commented] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-12-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727784#comment-15727784 ] Hudson commented on YARN-5932: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10958 (See

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-12-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727783#comment-15727783 ] Hudson commented on YARN-5611: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10958 (See

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2016-12-06 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727953#comment-15727953 ] Varun Vasudev commented on YARN-5673: - Thanks for the feedback [~miklos.szeg...@cloudera.com]! {quote}

[jira] [Commented] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728033#comment-15728033 ] Jian He commented on YARN-5965: --- lgtm > Revisit ApplicationReport #getApplicationTimeouts >

[jira] [Commented] (YARN-5877) Allow all nm-whitelist-env to get overridden during launch

2016-12-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727893#comment-15727893 ] Sunil G commented on YARN-5877: --- We have checked various cases for this issue in detail and had some offline

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.1.patch > Cleanup leader election related configuration mess >

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: (was: yarn-5709-1.patch) > Cleanup leader election related configuration mess

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-12-06 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727669#comment-15727669 ] Wilfred Spiegelenburg commented on YARN-5554: - The main point is that the {{ClientRMService}}

[jira] [Commented] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727101#comment-15727101 ] Hadoop QA commented on YARN-5922: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-5006) ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk

2016-12-06 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun reassigned YARN-5006: --- Assignee: luhuichun > ResourceManager quit due to ApplicationStateData exceed the limit size of >

[jira] [Assigned] (YARN-2338) service assemble so complex

2016-12-06 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun reassigned YARN-2338: --- Assignee: luhuichun > service assemble so complex > --- > >

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727160#comment-15727160 ] Hadoop QA commented on YARN-4390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727593#comment-15727593 ] Hadoop QA commented on YARN-5709: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727307#comment-15727307 ] Hitesh Sharma commented on YARN-5966: - Just a quick clarification, how is it different than

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727438#comment-15727438 ] Karthik Kambatla commented on YARN-5709: The patch posted here captures my intention. [~jianhe] -

[jira] [Assigned] (YARN-558) Add ability to completely remove nodemanager from resourcemanager.

2016-12-06 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun reassigned YARN-558: -- Assignee: luhuichun > Add ability to completely remove nodemanager from resourcemanager. >

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727256#comment-15727256 ] Hitesh Sharma commented on YARN-5972: - Hi folks, thanks for opening this JIRA and the feedback. Much

[jira] [Commented] (YARN-5966) AMRMClient changes to support ExecutionType update

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727336#comment-15727336 ] Arun Suresh commented on YARN-5966: --- [~hrsharma], YARN-5087 addresses changes in the

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709-1.patch > Cleanup leader election related configuration mess >

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: (was: yarn-5709.1.patch) > Cleanup leader election related configuration mess

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Attachment: yarn-5709.1.patch > Cleanup leader election related configuration mess >

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-06 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727137#comment-15727137 ] Jonathan Hung commented on YARN-5734: - Hi [~jianhe], thanks for the feedback. bq. Does add/remove also

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-06 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727312#comment-15727312 ] Hitesh Sharma commented on YARN-5959: - Hello [~asuresh], can you share some design around how NM

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725959#comment-15725959 ] Eric Payne commented on YARN-4390: -- The failing unit tests {{TestAMAuthorization, TestCapacityScheduler,

[jira] [Commented] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726063#comment-15726063 ] Varun Saxena commented on YARN-5647: Please note patch in YARN-5648 is on top of YARN-5647 >

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726060#comment-15726060 ] Varun Saxena commented on YARN-5739: [~sjlee0], should I go ahead and commit it or do you want to

[jira] [Commented] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727237#comment-15727237 ] Hadoop QA commented on YARN-5975: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5959) RM changes to support change of container ExecutionType

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727348#comment-15727348 ] Arun Suresh commented on YARN-5959: --- [~hrsharma], this patch address only the RM side changes. The

[jira] [Updated] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Summary: Cleanup leader election configs and pluggability (was: Cleanup leader election

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727172#comment-15727172 ] Jian He commented on YARN-5554: --- oh, I think it was because the CapacityScheduler#checkAccess is actually not

[jira] [Created] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2016-12-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5977: - Summary: ContainerManagementProtocol changes to support change of container ExecutionType Key: YARN-5977 URL: https://issues.apache.org/jira/browse/YARN-5977 Project:

[jira] [Created] (YARN-5978) ContainerScheduler and Container state machine changes to support ExecType update

2016-12-06 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5978: - Summary: ContainerScheduler and Container state machine changes to support ExecType update Key: YARN-5978 URL: https://issues.apache.org/jira/browse/YARN-5978 Project:

[jira] [Assigned] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reassigned YARN-5709: -- Assignee: Karthik Kambatla (was: Daniel Templeton) > Cleanup leader election related

[jira] [Commented] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-12-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727426#comment-15727426 ] Sangjin Lee commented on YARN-5922: --- I cherry-picked that commit into YARN-5355 and YARN-5355-branch-2

[jira] [Assigned] (YARN-5120) Metric for RM async dispatcher queue size

2016-12-06 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun reassigned YARN-5120: --- Assignee: luhuichun > Metric for RM async dispatcher queue size >

[jira] [Updated] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Summary: Cleanup leader election related configuration mess (was: Cleanup Curator-based

[jira] [Updated] (YARN-5709) Cleanup Curator-based leader election code

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5709: --- Priority: Blocker (was: Critical) > Cleanup Curator-based leader election code >

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726446#comment-15726446 ] Wangda Tan commented on YARN-4390: -- Thanks [~eepayne], if the {{TestCapacitySchedulerSurgicalPreemption}}

[jira] [Commented] (YARN-5685) Non-embedded HA failover is broken

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726603#comment-15726603 ] Karthik Kambatla commented on YARN-5685: I am uncomfortable with deprecating the config for

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4390: - Attachment: YARN-4390.branch-2.8.002.patch Thanks [~leftnoteasy]. {quote} Thanks Eric Payne, if the

[jira] [Commented] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726913#comment-15726913 ] Arun Suresh commented on YARN-5972: --- [~subru], thanks for taking a look. w.r.t your

[jira] [Commented] (YARN-3409) Add constraint node labels

2016-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726911#comment-15726911 ] Wangda Tan commented on YARN-3409: -- Thanks [~naganarasimha...@apache.org], my responses: bq. the above

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726920#comment-15726920 ] Jian He commented on YARN-5709: --- bq. yarn.resourcemanager.ha.automatic-failover.embedded For the original

[jira] [Updated] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-12-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5922: - Attachment: YARN-5922.03.patch > Remove direct references of HBaseTimelineWriter/Reader in core ATS

[jira] [Commented] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-12-06 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726932#comment-15726932 ] Haibo Chen commented on YARN-5922: -- Uploaded a new patch for trunk branch now that HADOOP-13859 has been

[jira] [Created] (YARN-5975) Remove the agent - sldier M ssl related code

2016-12-06 Thread Jian He (JIRA)
Jian He created YARN-5975: - Summary: Remove the agent - sldier M ssl related code Key: YARN-5975 URL: https://issues.apache.org/jira/browse/YARN-5975 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5975) Remove the agent - sldier M ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Attachment: YARN-5975-yarn-native-services.01.patch > Remove the agent - sldier M ssl related code >

[jira] [Assigned] (YARN-5975) Remove the agent - sldier AM ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5975: - Assignee: Jian He > Remove the agent - sldier AM ssl related code >

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726943#comment-15726943 ] Karthik Kambatla commented on YARN-5709: bq. For the original hadoop-common's elector, I agree we

[jira] [Updated] (YARN-5975) Remove the agent - sldier AM ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Summary: Remove the agent - sldier AM ssl related code (was: Remove the agent - sldier M ssl related code) >

[jira] [Updated] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Summary: Remove the agent - slider AM ssl related code (was: Remove the agent - sldier AM ssl related code) >

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-12-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726946#comment-15726946 ] Daniel Templeton commented on YARN-5554: bq. The change to not use the checkAccess() of the

[jira] [Assigned] (YARN-5970) Validate AppTimeoutInfo request parameters

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-5970: --- Assignee: Rohith Sharma K S > Validate AppTimeoutInfo request parameters >

[jira] [Created] (YARN-5970) Validate AppTimeoutInfo request parameters

2016-12-06 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-5970: --- Summary: Validate AppTimeoutInfo request parameters Key: YARN-5970 URL: https://issues.apache.org/jira/browse/YARN-5970 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5971) All Events processed by one dispatcher in rm

2016-12-06 Thread Zhaofei Meng (JIRA)
Zhaofei Meng created YARN-5971: -- Summary: All Events processed by one dispatcher in rm Key: YARN-5971 URL: https://issues.apache.org/jira/browse/YARN-5971 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5965: Attachment: YARN-5965.0.patch updated patch changing return type to Map. > Revisit

[jira] [Updated] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5970: Attachment: YARN-5970.0.patch Updating the patch with following changes. # Validate for

[jira] [Commented] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724926#comment-15724926 ] Varun Saxena commented on YARN-5647: I was actually attempting to remove setupOptions but soon realised

[jira] [Comment Edited] (YARN-5647) [Security] Collector and reader side changes for loading auth filters and principals

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724926#comment-15724926 ] Varun Saxena edited comment on YARN-5647 at 12/6/16 9:33 AM: - I was actually

[jira] [Commented] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725389#comment-15725389 ] Hadoop QA commented on YARN-5970: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724916#comment-15724916 ] Varun Saxena commented on YARN-5739: Checkstyle is unrelated. +1 LGTM. > Provide timeline reader API

[jira] [Commented] (YARN-5935) TestAppRunnability.testMoveRunnableApp fails intermittently

2016-12-06 Thread Fei Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15725050#comment-15725050 ] Fei Hui commented on YARN-5935: --- which version do you test? > TestAppRunnability.testMoveRunnableApp fails

[jira] [Updated] (YARN-5970) Validate update timeout request parameters

2016-12-06 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5970: Summary: Validate update timeout request parameters (was: Validate AppTimeoutInfo request

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2016-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726489#comment-15726489 ] Miklos Szegedi commented on YARN-5673: -- Thank you [~vvasudev] for the design proposal! I like the

[jira] [Comment Edited] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726506#comment-15726506 ] Karthik Kambatla edited comment on YARN-5709 at 12/6/16 7:50 PM: - My

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726506#comment-15726506 ] Karthik Kambatla commented on YARN-5709: My primary concern with the current 2.8.0 code is

[jira] [Created] (YARN-5973) TestCapacitySchedulerSurgicalPreemption sometimes fails

2016-12-06 Thread Eric Payne (JIRA)
Eric Payne created YARN-5973: Summary: TestCapacitySchedulerSurgicalPreemption sometimes fails Key: YARN-5973 URL: https://issues.apache.org/jira/browse/YARN-5973 Project: Hadoop YARN Issue

[jira] [Reopened] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-4390: -- > Do surgical preemption based on reserved container in CapacityScheduler >

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726731#comment-15726731 ] Wangda Tan commented on YARN-4390: -- [~eepayne], thanks. Reopened the ticket to trigger Jenkins. > Do

[jira] [Updated] (YARN-5969) FairShareComparator getResourceUsage poor performance

2016-12-06 Thread Daniel Templeton (JIRA)
Affects Versions: 2.7.1 >Reporter: zhangshilong >Assignee: zhangshilong > Attachments: 20161206.patch > > > in FairShareComparator class, the performance of function getResourceUsage() > is very poor. It will be executed above 100,000,000 times per second.

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726776#comment-15726776 ] Li Lu commented on YARN-4675: - I'm fine with separating the v1 and v2 interfaces. Right now mixing v1 and v2

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726783#comment-15726783 ] Li Lu commented on YARN-4675: - Created YARN-5974 for removing unnecessary references to TimelineClientImpl. >

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726699#comment-15726699 ] Varun Saxena commented on YARN-4675: At a cursory glance, the patch posted seems to be at a high level,

[jira] [Comment Edited] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-06 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726699#comment-15726699 ] Varun Saxena edited comment on YARN-4675 at 12/6/16 9:02 PM: - At a cursory

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726717#comment-15726717 ] Wangda Tan commented on YARN-5756: -- Thanks [~xgong], some comments/questions. General: - Could you add

[jira] [Created] (YARN-5974) Remove direct reference to TimelineClientImpl

2016-12-06 Thread Li Lu (JIRA)
Li Lu created YARN-5974: --- Summary: Remove direct reference to TimelineClientImpl Key: YARN-5974 URL: https://issues.apache.org/jira/browse/YARN-5974 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Comment Edited] (YARN-5972) Add Support for Pausing/Freezing of containers

2016-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726913#comment-15726913 ] Arun Suresh edited comment on YARN-5972 at 12/6/16 10:49 PM: - [~subru], thanks

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726972#comment-15726972 ] Jian He commented on YARN-5709: --- yeah... I mean.. if we already have an explicit config

  1   2   >