[jira] [Created] (YARN-5998) Simplify the logs for queue initialization

2016-12-13 Thread Jian He (JIRA)
Jian He created YARN-5998: - Summary: Simplify the logs for queue initialization Key: YARN-5998 URL: https://issues.apache.org/jira/browse/YARN-5998 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746161#comment-15746161 ] Jian He commented on YARN-5975: --- thanks for the update ! > Remove the agent - slider AM ssl related code >

[jira] [Updated] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Attachment: YARN-5975-yarn-native-services.02.patch removed a couple of unused params in AclientClientArgs. >

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-12 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15743822#comment-15743822 ] Jian He commented on YARN-5709: --- I agree with what you suggested, include it. > Cleanup leader election

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738752#comment-15738752 ] Jian He commented on YARN-5216: --- Is the question that, given container-executor can already have a conf to

[jira] [Updated] (YARN-4438) Implement RM leader election with curator

2016-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4438: -- Target Version/s: 2.9.0 (was: 2.8.0) > Implement RM leader election with curator >

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15738355#comment-15738355 ] Jian He commented on YARN-5709: --- oh,, ok. Sounds good to me, given that those do not affect existing code.

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736967#comment-15736967 ] Jian He commented on YARN-4126: --- bq. Assuming that Oozie wants to keep supporting 2.x releases there must be

[jira] [Commented] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736894#comment-15736894 ] Jian He commented on YARN-5975: --- Since they are not needed at this point, and those code introduced a lot

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736886#comment-15736886 ] Jian He commented on YARN-5709: --- branch-2, and trunk is committed. Unfortunately, there seems quite some

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736827#comment-15736827 ] Jian He commented on YARN-5709: --- +1, committing > Cleanup leader election configs and pluggability >

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15733166#comment-15733166 ] Jian He commented on YARN-5709: --- thanks Karthik for the refactoring, it indeed looks cleaner ! minor comment

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15731145#comment-15731145 ] Jian He commented on YARN-3866: --- IIUC, the value of adding back this API is to avoid the

[jira] [Assigned] (YARN-5740) Add a new field in Slider status output - lifetime (remaining)

2016-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5740: - Assignee: Jian He > Add a new field in Slider status output - lifetime (remaining) >

[jira] [Updated] (YARN-5740) Add a new field in Slider status output - lifetime (remaining)

2016-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5740: -- Attachment: YARN-5740-yarn-native-services.01.patch This patch address both rest API and slider CLI to get the

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15730016#comment-15730016 ] Jian He commented on YARN-5709: --- i see, sounds good to me. > Cleanup leader election configs and

[jira] [Commented] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15729904#comment-15729904 ] Jian He commented on YARN-3866: --- I think all patches are committed to branch-2.8. it should be fine ? >

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15729865#comment-15729865 ] Jian He commented on YARN-5709: --- yeah, looks good to me overall should CURATOR_LEADER_ELECTOR in

[jira] [Commented] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15728033#comment-15728033 ] Jian He commented on YARN-5965: --- lgtm > Revisit ApplicationReport #getApplicationTimeouts >

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15727172#comment-15727172 ] Jian He commented on YARN-5554: --- oh, I think it was because the CapacityScheduler#checkAccess is actually not

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726994#comment-15726994 ] Jian He commented on YARN-5554: --- In YARN-4571, do you mean the QueueACLsManager#checkAccess method ? it has

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726972#comment-15726972 ] Jian He commented on YARN-5709: --- yeah... I mean.. if we already have an explicit config

[jira] [Updated] (YARN-5975) Remove the agent - slider AM ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Summary: Remove the agent - slider AM ssl related code (was: Remove the agent - sldier AM ssl related code) >

[jira] [Assigned] (YARN-5975) Remove the agent - sldier AM ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5975: - Assignee: Jian He > Remove the agent - sldier AM ssl related code >

[jira] [Updated] (YARN-5975) Remove the agent - sldier AM ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Summary: Remove the agent - sldier AM ssl related code (was: Remove the agent - sldier M ssl related code) >

[jira] [Updated] (YARN-5975) Remove the agent - sldier M ssl related code

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5975: -- Attachment: YARN-5975-yarn-native-services.01.patch > Remove the agent - sldier M ssl related code >

[jira] [Created] (YARN-5975) Remove the agent - sldier M ssl related code

2016-12-06 Thread Jian He (JIRA)
Jian He created YARN-5975: - Summary: Remove the agent - sldier M ssl related code Key: YARN-5975 URL: https://issues.apache.org/jira/browse/YARN-5975 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5709) Cleanup leader election related configuration mess

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726920#comment-15726920 ] Jian He commented on YARN-5709: --- bq. yarn.resourcemanager.ha.automatic-failover.embedded For the original

[jira] [Commented] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-12-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15726220#comment-15726220 ] Jian He commented on YARN-5932: --- bq. Could such cases be handled in next allocation / preemption cycle

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15724356#comment-15724356 ] Jian He commented on YARN-5734: --- [~mshen], [~jhung], [~zhz], very useful feature! thanks for the

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: YARN-5967-yarn-native-services.01.patch > Fix slider core module findbugs warnings >

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: (was: YARN-5967-yarn-native-services-01.patch) > Fix slider core module findbugs warnings >

[jira] [Created] (YARN-5968) Fix slider core module javadocs

2016-12-05 Thread Jian He (JIRA)
Jian He created YARN-5968: - Summary: Fix slider core module javadocs Key: YARN-5968 URL: https://issues.apache.org/jira/browse/YARN-5968 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: YARN-5967-yarn-native-services-01.patch a dummy patch to trigger jenkins > Fix slider core module

[jira] [Created] (YARN-5967) Fix slider core module findbugs warnings

2016-12-05 Thread Jian He (JIRA)
Jian He created YARN-5967: - Summary: Fix slider core module findbugs warnings Key: YARN-5967 URL: https://issues.apache.org/jira/browse/YARN-5967 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5525) Make log aggregation service class configurable

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723872#comment-15723872 ] Jian He commented on YARN-5525: --- yeah, we should probably have both log aggregator and logFetcher pluggable

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723829#comment-15723829 ] Jian He commented on YARN-5910: --- bq. ideally, the token should be self-sufficient to discover the renewer

[jira] [Assigned] (YARN-5768) Integrate remaining app lifetime using feature implemented in YARN-4206

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5768: - Assignee: Jian He > Integrate remaining app lifetime using feature implemented in YARN-4206 >

[jira] [Commented] (YARN-5931) Document timeout interfaces CLI and REST APIs

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723542#comment-15723542 ] Jian He commented on YARN-5931: --- - " Update timeout of an application from NOW. ApplicationId can be passed

[jira] [Commented] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15723482#comment-15723482 ] Jian He commented on YARN-5965: --- yep, sounds good to me. > Revisit ApplicationReport #getApplicationTimeouts

[jira] [Commented] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15721574#comment-15721574 ] Jian He commented on YARN-5965: --- [~sunilg], [~rohithsharma] your opinion ? I was working on YARN-5768,

[jira] [Created] (YARN-5965) Revisit ApplicationReport #getApplicationTimeouts

2016-12-05 Thread Jian He (JIRA)
Jian He created YARN-5965: - Summary: Revisit ApplicationReport #getApplicationTimeouts Key: YARN-5965 URL: https://issues.apache.org/jira/browse/YARN-5965 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-12-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15718846#comment-15718846 ] Jian He commented on YARN-5559: --- [~ajisakaa], mind check the findbugs warning? > Analyse 2.8.0/3.0.0 jdiff

[jira] [Commented] (YARN-5961) Generate native services protobuf classes during build

2016-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15717006#comment-15717006 ] Jian He commented on YARN-5961: --- looks good to me. should below profile in the same pom file be removed ?

[jira] [Commented] (YARN-5694) ZKRMStateStore can prevent the transition to standby in branch-2.7 if the ZK node is unreachable

2016-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15716950#comment-15716950 ] Jian He commented on YARN-5694: --- sounds good, i'll commit the 2.7 and 2.6 patches > ZKRMStateStore can

[jira] [Updated] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5746: -- Labels: (was: oct16-easy) > The state of the parentQueue and its childQueues should be synchronized. >

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15715947#comment-15715947 ] Jian He commented on YARN-5559: --- [~ajisakaa], the patch looks good to me, only that I saw

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713444#comment-15713444 ] Jian He commented on YARN-5910: --- Thanks for your inputs, Jason bq. Once we have a keytab, is there a need to

[jira] [Commented] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15710684#comment-15710684 ] Jian He commented on YARN-5769: --- Yep, updated the patch to change that. > Integrate update app lifetime

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: YARN-5769-yarn-native-services.03.patch > Integrate update app lifetime using feature implemented in

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: (was: YARN-5769-yarn-native-services.02.patch) > Integrate update app lifetime using feature

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: YARN-5769-yarn-native-services.02.patch > Integrate update app lifetime using feature implemented in

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: YARN-5769-yarn-native-services.02.patch > Integrate update app lifetime using feature implemented in

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: (was: YARN-5769-yarn-native-services.02.patch) > Integrate update app lifetime using feature

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: YARN-5769-yarn-native-services.02.patch > Integrate update app lifetime using feature implemented in

[jira] [Commented] (YARN-5709) Cleanup Curator-based leader election code

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709834#comment-15709834 ] Jian He commented on YARN-5709: --- When I had offline discussion with [~xgong], the ultimate goal is to remove

[jira] [Commented] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709783#comment-15709783 ] Jian He commented on YARN-5932: --- one question about move, what if the target queue goes over its capacity

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-11-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15709497#comment-15709497 ] Jian He commented on YARN-5559: --- sorry, I meant get/setNodeLabelList ... no 's'.. would you also if the

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707761#comment-15707761 ] Jian He commented on YARN-5559: --- bq. we can make setNodeLabels(List) to setNodeLabelsList(List sounds good,

[jira] [Comment Edited] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707227#comment-15707227 ] Jian He edited comment on YARN-5746 at 11/30/16 1:58 AM: - the message could be more

[jira] [Commented] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15707227#comment-15707227 ] Jian He commented on YARN-5746: --- the message could be more clear as "Parent queue (queueName) state is

[jira] [Created] (YARN-5940) Change Re-Init API to use deferred RPC

2016-11-29 Thread Jian He (JIRA)
Jian He created YARN-5940: - Summary: Change Re-Init API to use deferred RPC Key: YARN-5940 URL: https://issues.apache.org/jira/browse/YARN-5940 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5694) ZKRMStateStore can prevent the transition to standby in branch-2.7 if the ZK node is unreachable

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706759#comment-15706759 ] Jian He commented on YARN-5694: --- I see, then we need a separate patch for 2.6 in that case, as current 2.7

[jira] [Commented] (YARN-5694) ZKRMStateStore can prevent the transition to standby in branch-2.7 if the ZK node is unreachable

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706740#comment-15706740 ] Jian He commented on YARN-5694: --- latest patch for branch-2.7 looks good to me, thanks Daniel ! is this

[jira] [Updated] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5769: -- Attachment: YARN-5769-yarn-native-services.01.patch > Integrate update app lifetime using feature implemented in

[jira] [Updated] (YARN-5909) Remove the agent code in slider

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5909: -- Summary: Remove the agent code in slider (was: Remove the agent code in slider and upgrade framework jetty

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15706246#comment-15706246 ] Jian He commented on YARN-5559: --- Thanks for updating ! - Found that the getter/setter name is inconsistent,

[jira] [Commented] (YARN-5559) Analyse 2.8.0/3.0.0 jdiff reports and fix any issues

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703623#comment-15703623 ] Jian He commented on YARN-5559: --- [~ajisakaa], wangda is off for a while. would you like to update the patch

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703346#comment-15703346 ] Jian He commented on YARN-4126: --- Below is the original code, the logic is also bizarre: what's the point of

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703305#comment-15703305 ] Jian He commented on YARN-5910: --- To summarize, ideally, the token should be self-sufficient to discover the

[jira] [Commented] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703205#comment-15703205 ] Jian He commented on YARN-5909: --- Thanks Billie for the review ! - Fixed the typo in WebAppApi - Removed the

[jira] [Assigned] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5909: - Assignee: Jian He > Remove the agent code in slider and upgrade framework jetty version >

[jira] [Updated] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5909: -- Attachment: YARN-5909-yarn-native-services.02.patch > Remove the agent code in slider and upgrade framework

[jira] [Updated] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5909: -- Attachment: (was: YARN-5909-yarn-native-services.02.patch) > Remove the agent code in slider and upgrade

[jira] [Updated] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5909: -- Attachment: YARN-5909-yarn-native-services.02.patch > Remove the agent code in slider and upgrade framework

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700221#comment-15700221 ] Jian He commented on YARN-5910: --- bq. dtutil alias might even fix at least token renewal for the HA case.

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700081#comment-15700081 ] Jian He commented on YARN-5910: --- Hence, the "hadoop dtutil" cannot solve this problem then ? we need a

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692464#comment-15692464 ] Jian He commented on YARN-4206: --- +1 > Add life time value in Application report and CLI >

[jira] [Commented] (YARN-5649) Add REST endpoints for updating application timeouts

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692445#comment-15692445 ] Jian He commented on YARN-5649: --- the branch-2 patch looks good to me. > Add REST endpoints for updating

[jira] [Commented] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691692#comment-15691692 ] Jian He commented on YARN-5909: --- This patch removed all the agent related code in slider AM, also changed the

[jira] [Updated] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5909: -- Attachment: YARN-5909-yarn-native-services.01.patch > Remove the agent code in slider and upgrade framework

[jira] [Updated] (YARN-5909) Remove the agent code in slider and upgrade framework jetty version

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5909: -- Summary: Remove the agent code in slider and upgrade framework jetty version (was: Upgrade framework jetty

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691535#comment-15691535 ] Jian He commented on YARN-4206: --- would a single option -updateLifetime be simper ? having one more option

[jira] [Commented] (YARN-5649) Add REST endpoints for updating application timeouts

2016-11-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691478#comment-15691478 ] Jian He commented on YARN-5649: --- looks good, committing > Add REST endpoints for updating application

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688768#comment-15688768 ] Jian He commented on YARN-5910: --- bq. The service field is effectively the URL to use to renew and kind

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688526#comment-15688526 ] Jian He commented on YARN-5910: --- I see. But I think the problem here is not about gathering the tokens on job

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688123#comment-15688123 ] Jian He commented on YARN-5910: --- [~aw], I think the problem here is that RM cannot renew the delegation

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687912#comment-15687912 ] Jian He commented on YARN-4206: --- UT failed, [~rohithsharma], could you take a look ? > Add life time value

[jira] [Commented] (YARN-5649) Add REST endpoints for updating application timeouts

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687664#comment-15687664 ] Jian He commented on YARN-5649: --- I see, thanks. then this patch is good to go > Add REST endpoints for

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687648#comment-15687648 ] Jian He commented on YARN-4206: --- +1 > Add life time value in Application report and CLI >

[jira] [Commented] (YARN-5649) Add REST endpoints for updating application timeouts

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687626#comment-15687626 ] Jian He commented on YARN-5649: --- [~rohithsharma], the failed ut seems related, can you check? > Add REST

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687569#comment-15687569 ] Jian He commented on YARN-5292: --- May be I used the wrong word. The need was to stop/start the container

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685049#comment-15685049 ] Jian He commented on YARN-4206: --- minor comment on the logging {code} sysout.println("Updating timeout of an

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684963#comment-15684963 ] Jian He commented on YARN-5292: --- bq. Since if I understand correctly, for yarn native services, there is a

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684826#comment-15684826 ] Jian He commented on YARN-5694: --- bq. (Currently, it's only started with manual failover, which doesn't make

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684826#comment-15684826 ] Jian He edited comment on YARN-5694 at 11/21/16 9:45 PM: - bq. (Currently, it's only

[jira] [Comment Edited] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675011#comment-15675011 ] Jian He edited comment on YARN-4206 at 11/18/16 3:07 AM: - looks good overall

[jira] [Commented] (YARN-4770) Auto-restart of containers should work across NM restarts.

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675321#comment-15675321 ] Jian He commented on YARN-4770: --- [~hex108], bq. If container crashed during the NM reboot, container would

[jira] [Created] (YARN-5909) Upgrade framework jetty version

2016-11-17 Thread Jian He (JIRA)
Jian He created YARN-5909: - Summary: Upgrade framework jetty version Key: YARN-5909 URL: https://issues.apache.org/jira/browse/YARN-5909 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15675011#comment-15675011 ] Jian He commented on YARN-4206: --- looks good overall ,thanks Rohith, few comments - what is this code for, we

<    5   6   7   8   9   10   11   12   13   14   >