[jira] [Commented] (YARN-7555) Support multiple resource types in YARN native services

2017-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282624#comment-16282624 ] Jian He commented on YARN-7555: --- could you also add API documentation in the YarnServiceAPI.m

[jira] [Commented] (YARN-7555) Support multiple resource types in YARN native services

2017-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16282603#comment-16282603 ] Jian He commented on YARN-7555: --- - In component: serviceResource -> compResource - The name f

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277621#comment-16277621 ] Jian He commented on YARN-6669: --- Thanks Eric ! > Support security for YARN service framework

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16277357#comment-16277357 ] Jian He commented on YARN-6669: --- I opened YARN-7606 for followup work > Support security for

[jira] [Updated] (YARN-7606) Ensure long running service AM works in secure cluster

2017-12-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7606: -- Description: 1) Ensure kerberos ticket is renewed every 24 hours 2) It can localize new jars after 24 hours or 7

[jira] [Updated] (YARN-7606) Ensure long running service AM works in secure cluster

2017-12-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7606: -- Description: 1) Ensure kerberos ticket is renewed every 24 hours 2) YARN can localize new jars after 24 hours or

[jira] [Created] (YARN-7606) Ensure long running service AM works in secure cluster

2017-12-04 Thread Jian He (JIRA)
Jian He created YARN-7606: - Summary: Ensure long running service AM works in secure cluster Key: YARN-7606 URL: https://issues.apache.org/jira/browse/YARN-7606 Project: Hadoop YARN Issue Type: Sub-t

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.12.patch > Support security for YARN service framework > --

[jira] [Comment Edited] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275442#comment-16275442 ] Jian He edited comment on YARN-6669 at 12/2/17 6:36 AM: Thanks Eric

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.11.patch > Support security for YARN service framework > --

[jira] [Comment Edited] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275442#comment-16275442 ] Jian He edited comment on YARN-6669 at 12/2/17 6:30 AM: Thanks Eric

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16275442#comment-16275442 ] Jian He commented on YARN-6669: --- Thanks Eric for help debugging. You are right, it is because

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: (was: YARN-6669.11.patch) > Support security for YARN service framework > ---

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.11.patch > Support security for YARN service framework > --

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16271625#comment-16271625 ] Jian He commented on YARN-7565: --- - onContainersFromPreviousAttempts -> onContainersReceivedF

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.10.patch > Support security for YARN service framework > --

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.09.patch > Support security for YARN service framework > --

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: (was: YARN-6669.08.patch) > Support security for YARN service framework > ---

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.08.patch > Support security for YARN service framework > --

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16269739#comment-16269739 ] Jian He commented on YARN-6669: --- Fixed an issue in the KerberosPrincipal object > Support se

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.08.patch > Support security for YARN service framework > --

[jira] [Created] (YARN-7572) Make the service status output more readable

2017-11-27 Thread Jian He (JIRA)
Jian He created YARN-7572: - Summary: Make the service status output more readable Key: YARN-7572 URL: https://issues.apache.org/jira/browse/YARN-7572 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.07.patch fixed some check style issues, and made client to throw explicit exception if it

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: (was: YARN-6669.07.patch) > Support security for YARN service framework > ---

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.07.patch > Support security for YARN service framework > --

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16267181#comment-16267181 ] Jian He commented on YARN-6168: --- I committed this into trunk. Thanks [~csingh] ! > Restarted

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Description: Changes include: - Make registry client to programmatically generate the jaas conf for secure acce

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.06.patch fixed the findbugs warning > Support security for YARN service framework > --

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Description: Changes include: - Make registry client to programmatically generate the jaas conf for secure acce

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.05.patch Added the security implementation between client and AM, client and AM uses kerbe

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16261552#comment-16261552 ] Jian He commented on YARN-6168: --- A minor optimization for pullPreviousAttemptContainers : we

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.04.patch The new patch added some docs for the keytab related properties > Support securit

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.03.patch Removed the RMRegistryOperationsService class and its associated UT, as this clas

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259960#comment-16259960 ] Jian He commented on YARN-6168: --- could you also add more detailed comments in AllocateRespon

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259957#comment-16259957 ] Jian He commented on YARN-6168: --- - AllocateResponsePBImpl#mergeLocalToBuilder needs some chan

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.02.patch Fixed the UT failures > Support security for YARN service framework > --

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259736#comment-16259736 ] Jian He commented on YARN-6669: --- I also tested above changes in a secure cluster > Support s

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Description: Changes include: - Make registry client to programmatically generate the jaas conf for secure acce

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Summary: Support security for YARN service framework (was: Kerberos support for native service AM with the servi

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Description: Changes include: - Make registry client to programmatically generate the jaas conf for secure acce

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.01.patch > Kerberos support for native service AM with the service REST API > -

[jira] [Commented] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16259732#comment-16259732 ] Jian He commented on YARN-6669: --- Changes include: - YARN-7517. Make registry client to progra

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: (was: YARN-6669.01.patch) > Kerberos support for native service AM with the service REST API > --

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-11-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.01.patch > Kerberos support for native service AM with the service REST API > -

[jira] [Created] (YARN-7526) Add --debug option for yarn service framework

2017-11-16 Thread Jian He (JIRA)
Jian He created YARN-7526: - Summary: Add --debug option for yarn service framework Key: YARN-7526 URL: https://issues.apache.org/jira/browse/YARN-7526 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254806#comment-16254806 ] Jian He commented on YARN-7218: --- Got a question, is YARN-7505 related to this ? > ApiServer

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254512#comment-16254512 ] Jian He commented on YARN-7503: --- The patch looks good to me. "yarn.service.java.opts", how a

[jira] [Commented] (YARN-7503) Configurable heap size / JVM opts in service AM

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254511#comment-16254511 ] Jian He commented on YARN-7503: --- Thanks Jonathan, bq. This is just parsed on the AM. For the

[jira] [Commented] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254173#comment-16254173 ] Jian He commented on YARN-7486: --- Thanks for changing the patch, I agree, opened YARN-7504 for

[jira] [Created] (YARN-7504) Separate log file for service rest API

2017-11-15 Thread Jian He (JIRA)
Jian He created YARN-7504: - Summary: Separate log file for service rest API Key: YARN-7504 URL: https://issues.apache.org/jira/browse/YARN-7504 Project: Hadoop YARN Issue Type: Sub-task R

[jira] [Commented] (YARN-6903) Yarn-native-service framework core rewrite

2017-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16254015#comment-16254015 ] Jian He commented on YARN-6903: --- I'm working on other items now. Sure, please go ahead. Than

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Description: 1. container1 completed for instance1 2. instance1 is added to pending list, and send an event async

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Attachment: YARN-7486.01.patch > Race condition in service AM that can cause NPE > --

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Attachment: (was: YARN-7486.01.patch) > Race condition in service AM that can cause NPE > ---

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Attachment: YARN-7486.01.patch > Race condition in service AM that can cause NPE > --

[jira] [Commented] (YARN-7490) ConcurrentModificationException in AMRMClient

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250808#comment-16250808 ] Jian He commented on YARN-7490: --- [~leftnoteasy], [~subru], [~asuresh]. should AMRMClient han

[jira] [Created] (YARN-7490) ConcurrentModificationException in AMRMClient

2017-11-13 Thread Jian He (JIRA)
Jian He created YARN-7490: - Summary: ConcurrentModificationException in AMRMClient Key: YARN-7490 URL: https://issues.apache.org/jira/browse/YARN-7490 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Description: 1. container1 completed for instance1 2. instance1 is added to pending list 3. container2 allocated,

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Issue Type: Sub-task (was: Bug) Parent: YARN-7054 > Race condition in service AM that can cause NPE > --

[jira] [Updated] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7486: -- Description: 1. container1 completed for instance1 2. instance1 is added to pending list 3. container2 allocated,

[jira] [Assigned] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-7486: - Assignee: Jian He > Race condition in service AM that can cause NPE >

[jira] [Created] (YARN-7486) Race condition in service AM that can cause NPE

2017-11-13 Thread Jian He (JIRA)
Jian He created YARN-7486: - Summary: Race condition in service AM that can cause NPE Key: YARN-7486 URL: https://issues.apache.org/jira/browse/YARN-7486 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7050) Post cleanup after YARN-6903, removal of org.apache.slider package

2017-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16248336#comment-16248336 ] Jian He commented on YARN-7050: --- Are you running in a secure env ? Since it's a long running

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16247930#comment-16247930 ] Jian He commented on YARN-7218: --- Thanks Eric, I vote for changing the prefix to " /app/v1/ser

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16246329#comment-16246329 ] Jian He commented on YARN-7466: --- lgtm, committing soon > ResourceRequest has a different def

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16244988#comment-16244988 ] Jian He commented on YARN-7466: --- [~leftnoteasy], [~subru], opinion on this ? we should make i

[jira] [Comment Edited] (YARN-7447) Fix a couple of issues in services REST API

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241528#comment-16241528 ] Jian He edited comment on YARN-7447 at 11/7/17 5:51 AM: a minor com

[jira] [Commented] (YARN-7447) Fix a couple of issues in services REST API

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16241528#comment-16241528 ] Jian He commented on YARN-7447: --- a minor comment, we my use "YarnJacksonJaxbJsonProvider.clas

[jira] [Resolved] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-4793. --- Resolution: Fixed > [Umbrella] Simplified API layer for services and beyond > -

[jira] [Updated] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4793: -- Fix Version/s: 3.1.0 > [Umbrella] Simplified API layer for services and beyond >

[jira] [Updated] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4793: -- Affects Version/s: 3.1.0 Release Note: A REST API service is implemented to enable users to launch and m

[jira] [Issue Comment Deleted] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4692: -- Comment: was deleted (was: Branch is merged to trunk, resolve this) > [Umbrella] Simplified and first-class supp

[jira] [Reopened] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reopened YARN-4692: --- > [Umbrella] Simplified and first-class support for services in YARN >

[jira] [Updated] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4692: -- Release Note: (was: A REST API service is implemented to enable users to launch and manage container based serv

[jira] [Updated] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4692: -- Target Version/s: (was: 3.1.0) Fix Version/s: (was: 3.1.0) > [Umbrella] Simplified and first-class s

[jira] [Resolved] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-4692. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0 Release Note: A REST

[jira] [Updated] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5079: -- Release Note: A framework is implemented to orchestrate containers on YARN > [Umbrella] Native YARN framework lay

[jira] [Resolved] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-5079. --- Resolution: Fixed Fix Version/s: 3.1.0 Target Version/s: 3.1.0 Branch is merged to trunk, reso

[jira] [Updated] (YARN-7127) Merge yarn-native-service branch into trunk

2017-11-06 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7127: -- Attachment: YARN-7127.07.patch > Merge yarn-native-service branch into trunk > --

[jira] [Resolved] (YARN-7441) Support placement policy in yarn service

2017-11-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-7441. --- Resolution: Duplicate dup of YARN-7142 > Support placement policy in yarn service > --

[jira] [Updated] (YARN-7371) Added allocateRequestId in NMContainerStatus for recovery

2017-11-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7371: -- Summary: Added allocateRequestId in NMContainerStatus for recovery (was: NPE in ServiceMaster after RM is resta

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16239141#comment-16239141 ] Jian He commented on YARN-7371: --- failed test not related, will commit > NPE in ServiceMaster

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.03.patch > Improve service client loggings > -

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: (was: YARN-7423.yarn-native-services.03.patch) > Improve service client loggings > --

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.03.patch > Improve service client loggings > -

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238508#comment-16238508 ] Jian He commented on YARN-7371: --- lgtm, will commit after jenkins reports > NPE in ServiceMas

[jira] [Commented] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238459#comment-16238459 ] Jian He commented on YARN-7423: --- Thanks Billie, bq. You could move the log statement to cre

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.02.patch > Improve service client loggings > -

[jira] [Updated] (YARN-7441) Support placement policy in yarn service

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7441: -- Description: YARN-6592 added support for more riched placement policies, yarn service framework can take advantag

[jira] [Created] (YARN-7441) Support placement policy in yarn service

2017-11-03 Thread Jian He (JIRA)
Jian He created YARN-7441: - Summary: Support placement policy in yarn service Key: YARN-7441 URL: https://issues.apache.org/jira/browse/YARN-7441 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.01.patch Renamed SliderUtils to to ServiceUtils, And fixed some loggin

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16238301#comment-16238301 ] Jian He commented on YARN-6394: --- bq. so for log include pattern (not rolling), are we expect

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.07.patch > Support specifying YARN related params in the service REST

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: (was: YARN-6394.yarn-native-services.07.patch) > Support specifying YARN related params in the se

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.07.patch renamed the props to properties in some places missed > Supp

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.06.patch Uploaded a new patch which adds support for user to be able t

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16236524#comment-16236524 ] Jian He commented on YARN-7371: --- there are some flaky tests, most of the time, if it can pass

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16236488#comment-16236488 ] Jian He commented on YARN-7371: --- Patch looks good to me overall, some comments: - This method

[jira] [Commented] (YARN-7396) NPE when accessing container logs due to null dirsHandler

2017-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234991#comment-16234991 ] Jian He commented on YARN-7396: --- Ran into the same problem, lgtm, committing > NPE when acce

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16234879#comment-16234879 ] Jian He commented on YARN-6394: --- - Fixed something related to updating the comp instance stat

<    1   2   3   4   5   6   7   8   9   10   >