[jira] [Created] (YARN-5426) Enable distributed shell to launch docker containers

2016-07-24 Thread Jian He (JIRA)
Jian He created YARN-5426: - Summary: Enable distributed shell to launch docker containers Key: YARN-5426 URL: https://issues.apache.org/jira/browse/YARN-5426 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5426) Enable distributed shell to launch docker containers

2016-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15391392#comment-15391392 ] Jian He commented on YARN-5426: --- Yeah, specifying those params is inconvenient. Also, those p

[jira] [Updated] (YARN-5426) Enable distributed shell to launch docker containers

2016-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5426: -- Description: This could be the easiest way to bring up docker containers on YARN. It's also very useful for test

[jira] [Updated] (YARN-5426) Enable distributed shell to launch docker containers

2016-07-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5426: -- Description: This could be the easiest way to bring up docker containers on YARN. An option like -docker , or wi

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-07-25 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393292#comment-15393292 ] Jian He commented on YARN-5333: --- I prefer doing initialization of services before starting it

[jira] [Created] (YARN-5430) Get docker container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
Jian He created YARN-5430: - Summary: Get docker container's ip and host from NM Key: YARN-5430 URL: https://issues.apache.org/jira/browse/YARN-5430 Project: Hadoop YARN Issue Type: Bug Re

[jira] [Assigned] (YARN-5430) Get docker container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5430: - Assignee: Jian He > Get docker container's ip and host from NM > -

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Summary: Get container's ip and host from NM (was: Get docker container's ip and host from NM) > Get container'

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Description: In YARN-4757, we introduced a DNS mechanism for containers. That's based on the assumption that we

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.1.patch What the patch does: - For docker container: container-executable runs the docker i

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.2.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.2.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.1.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-07-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.1.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5443) Add support for docker inspect

2016-07-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399008#comment-15399008 ] Jian He commented on YARN-5443: --- [~shaneku...@gmail.com], I think container-executor.c#run_do

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403414#comment-15403414 ] Jian He commented on YARN-5382: --- With this patch, looks like killing a normal running app wil

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403439#comment-15403439 ] Jian He commented on YARN-5333: --- Instead of reusing the existing refreshAll method, I checked

[jira] [Commented] (YARN-5406) In-memory based implementation of the FederationMembershipStateStore

2016-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403473#comment-15403473 ] Jian He commented on YARN-5406: --- lgtm, not related to this patch. I think mentioning the defa

[jira] [Commented] (YARN-5406) In-memory based implementation of the FederationMembershipStateStore

2016-08-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15403480#comment-15403480 ] Jian He commented on YARN-5406: --- Also, should the .impl package be under the .store package ?

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.2.patch > Get container's ip and host from NM > --- > >

[jira] [Created] (YARN-5461) Port initial slider-core module code into yarn

2016-08-02 Thread Jian He (JIRA)
Jian He created YARN-5461: - Summary: Port initial slider-core module code into yarn Key: YARN-5461 URL: https://issues.apache.org/jira/browse/YARN-5461 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405321#comment-15405321 ] Jian He commented on YARN-5382: --- bq. I see only one audit log message when I ran a sleep job

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.3.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405478#comment-15405478 ] Jian He commented on YARN-5333: --- Not related to this patch, I noticed that, if anything fails

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405539#comment-15405539 ] Jian He commented on YARN-5333: --- bq. then call rm.handleTransitionToStandBy. I think the Acti

[jira] [Commented] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2016-08-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407057#comment-15407057 ] Jian He commented on YARN-5079: --- Hi [~asuresh], Short answer is, agent in Slider will be thro

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407363#comment-15407363 ] Jian He commented on YARN-5333: --- I see, I think this makes sense. Otherwise, RM will continuo

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.4.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408798#comment-15408798 ] Jian He commented on YARN-5430: --- bq. Similarly we should change getIpAndHost and split them

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408799#comment-15408799 ] Jian He commented on YARN-5430: --- Thanks for the review, Varun ! fixed other comments, uploade

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.4.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.4.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409011#comment-15409011 ] Jian He commented on YARN-5382: --- [~vrushalic], looks like you reformatted the whole RMAppImpl

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409577#comment-15409577 ] Jian He commented on YARN-5333: --- Im fine with that, thx > Some recovered apps are put into d

[jira] [Commented] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15409576#comment-15409576 ] Jian He commented on YARN-5333: --- Im fine with that, thx > Some recovered apps are put into d

[jira] [Issue Comment Deleted] (YARN-5333) Some recovered apps are put into default queue when RM HA

2016-08-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5333: -- Comment: was deleted (was: Im fine with that, thx) > Some recovered apps are put into default queue when RM HA >

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411191#comment-15411191 ] Jian He commented on YARN-5382: --- lgtm, [~jlowe], would you like to check? > RM does not aud

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.4.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: (was: YARN-5430.4.patch) > Get container's ip and host from NM >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.5.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5382) RM does not audit log kill request for active applications

2016-08-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412869#comment-15412869 ] Jian He commented on YARN-5382: --- ah, I missed it.. thanks for catching this ! > RM does not

[jira] [Commented] (YARN-5407) In-memory based implementation of the FederationApplicationStateStore, FederationPolicyStateStore

2016-08-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413102#comment-15413102 ] Jian He commented on YARN-5407: --- lgtm > In-memory based implementation of the FederationAppl

[jira] [Commented] (YARN-5483) Optimize RMAppAttempt#pullJustFinishedContainers

2016-08-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413113#comment-15413113 ] Jian He commented on YARN-5483: --- thanks for the catch ! A minor typo in the existing code, '

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.6.patch > Get container's ip and host from NM > --- > >

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414808#comment-15414808 ] Jian He commented on YARN-5430: --- Varun, thanks for the review. I uploaded a new one. > Get c

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.7.patch > Get container's ip and host from NM > --- > >

[jira] [Updated] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5430: -- Attachment: YARN-5430.8.patch Fixing checkstyles > Get container's ip and host from NM > --

[jira] [Commented] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416492#comment-15416492 ] Jian He commented on YARN-4833: --- lgtm too, thanks > For Queue AccessControlException client

[jira] [Commented] (YARN-5430) Get container's ip and host from NM

2016-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416566#comment-15416566 ] Jian He commented on YARN-5430: --- The remaining warnings are not related to this patch. > Get

[jira] [Created] (YARN-5809) AsyncDispatcher possibly invokes multiple shutdown thread when handling exception

2016-10-31 Thread Jian He (JIRA)
Jian He created YARN-5809: - Summary: AsyncDispatcher possibly invokes multiple shutdown thread when handling exception Key: YARN-5809 URL: https://issues.apache.org/jira/browse/YARN-5809 Project: Hadoop YARN

[jira] [Updated] (YARN-5809) AsyncDispatcher possibly invokes multiple shutdown thread when handling exception

2016-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5809: -- Attachment: YARN-5809.1.patch > AsyncDispatcher possibly invokes multiple shutdown thread when handling > except

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623498#comment-15623498 ] Jian He commented on YARN-5611: --- - What is the reason to involve RMAppImpl state-machine to u

[jira] [Commented] (YARN-5809) AsyncDispatcher possibly invokes multiple shutdown thread when handling exception

2016-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623807#comment-15623807 ] Jian He commented on YARN-5809: --- [~varun_saxena], thanks for the review and commit ! > Async

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-10-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15623825#comment-15623825 ] Jian He commented on YARN-4597: --- Few more comments - maybe rename ContainerScheduler#running

[jira] [Commented] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2016-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626511#comment-15626511 ] Jian He commented on YARN-5762: --- [~raviprak], instead of ignoring the exception at server, I

[jira] [Commented] (YARN-2009) CapacityScheduler: Add intra-queue preemption for app priority support

2016-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626578#comment-15626578 ] Jian He commented on YARN-2009: --- One question, not sure if this is expected. This code synch

[jira] [Assigned] (YARN-5813) Slider should not try to set a negative lifetime timeout value

2016-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5813: - Assignee: Jian He > Slider should not try to set a negative lifetime timeout value > -

[jira] [Updated] (YARN-5813) Slider should not try to set a negative lifetime timeout value

2016-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5813: -- Attachment: (was: YARN-5813.1.patch) > Slider should not try to set a negative lifetime timeout value > -

[jira] [Updated] (YARN-5813) Slider should not try to set a negative lifetime timeout value

2016-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5813: -- Attachment: YARN-5813.1.patch upload a patch > Slider should not try to set a negative lifetime timeout value >

[jira] [Updated] (YARN-5813) Slider should not try to set a negative lifetime timeout value

2016-11-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5813: -- Attachment: YARN-5813-yarn-native-services.001.patch > Slider should not try to set a negative lifetime timeout v

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629737#comment-15629737 ] Jian He commented on YARN-5694: --- sorry, I don't quite get it. why is the active thread needed

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15629737#comment-15629737 ] Jian He edited comment on YARN-5694 at 11/2/16 5:32 PM: sorry, I do

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-11-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15630958#comment-15630958 ] Jian He commented on YARN-5611: --- - can you add comments about the type of the timeout value ?

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-11-04 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15638126#comment-15638126 ] Jian He commented on YARN-5611: --- Currently, the patch is taking a lock on the applicationId w

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-11-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15640617#comment-15640617 ] Jian He commented on YARN-5716: --- we'll commit this soon, if no further comments > Add global

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645979#comment-15645979 ] Jian He commented on YARN-4597: --- bq. scheduledToRunContainers sounds good bq. Using shouldL

[jira] [Created] (YARN-5852) Consolidate CSAssignment, ContainerAllocation, ContainerAllocationContext class in CapacityScheduler

2016-11-07 Thread Jian He (JIRA)
Jian He created YARN-5852: - Summary: Consolidate CSAssignment, ContainerAllocation, ContainerAllocationContext class in CapacityScheduler Key: YARN-5852 URL: https://issues.apache.org/jira/browse/YARN-5852 Pr

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15646047#comment-15646047 ] Jian He commented on YARN-5694: --- One other thing is the normal state-store operation already

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15648821#comment-15648821 ] Jian He commented on YARN-4597: --- bq. I tried to reuse shouldLaunchContainer for the killedBef

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649082#comment-15649082 ] Jian He commented on YARN-4597: --- I see.. thanks for looking into it.. I guess the killedBefor

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15649229#comment-15649229 ] Jian He commented on YARN-4597: --- I see, sounds reasonable. bq. I feel a better name for 'sho

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652237#comment-15652237 ] Jian He commented on YARN-4597: --- the patch looks good to me, is [~kkaranasos] going to take a

[jira] [Commented] (YARN-5611) Provide an API to update lifetime of an application.

2016-11-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652550#comment-15652550 ] Jian He commented on YARN-5611: --- Committed to trunk, branch-2, thanks Rohith ! Thanks Sunil f

[jira] [Commented] (YARN-3955) Support for priority ACLs in CapacityScheduler

2016-11-09 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15652791#comment-15652791 ] Jian He commented on YARN-3955: --- thanks Sunil, some comments for the patch: - PriorityACLCon

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654697#comment-15654697 ] Jian He commented on YARN-5694: --- bq. If we agree that it's bad to have two RMs accidentally s

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15654697#comment-15654697 ] Jian He edited comment on YARN-5694 at 11/10/16 6:09 PM: - bq. If we

[jira] [Commented] (YARN-4206) Add life time value in Application report and web UI

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655155#comment-15655155 ] Jian He commented on YARN-4206: --- The remaining time can be inferred from the absolute timeout

[jira] [Commented] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2016-11-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15655310#comment-15655310 ] Jian He commented on YARN-5825: --- looks good overall, looks like this method added is not use

[jira] [Commented] (YARN-5865) Retrospect updateApplicationPriority api to handle state store exception in align with YARN-5611

2016-11-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658396#comment-15658396 ] Jian He commented on YARN-5865: --- thanks Sunil, one comment: we should make sure update in sto

[jira] [Commented] (YARN-5825) ProportionalPreemptionalPolicy could use readLock over LeafQueue instead of synchronized block

2016-11-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658406#comment-15658406 ] Jian He commented on YARN-5825: --- lgtm , committing > ProportionalPreemptionalPolicy could us

[jira] [Commented] (YARN-5762) Summarize ApplicationNotFoundException in the RM log

2016-11-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658453#comment-15658453 ] Jian He commented on YARN-5762: --- It does have an API which is getApplications, does that work

[jira] [Assigned] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5870: - Assignee: Jian He > Expose getApplications API in YarnClient with GetApplicationsRequest parameter > -

[jira] [Updated] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5870: -- Attachment: YARN-5870.patch > Expose getApplications API in YarnClient with GetApplicationsRequest parameter > --

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-11-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665729#comment-15665729 ] Jian He commented on YARN-4126: --- [~daryn], what's your suggestion to my last question ? Reve

[jira] [Assigned] (YARN-5769) Integrate update app lifetime using feature implemented in YARN-5611

2016-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-5769: - Assignee: Jian He > Integrate update app lifetime using feature implemented in YARN-5611 > ---

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15668020#comment-15668020 ] Jian He commented on YARN-5870: --- Good catch, Rohith ! I updated the patch to fix that. > E

[jira] [Updated] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5870: -- Attachment: YARN-5870.1.patch > Expose getApplications API in YarnClient with GetApplicationsRequest parameter >

[jira] [Updated] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5870: -- Attachment: YARN-5870.2.patch > Expose getApplications API in YarnClient with GetApplicationsRequest parameter >

[jira] [Commented] (YARN-5870) Expose getApplications API in YarnClient with GetApplicationsRequest parameter

2016-11-16 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15671379#comment-15671379 ] Jian He commented on YARN-5870: --- The javadoc complains exception no description, but all othe

[jira] [Comment Edited] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675011#comment-15675011 ] Jian He edited comment on YARN-4206 at 11/17/16 10:35 PM: -- looks g

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675011#comment-15675011 ] Jian He commented on YARN-4206: --- looks good overall ,thanks Rohith, few comments - what is th

[jira] [Created] (YARN-5909) Upgrade framework jetty version

2016-11-17 Thread Jian He (JIRA)
Jian He created YARN-5909: - Summary: Upgrade framework jetty version Key: YARN-5909 URL: https://issues.apache.org/jira/browse/YARN-5909 Project: Hadoop YARN Issue Type: Sub-task Reporte

[jira] [Commented] (YARN-4770) Auto-restart of containers should work across NM restarts.

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675321#comment-15675321 ] Jian He commented on YARN-4770: --- [~hex108], bq. If container crashed during the NM reboot, co

[jira] [Comment Edited] (YARN-4206) Add life time value in Application report and CLI

2016-11-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15675011#comment-15675011 ] Jian He edited comment on YARN-4206 at 11/18/16 3:07 AM: - looks goo

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684826#comment-15684826 ] Jian He commented on YARN-5694: --- bq. (Currently, it's only started with manual failover, whic

[jira] [Comment Edited] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684826#comment-15684826 ] Jian He edited comment on YARN-5694 at 11/21/16 9:45 PM: - bq. (Curr

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15684963#comment-15684963 ] Jian He commented on YARN-5292: --- bq. Since if I understand correctly, for yarn native service

[jira] [Commented] (YARN-4206) Add life time value in Application report and CLI

2016-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15685049#comment-15685049 ] Jian He commented on YARN-4206: --- minor comment on the logging {code} sysout.println("Updatin

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687569#comment-15687569 ] Jian He commented on YARN-5292: --- May be I used the wrong word. The need was to stop/start the

[jira] [Commented] (YARN-5649) Add REST endpoints for updating application timeouts

2016-11-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15687626#comment-15687626 ] Jian He commented on YARN-5649: --- [~rohithsharma], the failed ut seems related, can you check?

<    1   2   3   4   5   6   7   8   9   10   >