[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523568#comment-15523568 ] Jian He commented on YARN-5620: --- In that case, IIUC, if a LocalizedResource is referenced by both v1 and v3.

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523904#comment-15523904 ] Li Lu commented on YARN-5585: - Hi [~rohithsharma], some of my understandings bq. IIUC from user perspective,

[jira] [Commented] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523720#comment-15523720 ] Naganarasimha G R commented on YARN-5660: - Thanks [~rohithsharma] for the latest patch, +1 LGTM,

[jira] [Commented] (YARN-4855) Should check if node exists when replace nodelabels

2016-09-26 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523732#comment-15523732 ] Naganarasimha G R commented on YARN-4855: - Thanks for your copinion [~sunilg], but further to this

[jira] [Updated] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-09-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-5325: --- Attachment: YARN-5325-YARN-2915.06.patch > Stateless ARMRMProxy policies implementation >

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523455#comment-15523455 ] Hudson commented on YARN-5609: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10488 (See

[jira] [Assigned] (YARN-5675) Checkin swagger definition in the repo

2016-09-26 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-5675: --- Assignee: Gour Saha > Checkin swagger definition in the repo > --

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523300#comment-15523300 ] Hudson commented on YARN-5609: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #10487 (See

[jira] [Updated] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5660: Attachment: YARN-5660.1.patch There were more APIs had similar issue. I fixed all of them by

[jira] [Comment Edited] (YARN-5672) FairScheduler: wrong queue name in log when adding application

2016-09-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523597#comment-15523597 ] Daniel Templeton edited comment on YARN-5672 at 9/26/16 4:56 PM: - +1

[jira] [Commented] (YARN-5610) Initial code for native services REST API

2016-09-26 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523560#comment-15523560 ] Gour Saha commented on YARN-5610: - [~jianhe] addressing the second set of comments/feedback. Will upload

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2016-09-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523561#comment-15523561 ] Daniel Templeton commented on YARN-5673: +1 The current state of things has pushed the majority of

[jira] [Commented] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523659#comment-15523659 ] Sunil G commented on YARN-5660: --- Thanks [~rohithsharma] for the patch. Generally looks fine. > Wrong audit

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523538#comment-15523538 ] Arun Suresh commented on YARN-5620: --- I agree.. but what if the resourcesets for v2 and v3 are only

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523284#comment-15523284 ] Arun Suresh commented on YARN-5609: --- Thanks for the reviews and the commit [~jianhe] > Expose upgrade

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523515#comment-15523515 ] Jian He commented on YARN-5620: --- [~asuresh], I think we need one more jira to release the older than previous

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523668#comment-15523668 ] Wangda Tan commented on YARN-5145: -- Thanks for sharing your thoughts, [~Sreenath], [~sunilg],

[jira] [Created] (YARN-5675) Checkin swagger definition in the repo

2016-09-26 Thread Gour Saha (JIRA)
Gour Saha created YARN-5675: --- Summary: Checkin swagger definition in the repo Key: YARN-5675 URL: https://issues.apache.org/jira/browse/YARN-5675 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5430) Return container's ip and host from NM ContainerStatus call

2016-09-26 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523551#comment-15523551 ] Gour Saha commented on YARN-5430: - [~jianhe] can this return the docker image name used to create a

[jira] [Commented] (YARN-5672) FairScheduler: wrong queue name in log when adding application

2016-09-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523597#comment-15523597 ] Daniel Templeton commented on YARN-5672: +1 (non-binding). Thanks for the patch, [~wilfreds].

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523620#comment-15523620 ] Arun Suresh commented on YARN-5620: --- Aah.. got it, since {{LocalizedResource#ref}} is a Queue and not a

[jira] [Commented] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-09-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523418#comment-15523418 ] Sangjin Lee commented on YARN-5667: --- In principle, no. You'll find that we've already isolated the hbase

[jira] [Created] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-09-26 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-5676: -- Summary: Add a HashBasedRouterPolicy, that routes jobs based on queue name hash. Key: YARN-5676 URL: https://issues.apache.org/jira/browse/YARN-5676 Project: Hadoop YARN

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523993#comment-15523993 ] Wangda Tan commented on YARN-3139: -- Test failure is not related. > Improve locks in

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524011#comment-15524011 ] Varun Saxena commented on YARN-5585: Just to add, bq. And after providing entityPrefixId , does reader

[jira] [Commented] (YARN-5599) Post AM launcher artifacts to ATS

2016-09-26 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524068#comment-15524068 ] Naganarasimha G R commented on YARN-5599: - Agree to [~templedf]'s comment we are logging the

[jira] [Commented] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-09-26 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524253#comment-15524253 ] Haibo Chen commented on YARN-5667: -- Thanks very much for the explanation [~sjlee0]! Trying to understand

[jira] [Commented] (YARN-5676) Add a HashBasedRouterPolicy, that routes jobs based on queue name hash.

2016-09-26 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523973#comment-15523973 ] Daniel Templeton commented on YARN-5676: What is the use case? > Add a HashBasedRouterPolicy, that

[jira] [Commented] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524048#comment-15524048 ] Hadoop QA commented on YARN-5660: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-09-26 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523953#comment-15523953 ] Carlo Curino commented on YARN-5325: The latest patch has been rebased on YARN-5323/YARN-5324. And

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522428#comment-15522428 ] Hadoop QA commented on YARN-5609: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5668) Support content-type: application/json in RM's /conf endpoint

2016-09-26 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated YARN-5668: - Description: - Right now all requests send to RM's /conf endpoint is responded

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522238#comment-15522238 ] Zhankun Tang edited comment on YARN-4266 at 9/26/16 8:47 AM: - A patch based on

[jira] [Commented] (YARN-5621) Support LinuxContainerExecutor to create symlinks for continuously localized resources

2016-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522339#comment-15522339 ] Jian He commented on YARN-5621: --- I still have hesitation on this approach to spawn an additional process to

[jira] [Created] (YARN-5669) Add support for Docker pull

2016-09-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5669: -- Summary: Add support for Docker pull Key: YARN-5669 URL: https://issues.apache.org/jira/browse/YARN-5669 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5671) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522471#comment-15522471 ] Zhankun Tang commented on YARN-5671: Sorry for the duplicate due to the bad network. Close this. > Add

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.010.patch Uploading patch (v010), which is basically (v008) but slight

[jira] [Commented] (YARN-4855) Should check if node exists when replace nodelabels

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522417#comment-15522417 ] Sunil G commented on YARN-4855: --- To clarify more, i am fine with options like - *-fail-on-unknown-nodes* with

[jira] [Updated] (YARN-5668) content-type: application/json support in RM's /conf endpoint

2016-09-26 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sreenath Somarajapuram updated YARN-5668: - Description: Right now all requests send to RM's /conf endpoint is responded with

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522477#comment-15522477 ] Zhankun Tang commented on YARN-3854: Thanks a lot. Shane. > Add localization support for docker images

[jira] [Commented] (YARN-3854) Add localization support for docker images

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522476#comment-15522476 ] Zhankun Tang commented on YARN-3854: I have created two sub-tasks which is YARN-5669 and YARN-5670.

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522182#comment-15522182 ] Jian He commented on YARN-5315: --- [~sandflee], I think your first patch is fine. In the 2nd patch, calling

[jira] [Created] (YARN-5668) content-type: application/json support in /conf endpoint

2016-09-26 Thread Sreenath Somarajapuram (JIRA)
Sreenath Somarajapuram created YARN-5668: Summary: content-type: application/json support in /conf endpoint Key: YARN-5668 URL: https://issues.apache.org/jira/browse/YARN-5668 Project: Hadoop

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522431#comment-15522431 ] Sunil G commented on YARN-5145: --- Hi All Few thoughts from my side. - I think overall approach is to get the

[jira] [Created] (YARN-5671) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5671: -- Summary: Add support for Docker image clean up Key: YARN-5671 URL: https://issues.apache.org/jira/browse/YARN-5671 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5663) Small refactor in ZKRMStateStore

2016-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522197#comment-15522197 ] Hudson commented on YARN-5663: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10486 (See

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266-branch-2.8.001.patch A patch based on branch-2.8 for your reference. Will add

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522238#comment-15522238 ] Zhankun Tang edited comment on YARN-4266 at 9/26/16 6:51 AM: - A patch based on

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-09-26 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522347#comment-15522347 ] sandflee commented on YARN-5375: I'm ok for both method, any thought? > invoke MockRM#drainEvents

[jira] [Commented] (YARN-5256) Add REST endpoint to support detailed NodeLabel Informations

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522380#comment-15522380 ] Hadoop QA commented on YARN-5256: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-26 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522518#comment-15522518 ] Sreenath Somarajapuram commented on YARN-5145: -- bq. configuration (timeline or others etc)

[jira] [Comment Edited] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522161#comment-15522161 ] Sunil G edited comment on YARN-2009 at 9/26/16 9:19 AM: Thanks [~eepayne] for the

[jira] [Created] (YARN-5677) RM can be in active-active state for an extended period

2016-09-26 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-5677: -- Summary: RM can be in active-active state for an extended period Key: YARN-5677 URL: https://issues.apache.org/jira/browse/YARN-5677 Project: Hadoop YARN

[jira] [Commented] (YARN-5325) Stateless ARMRMProxy policies implementation

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524386#comment-15524386 ] Hadoop QA commented on YARN-5325: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3981) support timeline clients not associated with an application

2016-09-26 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524485#comment-15524485 ] Li Lu commented on YARN-3981: - Continuing this thread. We may want to limit the active connections to the

[jira] [Commented] (YARN-3142) Improve locks in AppSchedulingInfo

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524482#comment-15524482 ] Hadoop QA commented on YARN-3142: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523326#comment-15523326 ] Hadoop QA commented on YARN-5660: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523429#comment-15523429 ] Rohith Sharma K S commented on YARN-5585: - Thanks Varun, I got overall picture of solution. #

[jira] [Created] (YARN-5679) TestAHSWebServices is failing

2016-09-26 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-5679: --- Summary: TestAHSWebServices is failing Key: YARN-5679 URL: https://issues.apache.org/jira/browse/YARN-5679 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5667) Move HBase backend code in ATS v2 into its separate module

2016-09-26 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524746#comment-15524746 ] Sangjin Lee commented on YARN-5667: --- Those are great questions. The diamond dependency (where there are

[jira] [Commented] (YARN-4743) ResourceManager crash because TimSort

2016-09-26 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524820#comment-15524820 ] stefanlee commented on YARN-4743: - thanks [~gzh1992n] ,the patch you fixed is that the exception happended

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522168#comment-15522168 ] Rohith Sharma K S commented on YARN-5561: - bq. Rohith, I think you're saying you are OK without

[jira] [Updated] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-4266: --- Attachment: YARN-4266_Allow_whitelisted_users_to_disable_user_re-mapping_v3.pdf Updated the

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522296#comment-15522296 ] Hadoop QA commented on YARN-5315: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522161#comment-15522161 ] Sunil G commented on YARN-2009: --- Thanks [~eepayne] for the detailed explanation. bq.when it comes time for

[jira] [Updated] (YARN-5256) Add REST endpoint to support detailed NodeLabel Informations

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5256: -- Attachment: YARN-5256.0001.patch Attaching latest patch. > Add REST endpoint to support detailed NodeLabel

[jira] [Resolved] (YARN-5671) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-5671. Resolution: Duplicate > Add support for Docker image clean up >

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522748#comment-15522748 ] Hadoop QA commented on YARN-5609: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-09-26 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-5554: Attachment: YARN-5554.4.patch Sorry for the delayed response, I tried to add a new

[jira] [Updated] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2009: -- Attachment: YARN-2009.0003.patch Attaching new patch with user-limit support. I think

[jira] [Updated] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5660: Attachment: YARN-5660.patch > Wrong audit constants are used in Get/Put of priority in

[jira] [Updated] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5585: Attachment: YARN-5585-workaround.patch > [Atsv2] Add a new filter fromId in REST endpoints >

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523047#comment-15523047 ] Rohith Sharma K S commented on YARN-5585: - Apologized, I was in leave!! Lot more discussions are

[jira] [Created] (YARN-5672) FairScheduler: wrong queue name in log when adding application

2016-09-26 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-5672: --- Summary: FairScheduler: wrong queue name in log when adding application Key: YARN-5672 URL: https://issues.apache.org/jira/browse/YARN-5672 Project:

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523082#comment-15523082 ] Hadoop QA commented on YARN-5280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-09-26 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-5554: Attachment: YARN-5554.5.patch updated patch to fix the checkstyle warnings >

[jira] [Commented] (YARN-5660) Wrong audit constants are used in Get/Put of priority in RMWebService

2016-09-26 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523064#comment-15523064 ] Naganarasimha G R commented on YARN-5660: - Well not sure why for all the REST queries are doing

[jira] [Commented] (YARN-5638) Introduce a collector timestamp to uniquely identify collectors creation order in collector discovery

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522262#comment-15522262 ] Rohith Sharma K S commented on YARN-5638: - bq. Did not quite get the point here... I think we're

[jira] [Commented] (YARN-5315) Standby RM keep sending start am container request to NM

2016-09-26 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522338#comment-15522338 ] sandflee commented on YARN-5315: {quote} shutdownNow : Attempts to stop all actively executing tasks, halts

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-26 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522419#comment-15522419 ] Sreenath Somarajapuram commented on YARN-5145: -- [~leftnoteasy] [~cheersyang] Adding to that,

[jira] [Created] (YARN-5670) Add support for Docker image clean up

2016-09-26 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-5670: -- Summary: Add support for Docker image clean up Key: YARN-5670 URL: https://issues.apache.org/jira/browse/YARN-5670 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-26 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522526#comment-15522526 ] Kai Sasaki commented on YARN-5145: -- Hi [~sunilg]. {quote} I think overall approach is to get the

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522861#comment-15522861 ] Hadoop QA commented on YARN-5554: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5668) Support content-type: application/json in RM's /conf endpoint

2016-09-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522873#comment-15522873 ] Weiwei Yang commented on YARN-5668: --- Hi [~Sreenath] I think this is already resolved in HADOOP-13588, I

[jira] [Commented] (YARN-5145) [YARN-3368] Move new YARN UI configuration to HADOOP_CONF_DIR

2016-09-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15522882#comment-15522882 ] Weiwei Yang commented on YARN-5145: --- Hello [~Sreenath] I think this is already done in HADOOP-13588,

[jira] [Updated] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-09-26 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Phillips updated YARN-5280: Attachment: YARN-5280.002.patch > Allow YARN containers to run with Java Security Manager >

[jira] [Updated] (YARN-5672) FairScheduler: wrong queue name in log when adding application

2016-09-26 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-5672: Attachment: YARN-5672.1.patch > FairScheduler: wrong queue name in log when adding

[jira] [Created] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2016-09-26 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-5673: --- Summary: [Umbrella] Re-write container-executor to improve security, extensibility, and portability Key: YARN-5673 URL: https://issues.apache.org/jira/browse/YARN-5673

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523177#comment-15523177 ] Varun Saxena commented on YARN-5585: bq. When scan is performed on rows, the ResultScanner gives in the

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523179#comment-15523179 ] Varun Saxena commented on YARN-5585: Alternatively, you can change your entity ID in a manner in which

[jira] [Comment Edited] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523177#comment-15523177 ] Varun Saxena edited comment on YARN-5585 at 9/26/16 2:13 PM: - bq. When scan is

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523186#comment-15523186 ] Hadoop QA commented on YARN-5585: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-5678) Misleading log message in FSLeafQueue

2016-09-26 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5678: -- Summary: Misleading log message in FSLeafQueue Key: YARN-5678 URL: https://issues.apache.org/jira/browse/YARN-5678 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5621) Support LinuxContainerExecutor to create symlinks for continuously localized resources

2016-09-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524603#comment-15524603 ] Chris Douglas commented on YARN-5621: - That summary of work seems about right, thanks for putting it

[jira] [Commented] (YARN-5375) invoke MockRM#drainEvents implicitly in MockRM methods to reduce test failures

2016-09-26 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525120#comment-15525120 ] Rohith Sharma K S commented on YARN-5375: - I am +1 for sync-statestore patch. I just went through

[jira] [Commented] (YARN-5677) RM can be in active-active state for an extended period

2016-09-26 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525172#comment-15525172 ] Jian He commented on YARN-5677: --- bq. when the active RM loses contact with the ZK node Definitely, the leader

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

2016-09-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15525174#comment-15525174 ] Wangda Tan commented on YARN-2009: -- Thanks [~sunilg], More comments: 1) Config: General, it's better

[jira] [Comment Edited] (YARN-4743) ResourceManager crash because TimSort

2016-09-26 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524820#comment-15524820 ] stefanlee edited comment on YARN-4743 at 9/27/16 2:27 AM: -- thanks [~gzh1992n] ,the

[jira] [Commented] (YARN-5575) Many classes use bare yarn. properties instead of the defined constants

2016-09-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524872#comment-15524872 ] Miklos Szegedi commented on YARN-5575: -- TestTimelineAuthenticationFilterInitializer.java has a new

[jira] [Commented] (YARN-5575) Many classes use bare yarn. properties instead of the defined constants

2016-09-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524859#comment-15524859 ] Miklos Szegedi commented on YARN-5575: -- Hi [~templedf], TestRMApplicationHistoryWriter.java line 392

  1   2   >