[jira] [Commented] (YARN-3610) FairScheduler: Add steady-fair-shares to the REST API documentation

2018-05-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465472#comment-16465472 ] Wilfred Spiegelenburg commented on YARN-3610: - This looks OK, no more comments, +1 >

[jira] [Updated] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

2018-05-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8025: -- Fix Version/s: 3.0.3 > UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to >

[jira] [Commented] (YARN-8025) UsersManangers#getComputedResourceLimitForActiveUsers throws NPE due to preComputedActiveUserLimit is empty

2018-05-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465467#comment-16465467 ] Weiwei Yang commented on YARN-8025: --- I've committed this to trunk, cherry picked to branch-3.0 and

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.002.patch > DRAINING state of queues can't be recovered after RM restart >

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated YARN-6578: Attachment: YARN-6578.003.patch > Return container resource utilization from NM ContainerStatus call >

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465728#comment-16465728 ] Tao Yang commented on YARN-7003: Update v2 patch for trunk now. [~cheersyang], can you help to review this

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-07 Thread Yang Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465620#comment-16465620 ] Yang Wang commented on YARN-6578: - [~cheersyang], thanks for your comment. Have fixed the findbugs issues.

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465757#comment-16465757 ] genericqa commented on YARN-6578: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6645) Bug fix in ContainerImpl when calling the symLink of LinuxContainerExecutor

2018-05-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated YARN-6645: Fix Version/s: (was: 2.9.1) > Bug fix in ContainerImpl when calling the symLink of

[jira] [Updated] (YARN-6661) Too much CLEANUP event hang ApplicationMasterLauncher thread pool

2018-05-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated YARN-6661: Fix Version/s: (was: 2.9.1) > Too much CLEANUP event hang ApplicationMasterLauncher thread pool >

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465833#comment-16465833 ] genericqa commented on YARN-7003: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6606) The implementation of LocalizationStatus in ContainerStatusProto

2018-05-07 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated YARN-6606: Fix Version/s: (was: 2.9.1) > The implementation of LocalizationStatus in ContainerStatusProto >

[jira] [Created] (YARN-8252) Fix ServiceMaster main not found

2018-05-07 Thread Zoltan Haindrich (JIRA)
Zoltan Haindrich created YARN-8252: -- Summary: Fix ServiceMaster main not found Key: YARN-8252 URL: https://issues.apache.org/jira/browse/YARN-8252 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8252) Fix ServiceMaster main not found

2018-05-07 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466001#comment-16466001 ] Zoltan Haindrich commented on YARN-8252: the problem is that {{ServiceMaster}} extends

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.007.patch > Docker container launch use popen have risk of shell expansion >

[jira] [Commented] (YARN-8252) Fix ServiceMaster main not found

2018-05-07 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8252?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466059#comment-16466059 ] Zoltan Haindrich commented on YARN-8252: currently the only jar provided at startup is a vanilla

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466422#comment-16466422 ] genericqa commented on YARN-8242: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466423#comment-16466423 ] Billie Rinaldi commented on YARN-8255: -- If people disagree with me and we do allow this to be

[jira] [Updated] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7894: Attachment: YARN-7894.004.patch > Improve ATS response for DS_CONTAINER when container launch fails

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466589#comment-16466589 ] genericqa commented on YARN-8233: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466616#comment-16466616 ] Eric Yang commented on YARN-8206: - [~ebadger] +1 for proposal 2. This is safer option in my opinion. >

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-07 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466529#comment-16466529 ] Eric Badger commented on YARN-8206: --- [~eyang], [~shaneku...@gmail.com], [~jlowe], [~Jim_Brennan], I've

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Priority: Blocker (was: Major) > Docker container launch use popen have risk of shell expansion >

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466578#comment-16466578 ] Jason Lowe commented on YARN-8207: -- Thanks for updating the patch! Nit: Needing to initialize the args

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466618#comment-16466618 ] Wangda Tan commented on YARN-7892: -- Thanks [~Naganarasimha], For id(identifier) and key, I think they're

[jira] [Updated] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-05-07 Thread Kanwaljeet Sachdev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanwaljeet Sachdev updated YARN-8242: - Attachment: YARN-8242.003.patch > YARN NM: OOM error while reading back the state store on

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466613#comment-16466613 ] genericqa commented on YARN-8191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466448#comment-16466448 ] Eric Yang commented on YARN-8255: - Instead of introduce another field to enable or disable flex. We can

[jira] [Created] (YARN-8256) Pluggable provider for node membership management

2018-05-07 Thread Dagang Wei (JIRA)
Dagang Wei created YARN-8256: Summary: Pluggable provider for node membership management Key: YARN-8256 URL: https://issues.apache.org/jira/browse/YARN-8256 Project: Hadoop YARN Issue Type: New

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466483#comment-16466483 ] Billie Rinaldi commented on YARN-7894: -- That output looks good, thanks [~csingh]. I noticed one more

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466512#comment-16466512 ] Eric Yang commented on YARN-8207: - [~jlowe] Hadoop 3.1.1 release date was proposed for May 7th. This is a

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466577#comment-16466577 ] Naganarasimha G R commented on YARN-7892: - @ [~leftnoteasy],  Hope you could share your view on my

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466576#comment-16466576 ] Wangda Tan commented on YARN-8141: -- Thanks [~shaneku...@gmail.com], I think we should consolidate the two,

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.001.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466462#comment-16466462 ] Wangda Tan commented on YARN-8255: -- Thanks [~suma.shivaprasad] for filing the JIRA and suggestions from

[jira] [Comment Edited] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466512#comment-16466512 ] Eric Yang edited comment on YARN-8207 at 5/7/18 9:47 PM: - [~jlowe] Hadoop 3.1.1

[jira] [Updated] (YARN-8256) Pluggable provider for node membership management

2018-05-07 Thread Dagang Wei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dagang Wei updated YARN-8256: - Description: h1. Background HDFS-7541 introduced a pluggable provider framework for node membership

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-05-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466541#comment-16466541 ] Eric Payne commented on YARN-4606: -- {code:title=AppSchedulingInfo#updatePendingResources} if(!

[jira] [Commented] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466553#comment-16466553 ] Naganarasimha G R commented on YARN-8254: - Thanks [~Prabhu Joseph] for raising this issue, it would

[jira] [Assigned] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8141: Assignee: Chandni Singh > YARN Native Service: Respect >

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466649#comment-16466649 ] genericqa commented on YARN-8207: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466683#comment-16466683 ] Eric Yang commented on YARN-8207: - [~jlowe] {quote}Rather than make an expensive deep copy of the

[jira] [Assigned] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-8253: --- Assignee: Rohith Sharma K S > HTTPS Ats v2 api call fails with "bad HTTP parsed" >

[jira] [Assigned] (YARN-8247) Incorrect HTTP status code returned by ATSv2 for non-whitelisted users

2018-05-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-8247: --- Assignee: Rohith Sharma K S > Incorrect HTTP status code returned by ATSv2 for

[jira] [Commented] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-07 Thread Charan Hebri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466903#comment-16466903 ] Charan Hebri commented on YARN-8253: [~rohithsharma] I can provide a fix if you haven't started. >

[jira] [Updated] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6091: - Target Version/s: 2.8.5 (was: 2.8.4) > the AppMaster register failed when use Docker on LinuxContainer >

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2018-05-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466774#comment-16466774 ] Junping Du commented on YARN-6091: -- Move to 2.8.5 as 2.8.4 is in RC stage. > the AppMaster register

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466857#comment-16466857 ] Wangda Tan commented on YARN-8255: -- [~eyang],  Thanks for commenting, your suggestion makes sense, and

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466872#comment-16466872 ] Bibin A Chundatt commented on YARN-7892: [~Naganarasimha] Can you also update

[jira] [Commented] (YARN-5151) [UI2] Support kill application from new YARN UI

2018-05-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466893#comment-16466893 ] Hudson commented on YARN-5151: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14137 (See

[jira] [Updated] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-07 Thread Charan Hebri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charan Hebri updated YARN-8253: --- Attachment: YARN-8253.01.patch > HTTPS Ats v2 api call fails with "bad HTTP parsed" >

[jira] [Commented] (YARN-8175) Add support for Node Labels in SLS.

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466629#comment-16466629 ] genericqa commented on YARN-8175: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7892) Revisit NodeAttribute class structure

2018-05-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7892: Attachment: YARN-7892-YARN-3409.007.patch > Revisit NodeAttribute class structure >

[jira] [Commented] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466853#comment-16466853 ] Prabhu Joseph commented on YARN-8254: - YarnClient can request setLogLevel for an application using a

[jira] [Commented] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466915#comment-16466915 ] Rohith Sharma K S commented on YARN-8253: - +1, pending jenkins > HTTPS Ats v2 api call fails with

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466641#comment-16466641 ] genericqa commented on YARN-8242: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-05-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-8236: --- Assignee: Gour Saha > Invalid kerberos principal file name cause NPE in native service >

[jira] [Updated] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-05-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8236: Attachment: YARN-8236.01.patch > Invalid kerberos principal file name cause NPE in native service >

[jira] [Commented] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-05-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466677#comment-16466677 ] Gour Saha commented on YARN-8236: - [~sunilg], I attached a patch to fix this. Please review. > Invalid

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466712#comment-16466712 ] Naganarasimha G R commented on YARN-7892: - Thanks for the comments [~leftnoteasy], I have modified

[jira] [Commented] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466634#comment-16466634 ] Wangda Tan commented on YARN-8257: -- Talked to [~gsaha], and [~gsaha] mentioned he will help if get chance.

[jira] [Created] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

2018-05-07 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8257: Summary: Native service should automatically adding escapes for environment/launch cmd before sending to YARN Key: YARN-8257 URL: https://issues.apache.org/jira/browse/YARN-8257

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466837#comment-16466837 ] genericqa commented on YARN-4599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-05-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8236: Target Version/s: 3.1.1 > Invalid kerberos principal file name cause NPE in native service >

[jira] [Updated] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-05-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8236: Fix Version/s: 3.1.1 3.2.0 > Invalid kerberos principal file name cause NPE in native

[jira] [Commented] (YARN-8201) Skip stacktrace of ApplicationNotFoundException at server side

2018-05-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466879#comment-16466879 ] Bibin A Chundatt commented on YARN-8201:   +1 lgtm. Will commit it later today. > Skip

[jira] [Assigned] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-8253: --- Assignee: Charan Hebri (was: Rohith Sharma K S) Assigned to you. > HTTPS Ats v2 api

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466653#comment-16466653 ] genericqa commented on YARN-7894: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466716#comment-16466716 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 008 fixed the issues discovered except char array copy.

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466800#comment-16466800 ] Eric Yang commented on YARN-8255: - [~leftnoteasy] Recompute and expandable are intertwined. They are the

[jira] [Comment Edited] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466800#comment-16466800 ] Eric Yang edited comment on YARN-8255 at 5/8/18 3:08 AM: - [~leftnoteasy] Recompute

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466631#comment-16466631 ] genericqa commented on YARN-7715: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

2018-05-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466656#comment-16466656 ] Wangda Tan commented on YARN-8257: -- Just took a closer look:  Since both of environment/launch command

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.008.patch > Docker container launch use popen have risk of shell expansion >

[jira] [Updated] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8254: Component/s: yarn > dynamically change log levels for YARN Jobs >

[jira] [Commented] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466767#comment-16466767 ] Prabhu Joseph commented on YARN-8254: - [~Naganarasimha] Just realized this is Application specific. AM

[jira] [Updated] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8254: Component/s: (was: yarn) > dynamically change log levels for YARN Jobs >

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466771#comment-16466771 ] genericqa commented on YARN-8207: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5151) [UI2] Support kill application from new YARN UI

2018-05-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5151: -- Summary: [UI2] Support kill application from new YARN UI (was: [YARN-3368] Support kill application from new

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466315#comment-16466315 ] Billie Rinaldi commented on YARN-8080: -- Another thing we should address is the concept of readiness

[jira] [Assigned] (YARN-8180) YARN Federation has not implemented blacklist sub-cluster for AM routing

2018-05-07 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8180: --- Assignee: Abhishek Modi > YARN Federation has not implemented blacklist sub-cluster for AM

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-05-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466136#comment-16466136 ] Eric Payne commented on YARN-4606: -- Thanks [~maniraj...@gmail.com] for your consistent and continuing

[jira] [Created] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-07 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8253: Summary: HTTPS Ats v2 api call fails with "bad HTTP parsed" Key: YARN-8253 URL: https://issues.apache.org/jira/browse/YARN-8253 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466169#comment-16466169 ] Billie Rinaldi commented on YARN-8080: -- Thanks for taking this up, [~suma.shivaprasad]! This is an

[jira] [Updated] (YARN-8175) Add support for Node Labels in SLS.

2018-05-07 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8175: Attachment: YARN-8175.004.patch > Add support for Node Labels in SLS. >

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-05-07 Thread Jeff Kubina (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466242#comment-16466242 ] Jeff Kubina commented on YARN-8242: --- {quote}A similar approach can be used for other recovered lists like

[jira] [Created] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8255: -- Summary: Allow option to disable flex for a service component Key: YARN-8255 URL: https://issues.apache.org/jira/browse/YARN-8255 Project: Hadoop YARN

[jira] [Updated] (YARN-8248) Job hangs when queue is specified and that queue has 0 capability of a resource

2018-05-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-8248: - Component/s: yarn fairscheduler > Job hangs when queue is specified and that queue has 0

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466268#comment-16466268 ] Billie Rinaldi commented on YARN-8255: -- I'm not sure this configuration parameter is necessary. Only

[jira] [Updated] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7894: Attachment: YARN-7894.003.patch > Improve ATS response for DS_CONTAINER when container launch fails

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466274#comment-16466274 ] Miklos Szegedi commented on YARN-7715: -- Thank you for the review [~haibochen]. I added a unit test

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466278#comment-16466278 ] Chandni Singh commented on YARN-7894: - Addressed the review comments in patch 3. Tried an app with 3

[jira] [Updated] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7894: Attachment: (was: YARN-7894.003.patch) > Improve ATS response for DS_CONTAINER when container

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-07 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.006.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Created] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-8254: --- Summary: dynamically change log levels for YARN Jobs Key: YARN-8254 URL: https://issues.apache.org/jira/browse/YARN-8254 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8254) dynamically change log levels for YARN Jobs

2018-05-07 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8254: Labels: supportability (was: ) > dynamically change log levels for YARN Jobs >

[jira] [Commented] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466259#comment-16466259 ] Billie Rinaldi commented on YARN-8243: -- I think one problem here is that the ComponentInstance

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.020.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-07 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16466258#comment-16466258 ] Eric Yang commented on YARN-7654: - Rebased patch 20 to based on YARN-8207 patch 007. > Support ENTRY_POINT

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.003.patch > Update CPU and Memory cgroups params on container update as

  1   2   >