[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469986#comment-16469986 ] genericqa commented on YARN-8080: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470144#comment-16470144 ] Weiwei Yang commented on YARN-7003: --- Hi [~Tao Yang] The current approach of recovering queue state is

[jira] [Commented] (YARN-8236) Invalid kerberos principal file name cause NPE in native service

2018-05-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470179#comment-16470179 ] Sunil G commented on YARN-8236: --- Thanks [~gsaha] for the patch. Overall looks good to me. Could you pls

[jira] [Commented] (YARN-8248) Job hangs when queue is specified and that queue has 0 capability of a resource

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470210#comment-16470210 ] Gergo Repas commented on YARN-8248: --- [~snemeth] Thanks for the updated patch, LGTM. +1 (non-binding) >

[jira] [Assigned] (YARN-8047) RMWebApp make external class pluggable

2018-05-10 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-8047: --- Assignee: Bilwa S T > RMWebApp make external class pluggable > --

[jira] [Commented] (YARN-8269) NPE happens when submit distributed shell with non-existing queue

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470230#comment-16470230 ] genericqa commented on YARN-8269: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470229#comment-16470229 ] genericqa commented on YARN-4599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470088#comment-16470088 ] genericqa commented on YARN-8202: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470134#comment-16470134 ] Bibin A Chundatt commented on YARN-7892: [~Naganarasimha] Minor comments # TestClientRMService

[jira] [Commented] (YARN-8269) NPE happens when submit distributed shell with non-existing queue

2018-05-10 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470182#comment-16470182 ] kyungwan nam commented on YARN-8269: attaches a new patch with test code. please review it. thanks.

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.003.patch > DRAINING state of queues can't be recovered after RM restart >

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470239#comment-16470239 ] Tao Yang commented on YARN-7003: Thanks [~cheersyang] for your detailed analyzation. Make sense to me!

[jira] [Updated] (YARN-8269) NPE happens when submit distributed shell with non-existing queue

2018-05-10 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-8269: --- Attachment: YARN-8269.002.patch > NPE happens when submit distributed shell with non-existing queue >

[jira] [Updated] (YARN-8268) Fair scheduler: reservable queue is configured both as parent and leaf queue

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8268: -- Description: The following allocation file {code:java} someuser someuser

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470458#comment-16470458 ] genericqa commented on YARN-7003: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470338#comment-16470338 ] Naganarasimha G R commented on YARN-7892: - Hi [~bibinchundatt], Have added the check for the values

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470401#comment-16470401 ] Shane Kumpf commented on YARN-8141: --- +1 to removing 

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470442#comment-16470442 ] Haibo Chen commented on YARN-8130: -- [~rohithsharma] I have one question about the race condition scenerio.

[jira] [Updated] (YARN-7892) Revisit NodeAttribute class structure

2018-05-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7892: Attachment: YARN-7892-YARN-3409.010.patch > Revisit NodeAttribute class structure >

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470427#comment-16470427 ] Jason Lowe commented on YARN-7654: -- bq. The patch writes .env file in the same nmPrivate directory as .cmd

[jira] [Assigned] (YARN-5399) Add configuration to remember ad-hoc queues upon configuration reload

2018-05-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-5399: --- Assignee: Wilfred Spiegelenburg > Add configuration to remember ad-hoc queues

[jira] [Commented] (YARN-8247) Incorrect HTTP status code returned by ATSv2 for non-whitelisted users

2018-05-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469967#comment-16469967 ] Rohith Sharma K S commented on YARN-8247: - [~leftnoteasy] [~vinodkv] [~sunilg] Does changing

[jira] [Resolved] (YARN-5399) Add configuration to remember ad-hoc queues upon configuration reload

2018-05-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-5399. - Resolution: Duplicate We should have this covered as part of YARN-8191. We're

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469992#comment-16469992 ] genericqa commented on YARN-8080: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8248) Job hangs when queue is specified and that queue has 0 capability of a resource

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470013#comment-16470013 ] genericqa commented on YARN-8248: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-6941) Allow Queue placement policies to be ordered by attribute

2018-05-10 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg resolved YARN-6941. - Resolution: Won't Fix The XML is already ordered so it does not make sense to

[jira] [Commented] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470492#comment-16470492 ] Jason Lowe commented on YARN-8244: -- Since in practice deserializing the protocol buffers will create

[jira] [Updated] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-8244: -- Attachment: YARN-8244.002.patch > TestContainerSchedulerQueuing.testStartMultipleContainers failed >

[jira] [Updated] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8249: -- Attachment: YARN-8249.004.patch > Few REST api's in RMWebServices are missing static user check >

[jira] [Commented] (YARN-7933) [atsv2 read acls] Add TimelineWriter#writeDomain

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470490#comment-16470490 ] Haibo Chen commented on YARN-7933: -- {quote} For storing in TimelineEntity, we should discuss it separately

[jira] [Updated] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8273: -- Attachment: YARN-8273.000.patch > Log aggregation does not warn if HDFS quota in target directory is

[jira] [Updated] (YARN-8107) Give an informative message when incorrect format is used in ATSv2 filter attributes

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8107: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Give an informative message when incorrect

[jira] [Updated] (YARN-8129) Improve error message for invalid value in fields attribute

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8129: - Issue Type: Sub-task (was: Improvement) Parent: YARN-1011 > Improve error message for invalid

[jira] [Updated] (YARN-8129) Improve error message for invalid value in fields attribute

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8129: - Parent Issue: YARN-7055 (was: YARN-1011) > Improve error message for invalid value in fields attribute >

[jira] [Updated] (YARN-8107) Give an informative message when incorrect format is used in ATSv2 filter attributes

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8107: - Parent Issue: YARN-7055 (was: YARN-1011) > Give an informative message when incorrect format is used in

[jira] [Updated] (YARN-8132) Final Status of applications shown as UNDEFINED in ATS app queries

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8132: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > Final Status of applications shown as

[jira] [Updated] (YARN-8253) HTTPS Ats v2 api call fails with "bad HTTP parsed"

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8253: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > HTTPS Ats v2 api call fails with "bad HTTP

[jira] [Updated] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8270: - Issue Type: Sub-task (was: Improvement) Parent: YARN-7055 > Adding JMX Metrics for Timeline

[jira] [Updated] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8130: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > Race condition when container events are

[jira] [Updated] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7003: --- Attachment: YARN-7003.004.patch > DRAINING state of queues can't be recovered after RM restart >

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.009.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470564#comment-16470564 ] Tao Yang commented on YARN-7003: UT failures seems irrelative with this patch. Attached v4 patch to fix

[jira] [Commented] (YARN-8132) Final Status of applications shown as UNDEFINED in ATS app queries

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470462#comment-16470462 ] Haibo Chen commented on YARN-8132: -- Both YARN_APPLICATION_STATE and YARN_APPLICATON_FINAL_STATUS are

[jira] [Comment Edited] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470564#comment-16470564 ] Tao Yang edited comment on YARN-7003 at 5/10/18 3:41 PM: - UT failures seem

[jira] [Created] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-10 Thread Gergo Repas (JIRA)
Gergo Repas created YARN-8273: - Summary: Log aggregation does not warn if HDFS quota in target directory is exceeded Key: YARN-8273 URL: https://issues.apache.org/jira/browse/YARN-8273 Project: Hadoop

[jira] [Updated] (YARN-8247) Incorrect HTTP status code returned by ATSv2 for non-whitelisted users

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8247: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > Incorrect HTTP status code returned by ATSv2

[jira] [Updated] (YARN-8215) ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8215: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > ATS v2 returns invalid

[jira] [Commented] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470551#comment-16470551 ] Jim Brennan commented on YARN-8244: --- [~jlowe], I put up another patch that does pretty much what you

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470570#comment-16470570 ] Gergo Repas commented on YARN-8191: --- [~wilfreds] Thank you for the review! I have a question regarding

[jira] [Commented] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470594#comment-16470594 ] Sunil G commented on YARN-8249: --- Updating v4 patch after correct test error. cc [~rohithsharma] [~vinodkv]

[jira] [Updated] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8249: -- Target Version/s: 2.8.4, 3.1.1, 2.9.2, 3.0.3 > Few REST api's in RMWebServices are missing static user check >

[jira] [Commented] (YARN-8242) YARN NM: OOM error while reading back the state store on recovery

2018-05-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470724#comment-16470724 ] Jason Lowe commented on YARN-8242: -- Thanks for updating the patch! Handling IOExceptions while walking

[jira] [Comment Edited] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470741#comment-16470741 ] Rohith Sharma K S edited comment on YARN-8130 at 5/10/18 5:03 PM: -- Events

[jira] [Commented] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470795#comment-16470795 ] Sunil G commented on YARN-8249: --- Thank you [~vinodkv] for the comments. Attaching v5 patch addressing all.

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.010.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470723#comment-16470723 ] Hudson commented on YARN-8202: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14158 (See

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470766#comment-16470766 ] Billie Rinaldi commented on YARN-8080: -- Hi [~suma.shivaprasad], thanks for the new patch. I like the

[jira] [Updated] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8249: -- Attachment: YARN-8249.005.patch > Few REST api's in RMWebServices are missing static user check >

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470814#comment-16470814 ] Eric Yang commented on YARN-8108: - [~daryn] This issue doesn't present in Hadoop 2.7.5, does not mean it

[jira] [Commented] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470845#comment-16470845 ] genericqa commented on YARN-8249: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470866#comment-16470866 ] Haibo Chen commented on YARN-7715: -- +1. Checking this in shortly. > Update CPU and Memory cgroups params

[jira] [Updated] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7715: - Summary: Support NM promotion/demotion of running containers. (was: Update CPU and Memory cgroups params

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470881#comment-16470881 ] Miklos Szegedi commented on YARN-4599: -- Fixing unit tests. [~asuresh], FYI this patch affects

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470741#comment-16470741 ] Rohith Sharma K S commented on YARN-8130: - Events are dispatched in FIFO but NMTimelinePublisher

[jira] [Commented] (YARN-8270) Adding JMX Metrics for Timeline Collector and Reader

2018-05-10 Thread Sushil Kumar S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470755#comment-16470755 ] Sushil Kumar S commented on YARN-8270: -- [~rohithsharma] Kindly grant permission to assign the JIRA

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-10 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470865#comment-16470865 ] Gergo Repas commented on YARN-8191: --- Unit test failure is unrelated, the last patch addresses the

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-10 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.004.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470877#comment-16470877 ] Wangda Tan commented on YARN-8141: -- Thanks [~csingh],  Overall patch looks good, it gonna be better to

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-10 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470644#comment-16470644 ] Robert Kanter commented on YARN-8202: - +1 > DefaultAMSProcessor should properly check units of

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-10 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470662#comment-16470662 ] Daryn Sharp commented on YARN-8108: --- bq. I took a look into the issue and am feeling okay about the

[jira] [Commented] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470690#comment-16470690 ] genericqa commented on YARN-8244: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470820#comment-16470820 ] genericqa commented on YARN-7003: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470838#comment-16470838 ] genericqa commented on YARN-8191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-10 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8141: Attachment: YARN-8141.002.patch > YARN Native Service: Respect >

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470899#comment-16470899 ] Suma Shivaprasad commented on YARN-8080: Thanks [~billie.rinaldi] Thats a good suggestion to add a

[jira] [Updated] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8080: --- Attachment: YARN-8080.010.patch > YARN native service should support component restart policy

[jira] [Commented] (YARN-8273) Log aggregation does not warn if HDFS quota in target directory is exceeded

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470918#comment-16470918 ] genericqa commented on YARN-8273: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7715) Support NM promotion/demotion of running containers.

2018-05-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470935#comment-16470935 ] Hudson commented on YARN-7715: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14161 (See

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470953#comment-16470953 ] Chandni Singh commented on YARN-8080: - # TestComponent line 250 - 252, {code}

[jira] [Updated] (YARN-7799) YARN Service dependency follow up work

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7799: Fix Version/s: 3.1.1 3.2.0 > YARN Service dependency follow up work >

[jira] [Commented] (YARN-8080) YARN native service should support component restart policy

2018-05-10 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470944#comment-16470944 ] Chandni Singh commented on YARN-8080: - #

[jira] [Commented] (YARN-8123) Skip compiling old hamlet package when the Java version is 10 or upper

2018-05-10 Thread Dinesh Chitlangia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470982#comment-16470982 ] Dinesh Chitlangia commented on YARN-8123: - [~tasanuma0829] +1 for including java9 too. I would

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470983#comment-16470983 ] genericqa commented on YARN-7892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8265) AM should retrieve new IP for restarted container

2018-05-10 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471183#comment-16471183 ] Billie Rinaldi commented on YARN-8265: -- It seems like we have a few options (in order from most to

[jira] [Commented] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471196#comment-16471196 ] Gour Saha commented on YARN-8243: - Ah, I know what you are saying [~billie.rinaldi]. I modified the patch

[jira] [Updated] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-8243: Attachment: YARN-8243.02.patch > Flex down should first remove pending container requests (if any) and then

[jira] [Commented] (YARN-8274) Docker command error during container relaunch

2018-05-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471224#comment-16471224 ] Eric Badger commented on YARN-8274: --- This smells like a bug in YARN-8209, since those invoke the docker

[jira] [Commented] (YARN-8248) Job hangs when queue is specified and that queue has 0 capability of a resource

2018-05-10 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471309#comment-16471309 ] Haibo Chen commented on YARN-8248: -- Thanks [~snemeth] for the patch. I have some questions. 1) Why the

[jira] [Commented] (YARN-8141) YARN Native Service: Respect YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS specified in service spec

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471262#comment-16471262 ] genericqa commented on YARN-8141: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471269#comment-16471269 ] genericqa commented on YARN-8243: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-8249: -- Attachment: YARN-8249.006.patch > Few REST api's in RMWebServices are missing

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471387#comment-16471387 ] Eric Yang commented on YARN-7654: - [~jlowe] Patch 22 contains all requested changes except refactoring code

[jira] [Commented] (YARN-7003) DRAINING state of queues is not recovered after RM restart

2018-05-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471434#comment-16471434 ] Hudson commented on YARN-7003: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14169 (See

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471493#comment-16471493 ] Rohith Sharma K S commented on YARN-8130: - [~haibochen] do you have any more comments? If not we

[jira] [Commented] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471379#comment-16471379 ] genericqa commented on YARN-8249: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471443#comment-16471443 ] genericqa commented on YARN-7654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.022.patch > Support ENTRY_POINT for docker container >

[jira] [Assigned] (YARN-8123) Skip compiling old hamlet package when the Java version is 10 or upper

2018-05-10 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-8123: --- Assignee: Dinesh Chitlangia > Skip compiling old hamlet package when the Java version is 10

[jira] [Commented] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471396#comment-16471396 ] Hudson commented on YARN-8249: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14168 (See

[jira] [Commented] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-05-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16471395#comment-16471395 ] Naganarasimha G R commented on YARN-6578: - Sorry for the delayed response [~cheersyang] &

  1   2   >