[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-08-31 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599213#comment-16599213 ] Jim Brennan commented on YARN-8648: --- [~jlowe] thanks for the review! {quote}Why was the postComplete

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-31 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599280#comment-16599280 ] Chandni Singh commented on YARN-8706: - {quote} Additionally, for non-privileged containers, we don't

[jira] [Commented] (YARN-8699) Add Yarnclient#yarnclusterMetrics API implementation in router

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599276#comment-16599276 ] genericqa commented on YARN-8699: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-08-31 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599235#comment-16599235 ] Jim Brennan commented on YARN-8648: --- {quote} I explicitly check that the directory exists before calling

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-08-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599266#comment-16599266 ] Eric Yang commented on YARN-8569: - Patch 005 fixed white space and findbugs issues. > Create an interface

[jira] [Updated] (YARN-8569) Create an interface to provide cluster information to application

2018-08-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8569: Attachment: YARN-8569.005.patch > Create an interface to provide cluster information to application >

[jira] [Commented] (YARN-8535) Fix DistributedShell unit tests

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599271#comment-16599271 ] genericqa commented on YARN-8535: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8680) YARN NM: Implement Iterable Abstraction for LocalResourceTrackerstate

2018-08-31 Thread Pradeep Ambati (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Ambati updated YARN-8680: - Attachment: YARN-8680.02.patch > YARN NM: Implement Iterable Abstraction for

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599318#comment-16599318 ] genericqa commented on YARN-8569: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8680) YARN NM: Implement Iterable Abstraction for LocalResourceTrackerstate

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599328#comment-16599328 ] genericqa commented on YARN-8680: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8680) YARN NM: Implement Iterable Abstraction for LocalResourceTrackerstate

2018-08-31 Thread Pradeep Ambati (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Ambati updated YARN-8680: - Attachment: YARN-8680.02.patch > YARN NM: Implement Iterable Abstraction for

[jira] [Updated] (YARN-8680) YARN NM: Implement Iterable Abstraction for LocalResourceTrackerstate

2018-08-31 Thread Pradeep Ambati (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pradeep Ambati updated YARN-8680: - Attachment: (was: YARN-8680.02.patch) > YARN NM: Implement Iterable Abstraction for

[jira] [Commented] (YARN-8680) YARN NM: Implement Iterable Abstraction for LocalResourceTrackerstate

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599442#comment-16599442 ] genericqa commented on YARN-8680: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2018-08-31 Thread Mike (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599324#comment-16599324 ] Mike commented on YARN-5139: Hi [~leftnoteasy], I am currently looking at trying to reproduce the simulation

[jira] [Commented] (YARN-8535) Fix DistributedShell unit tests

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599339#comment-16599339 ] genericqa commented on YARN-8535: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8718) Merge related work for YARN-3409

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599443#comment-16599443 ] genericqa commented on YARN-8718: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7746) Fix PlacementProcessor to support app priority

2018-08-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598294#comment-16598294 ] Manikandan R commented on YARN-7746: Can you please review the patch? > Fix PlacementProcessor to

[jira] [Commented] (YARN-4175) Example of use YARN-1197

2018-08-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598293#comment-16598293 ] Manikandan R commented on YARN-4175: [~asuresh] [~leftnoteasy] Can you please review the patch? >

[jira] [Commented] (YARN-8303) YarnClient should contact TimelineReader for application/attempt/container report

2018-08-31 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598375#comment-16598375 ] Abhishek Modi commented on YARN-8303: - Thanks [~rohithsharma] for review. I will address these

[jira] [Created] (YARN-8738) FairScheduler configures maxResources or minReosurces as negative, the value parse to a positive number.

2018-08-31 Thread Sen Zhao (JIRA)
Sen Zhao created YARN-8738: -- Summary: FairScheduler configures maxResources or minReosurces as negative, the value parse to a positive number. Key: YARN-8738 URL: https://issues.apache.org/jira/browse/YARN-8738

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.011.patch > Limit container sizes per queue in

[jira] [Commented] (YARN-6338) Typos in Docker docs: contains => containers

2018-08-31 Thread Gergely Pollak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598388#comment-16598388 ] Gergely Pollak commented on YARN-6338: -- [~zsiegl] thank you for the patch! LGTM, +1 (non-binding) >

[jira] [Assigned] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie reassigned YARN-8703: --- Assignee: (was: lujie) > Localized resource may leak on disk if container is killed while localizing >

[jira] [Commented] (YARN-6338) Typos in Docker docs: contains => containers

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598425#comment-16598425 ] genericqa commented on YARN-6338: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie reassigned YARN-8703: --- Assignee: lujie > Localized resource may leak on disk if container is killed while localizing >

[jira] [Updated] (YARN-8738) FairScheduler configures maxResources or minReosurces as negative, the value parse to a positive number.

2018-08-31 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-8738: --- Description: If maxResources or minResources is configured as a negative number, the value will be positive

[jira] [Assigned] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie reassigned YARN-8703: --- Assignee: lujie > Localized resource may leak on disk if container is killed while localizing >

[jira] [Commented] (YARN-8616) System.currentTimeMillis() used in RMAppImpl, instead of getting value from systemClock

2018-08-31 Thread Gergely Pollak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598601#comment-16598601 ] Gergely Pollak commented on YARN-8616: -- [~snemeth] thank you for the patch. LGTM +1 (Non-binding) >

[jira] [Comment Edited] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie edited comment on YARN-8703 at 8/31/18 10:52 AM: --- [~jlowe] Thanks for your 

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598482#comment-16598482 ] genericqa commented on YARN-8468: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6855) CLI Proto Modifications to support Node Attributes

2018-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6855: -- Labels: node-attributes (was: ) > CLI Proto Modifications to support Node Attributes >

[jira] [Updated] (YARN-7865) Node attributes documentation

2018-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7865: -- Labels: documentation node-attributes (was: ) > Node attributes documentation >

[jira] [Updated] (YARN-7865) Node attributes documentation

2018-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7865: -- Labels: node-attributes (was: documentation node-attributes) > Node attributes documentation >

[jira] [Commented] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie commented on YARN-8703: - [~jlowe] Thanks for your explain, I have added sleep and kill job command in

[jira] [Comment Edited] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie edited comment on YARN-8703 at 8/31/18 10:05 AM: --- [~jlowe] Thanks for your 

[jira] [Comment Edited] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie edited comment on YARN-8703 at 8/31/18 10:14 AM: --- [~jlowe] Thanks for your 

[jira] [Updated] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-08-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8738: - Summary: FairScheduler configures maxResources or minResources as negative, the value parse to a

[jira] [Resolved] (YARN-7990) Node attribute prefix definition and validation

2018-08-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang resolved YARN-7990. --- Resolution: Done Mark it as done for now. First version we simply support rm.yarn.io and nm.yarn.io.

[jira] [Updated] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8703: Attachment: hadoop-hires-nodemanager-hadoop15.log > Localized resource may leak on disk if container is killed

[jira] [Commented] (YARN-7865) Node attributes documentation

2018-08-31 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598538#comment-16598538 ] Sunil Govindan commented on YARN-7865: -- Thanks [~Naganarasimha] [~cheersyang] and [~bibinchundatt].

[jira] [Comment Edited] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie edited comment on YARN-8703 at 8/31/18 10:07 AM: --- [~jlowe] Thanks for your 

[jira] [Comment Edited] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie edited comment on YARN-8703 at 8/31/18 10:10 AM: --- [~jlowe] Thanks for your 

[jira] [Comment Edited] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598533#comment-16598533 ] lujie edited comment on YARN-8703 at 8/31/18 10:10 AM: --- [~jlowe] Thanks for your 

[jira] [Commented] (YARN-8703) Localized resource may leak on disk if container is killed while localizing

2018-08-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598694#comment-16598694 ] genericqa commented on YARN-8703: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-31 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598976#comment-16598976 ] Chandni Singh commented on YARN-8706: - Thanks for the review [~ebadger] {quote}Both reapContainer()

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598932#comment-16598932 ] Eric Badger commented on YARN-8706: --- Thanks for the patch, [~csingh]! Both {{reapContainer()}} and

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2018-08-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598942#comment-16598942 ] Eric Yang commented on YARN-7129: - Ping, can someone review this patch? Thanks > Application Catalog for

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599088#comment-16599088 ] Eric Badger commented on YARN-8706: --- bq. In DockerLinuxContainerRuntime, reapContainer() calls

[jira] [Commented] (YARN-8729) Node status updater thread could be lost after it restarted

2018-08-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598852#comment-16598852 ] Eric Badger commented on YARN-8729: --- Been awhile since I worked on that patch, but I think the idea was