[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694335#comment-16694335 ] Eric Yang commented on YARN-8986: - [~Charo Zhang]

[jira] [Comment Edited] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694313#comment-16694313 ] Charo Zhang edited comment on YARN-8986 at 11/21/18 7:53 AM: - [~eyang] I know

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.007.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: (was: YARN-8986.007.patch) > publish all exposed ports to random ports when using

[jira] [Commented] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694353#comment-16694353 ] Hadoop QA commented on YARN-8882: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694340#comment-16694340 ] Charo Zhang commented on YARN-8986: --- [~eyang] i understand. I set network_name=bridge when it's not

[jira] [Comment Edited] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694313#comment-16694313 ] Charo Zhang edited comment on YARN-8986 at 11/21/18 7:42 AM: - [~eyang] I know

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.007.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694329#comment-16694329 ] Steven Rand commented on YARN-9041: --- I'm not sure that this is correct. I think that it can lead to

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-20 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Attachment: (was: YARN-9016.001.patch) > DocumentStore as a backend for ATSv2 >

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694313#comment-16694313 ] Charo Zhang commented on YARN-8986: --- [~eyang] I know what your mean, it will use bridge network as

[jira] [Commented] (YARN-9005) FairScheduler maybe preempt the AM container

2018-11-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694310#comment-16694310 ] Wanqiang Ji commented on YARN-9005: --- Hi [~yufeigu], sorry to miss your latest reply. I created the new

[jira] [Updated] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.007.patch > Phase 1 - Add a shared device mapping manager for device

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694275#comment-16694275 ] Wanqiang Ji commented on YARN-9041: --- The UT failure should be irrelevant, I tested locally it can work

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694264#comment-16694264 ] Bibin A Chundatt commented on YARN-9039: Thank you [~suma.shivaprasad] for raising the issue #

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694263#comment-16694263 ] Eric Yang commented on YARN-8986: - [~Charo Zhang] If I am not mistaken, the [default network

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694255#comment-16694255 ] Hadoop QA commented on YARN-9039: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694241#comment-16694241 ] Hadoop QA commented on YARN-9027: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694244#comment-16694244 ] Hadoop QA commented on YARN-8882: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694220#comment-16694220 ] Suma Shivaprasad commented on YARN-9039: Fixed findbugs, CS > App ACLs are not validated when

[jira] [Updated] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-9039: --- Attachment: YARN-9039.2.patch > App ACLs are not validated when serving logs from Logs

[jira] [Updated] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9027: Attachment: 0002-YARN-9027.patch > EntityGroupFSTimelineStore fails to init

[jira] [Updated] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.006.patch > Phase 1 - Add a shared device mapping manager for device

[jira] [Commented] (YARN-8174) Add containerId to ResourceLocalizationService fetch failure

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694187#comment-16694187 ] Hadoop QA commented on YARN-8174: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8148) Update decimal values for queue capacities shown on queue status cli

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694180#comment-16694180 ] Hadoop QA commented on YARN-8148: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694176#comment-16694176 ] Hadoop QA commented on YARN-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

2018-11-20 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694173#comment-16694173 ] Tao Yang commented on YARN-9007: Thanks [~wilfreds] for the comments. I agree that current preemptions

[jira] [Commented] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694168#comment-16694168 ] Hadoop QA commented on YARN-8882: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694161#comment-16694161 ] Prabhu Joseph commented on YARN-9027: - Thanks [~tarunparimi] for the review. Will change it to

[jira] [Commented] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694159#comment-16694159 ] Hadoop QA commented on YARN-9040: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694156#comment-16694156 ] Tarun Parimi commented on YARN-9027: Thanks [~Prabhu Joseph] for the patch. I have one comment on the

[jira] [Commented] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694155#comment-16694155 ] Hadoop QA commented on YARN-9027: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694139#comment-16694139 ] Hadoop QA commented on YARN-9041: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8174) Add containerId to ResourceLocalizationService fetch failure

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694132#comment-16694132 ] Prabhu Joseph commented on YARN-8174: - [~bibinchundatt] Can you review this patch when you get time.

[jira] [Commented] (YARN-8148) Update decimal values for queue capacities shown on queue status cli

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694131#comment-16694131 ] Prabhu Joseph commented on YARN-8148: - [~sunilg] Can you review this patch when you get time. Thanks

[jira] [Commented] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694125#comment-16694125 ] Prabhu Joseph commented on YARN-9027: - [~rohithsharma] Please review the patch when you get time. Have

[jira] [Updated] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9027: Attachment: 0001-YARN-9027.patch > EntityGroupFSTimelineStore fails to init

[jira] [Updated] (YARN-8882) Phase 1 - Add a shared device mapping manager for device plugin to use

2018-11-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8882: --- Attachment: YARN-8882-trunk.005.patch > Phase 1 - Add a shared device mapping manager for device

[jira] [Updated] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9027: Attachment: (was: 0001-YARN-9027.patch) > EntityGroupFSTimelineStore fails to init

[jira] [Updated] (YARN-9027) EntityGroupFSTimelineStore fails to init LevelDBCacheTimelineStore

2018-11-20 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9027: Attachment: 0001-YARN-9027.patch > EntityGroupFSTimelineStore fails to init

[jira] [Updated] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-20 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-9040: --- Attachment: YARN-9040.001.patch > LevelDBCacheTimelineStore in ATS 1.5 leaks native memory >

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694101#comment-16694101 ] Hadoop QA commented on YARN-9036: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694099#comment-16694099 ] Charo Zhang commented on YARN-8986: --- [~eyang] 1, network_names free added in 006 patch. 2, when network

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.006.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Commented] (YARN-9026) DefaultOOMHandler should mark preempted containers as killed

2018-11-20 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693976#comment-16693976 ] Zhankun Tang commented on YARN-9026: [~haibochen] . Yeah. Thanks. :) > DefaultOOMHandler should mark

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693937#comment-16693937 ] Eric Yang commented on YARN-8986: - [~Charo Zhang] Patch 005 seems to return from

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Component/s: scheduler preemption > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Created] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-20 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-9041: - Summary: Optimize FSPreemptionThread#identifyContainersToPreempt method Key: YARN-9041 URL: https://issues.apache.org/jira/browse/YARN-9041 Project: Hadoop YARN

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693883#comment-16693883 ] Keqiu Hu commented on YARN-9036: Apparently IDE didn't pick up the right import, uploaded

[jira] [Updated] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keqiu Hu updated YARN-9036: --- Attachment: YARN-9036.004.patch > Escape newlines in health report in YARN UI >

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693874#comment-16693874 ] Hudson commented on YARN-8992: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15478 (See

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693873#comment-16693873 ] Hadoop QA commented on YARN-9036: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693863#comment-16693863 ] Haibo Chen commented on YARN-9025: -- [~snemeth] I notice the existence of MockRM.drainEvents(). Do that

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693857#comment-16693857 ] Hadoop QA commented on YARN-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8992) Fair scheduler can delete a dynamic queue while an application attempt is being added to the queue

2018-11-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693855#comment-16693855 ] Haibo Chen commented on YARN-8992: -- +1. Checking it in shortly > Fair scheduler can delete a dynamic

[jira] [Commented] (YARN-9030) Log aggregation changes to handle filesystems which do not support permissions

2018-11-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693852#comment-16693852 ] Wangda Tan commented on YARN-9030: -- Thanks [~suma.shivaprasad], +1, will get it committed later today.

[jira] [Updated] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9036: Attachment: YARN-9036.003.patch > Escape newlines in health report in YARN UI >

[jira] [Comment Edited] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693797#comment-16693797 ] Charo Zhang edited comment on YARN-8986 at 11/20/18 9:29 PM: - [~eyang] I think

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693797#comment-16693797 ] Charo Zhang commented on YARN-8986: --- [~eyang] I think network_name is allowed to not exist, and i find

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.005.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693780#comment-16693780 ] Hadoop QA commented on YARN-8738: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8962) Add ability to use interactive shell with normal yarn container

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693779#comment-16693779 ] Hadoop QA commented on YARN-8962: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9040) LevelDBCacheTimelineStore in ATS 1.5 leaks native memory

2018-11-20 Thread Tarun Parimi (JIRA)
Tarun Parimi created YARN-9040: -- Summary: LevelDBCacheTimelineStore in ATS 1.5 leaks native memory Key: YARN-9040 URL: https://issues.apache.org/jira/browse/YARN-9040 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-8279) AggregationLogDeletionService does not honor yarn.log-aggregation.IndexedFormat.remote-app-log-dir-suffix

2018-11-20 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8279: --- Release Note: This issue affects only when IndexedFormat is used for log-aggregation by setting

[jira] [Commented] (YARN-8838) Add security check for container user is same as websocket user

2018-11-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693695#comment-16693695 ] Hudson commented on YARN-8838: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15476 (See

[jira] [Commented] (YARN-8838) Add security check for container user is same as websocket user

2018-11-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693673#comment-16693673 ] Billie Rinaldi commented on YARN-8838: -- +1 for patch 7. This fixes whitespace and line length

[jira] [Commented] (YARN-8838) Add security check for container user is same as websocket user

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693657#comment-16693657 ] Hadoop QA commented on YARN-8838: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693633#comment-16693633 ] Hadoop QA commented on YARN-9016: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-9026) DefaultOOMHandler should mark preempted containers as killed

2018-11-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-9026. -- Resolution: Invalid > DefaultOOMHandler should mark preempted containers as killed >

[jira] [Commented] (YARN-9026) DefaultOOMHandler should mark preempted containers as killed

2018-11-20 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693638#comment-16693638 ] Haibo Chen commented on YARN-9026: -- Ah, I was not aware of this.  Indeed, this is already taken care of

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693615#comment-16693615 ] Keqiu Hu commented on YARN-9036: Uploaded 

[jira] [Comment Edited] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693615#comment-16693615 ] Keqiu Hu edited comment on YARN-9036 at 11/20/18 6:16 PM: -- Uploaded 

[jira] [Updated] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keqiu Hu updated YARN-9036: --- Attachment: YARN-9036.003.patch > Escape newlines in health report in YARN UI >

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693602#comment-16693602 ] Hadoop QA commented on YARN-9036: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693598#comment-16693598 ] Szilard Nemeth edited comment on YARN-8738 at 11/20/18 6:00 PM: Thanks

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693598#comment-16693598 ] Szilard Nemeth commented on YARN-8738: -- Thanks [~wilfreds] for the review! Yep, something went wrong

[jira] [Updated] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8738: - Attachment: YARN-8738.002.patch > FairScheduler configures maxResources or minResources as

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693587#comment-16693587 ] Keqiu Hu commented on YARN-9036: Uploaded YARN-9036.002.patch to make the fix more robust. > Escape

[jira] [Updated] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-20 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keqiu Hu updated YARN-9036: --- Attachment: YARN-9036.002.patch > Escape newlines in health report in YARN UI >

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693584#comment-16693584 ] Eric Yang commented on YARN-8986: - [~Charo Zhang] add_ports_mapping_to_command assumes that network_name

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693565#comment-16693565 ] Szilard Nemeth commented on YARN-8586: -- UT failure seems unrelated, this is ready to review. >

[jira] [Commented] (YARN-9024) ClusterNodeTracker maximum allocation does not respect resource units

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693571#comment-16693571 ] Szilard Nemeth commented on YARN-9024: -- I haven't noticed YARN-7159, that jira is about to move

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693562#comment-16693562 ] Szilard Nemeth commented on YARN-5106: -- Hi [~tangzhankun]! Thanks for the review! The unit test issue

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693507#comment-16693507 ] Hadoop QA commented on YARN-8986: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8838) Add security check for container user is same as websocket user

2018-11-20 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8838: - Attachment: YARN-8838.007.patch > Add security check for container user is same as websocket user

[jira] [Commented] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693392#comment-16693392 ] Charo Zhang commented on YARN-8986: --- [~eyang] “ports-mapping” test has added to

[jira] [Updated] (YARN-8986) publish all exposed ports to random ports when using bridge network

2018-11-20 Thread Charo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charo Zhang updated YARN-8986: -- Attachment: YARN-8986.004.patch > publish all exposed ports to random ports when using bridge network >

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693373#comment-16693373 ] Hadoop QA commented on YARN-8586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693368#comment-16693368 ] Hadoop QA commented on YARN-9039: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9030) Log aggregation changes to handle filesystems which do not support permissions

2018-11-20 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-9030: --- Description: Some cloud storages like ADLS do not support permissions in which case they

[jira] [Commented] (YARN-9034) ApplicationCLI should have option to take clusterId

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693327#comment-16693327 ] Hadoop QA commented on YARN-9034: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693316#comment-16693316 ] Wilfred Spiegelenburg commented on YARN-8738: - Thank you for the patch [~snemeth]. The build

[jira] [Created] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-9039: -- Summary: App ACLs are not validated when serving logs from Logs CLI/Yarn UI2 Key: YARN-9039 URL: https://issues.apache.org/jira/browse/YARN-9039 Project: Hadoop

[jira] [Commented] (YARN-9025) Make TestFairScheduler#testChildMaxResources more reliable, as it is flaky now

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693298#comment-16693298 ] Wilfred Spiegelenburg commented on YARN-9025: - Change looks good, we discussed the test

[jira] [Updated] (YARN-9039) App ACLs are not validated when serving logs from Logs CLI/Yarn UI2

2018-11-20 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-9039: --- Attachment: YARN-9039.1.patch > App ACLs are not validated when serving logs from Logs

[jira] [Commented] (YARN-9019) Ratio calculation of ResourceCalculator implementations could return NaN

2018-11-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693290#comment-16693290 ] Wilfred Spiegelenburg commented on YARN-9019: - Change looks good +1 (non binding) > Ratio

[jira] [Commented] (YARN-8951) Defining default queue placement rule in allocations file with create="false" throws an NPE

2018-11-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693266#comment-16693266 ] Szilard Nemeth commented on YARN-8951: -- Thanks [~wilfreds] for your comment! I debugged the test code

[jira] [Updated] (YARN-9016) DocumentStore as a backend for ATSv2

2018-11-20 Thread Sushil Ks (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sushil Ks updated YARN-9016: Attachment: (was: YARN-9016.001.patch) > DocumentStore as a backend for ATSv2 >

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-11-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16693198#comment-16693198 ] Hadoop QA commented on YARN-5106: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9034) ApplicationCLI should have option to take clusterId

2018-11-20 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-9034: Attachment: YARN-9034.02.patch > ApplicationCLI should have option to take clusterId >

  1   2   >