[jira] [Commented] (YARN-9394) Use new API of RackResolver to get better performance

2019-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808423#comment-16808423 ] Hadoop QA commented on YARN-9394: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

2019-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808453#comment-16808453 ] Hadoop QA commented on YARN-9435: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9281) Add express upgrade button to Appcatalog UI

2019-04-03 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808557#comment-16808557 ] Adam Antal commented on YARN-9281: -- Thanks for taking care of the items, LGTM (non-binding). > Add

[jira] [Assigned] (YARN-9430) Recovering containers does not check available resources on node

2019-04-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9430: Assignee: (was: Szilard Nemeth) > Recovering containers does not check available

[jira] [Commented] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

2019-04-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808563#comment-16808563 ] Szilard Nemeth commented on YARN-9421: -- As per our further discussion with [~wilfreds]: Let’s give

[jira] [Commented] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

2019-04-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808567#comment-16808567 ] Szilard Nemeth commented on YARN-9421: -- [~adam.antal]: Coming back to your corner case: As

[jira] [Comment Edited] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

2019-04-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808567#comment-16808567 ] Szilard Nemeth edited comment on YARN-9421 at 4/3/19 10:05 AM: ---

[jira] [Commented] (YARN-9430) Recovering containers does not check available resources on node

2019-04-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808578#comment-16808578 ] Szilard Nemeth commented on YARN-9430: -- As per our further discussion with [~wilfreds], we need to

[jira] [Commented] (YARN-9436) Flaky test testApplicationLifetimeMonitor

2019-04-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808805#comment-16808805 ] Peter Bacsko commented on YARN-9436: Whoah, thanks [~Prabhu Joseph] - yes it's exactly the same. I'm

[jira] [Commented] (YARN-5670) Add support for Docker image clean up

2019-04-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809338#comment-16809338 ] Eric Yang commented on YARN-5670: - In today's YARN Docker meeting, there is consensus on using Node

[jira] [Commented] (YARN-9254) Externalize Solr data storage

2019-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809154#comment-16809154 ] Hadoop QA commented on YARN-9254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9254) Externalize Solr data storage

2019-04-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9254: Attachment: YARN-9254.002.patch > Externalize Solr data storage > - > >

[jira] [Assigned] (YARN-9254) Externalize Solr data storage

2019-04-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9254: --- Assignee: Eric Yang > Externalize Solr data storage > - > >

[jira] [Updated] (YARN-9254) Externalize Solr data storage

2019-04-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9254: Attachment: YARN-9254.001.patch > Externalize Solr data storage > - > >

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808801#comment-16808801 ] Prabhu Joseph commented on YARN-9080: - Thanks [~snemeth] and [~pbacsko] for the detailed explanation.

[jira] [Commented] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

2019-04-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808945#comment-16808945 ] Eric Yang commented on YARN-9421: - [~snemeth] SLA are predefined time window that a program is allowed to

[jira] [Created] (YARN-9436) Flaky test testApplicationLifetimeMonitor

2019-04-03 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9436: -- Summary: Flaky test testApplicationLifetimeMonitor Key: YARN-9436 URL: https://issues.apache.org/jira/browse/YARN-9436 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9436) Flaky test testApplicationLifetimeMonitor

2019-04-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808803#comment-16808803 ] Prabhu Joseph commented on YARN-9436: - [~pbacsko] I think this issue will be fixed by YARN-9404. Can

[jira] [Resolved] (YARN-9436) Flaky test testApplicationLifetimeMonitor

2019-04-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9436. Resolution: Duplicate > Flaky test testApplicationLifetimeMonitor >

[jira] [Updated] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

2019-04-03 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9435: Attachment: YARN-9435.003.patch > Add Opportunistic Scheduler metrics in ResourceManager. >

[jira] [Commented] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

2019-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808951#comment-16808951 ] Hadoop QA commented on YARN-9435: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9303) Username splits won't help timelineservice.app_flow table

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809392#comment-16809392 ] Vrushali C commented on YARN-9303: -- +1 to patch v1. I am reviewing the other patch. But this one is

[jira] [Commented] (YARN-9303) Username splits won't help timelineservice.app_flow table

2019-04-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809497#comment-16809497 ] Prabhu Joseph commented on YARN-9303: - Thanks [~vrushalic] for reviewing. > Username splits won't

[jira] [Commented] (YARN-9254) Externalize Solr data storage

2019-04-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809341#comment-16809341 ] Hadoop QA commented on YARN-9254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-8466) Add Chaos Monkey unit test framework for feature validation in scale

2019-04-03 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora reassigned YARN-8466: Assignee: Yesha Vora > Add Chaos Monkey unit test framework for feature validation in scale >

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809385#comment-16809385 ] Vrushali C commented on YARN-9335: -- Thanks for the patch v3 Abhishek, lgtm. Will commit shortly >

[jira] [Created] (YARN-9438) launchTime not written to state store for running applications

2019-04-03 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-9438: --- Summary: launchTime not written to state store for running applications Key: YARN-9438 URL: https://issues.apache.org/jira/browse/YARN-9438 Project: Hadoop YARN

[jira] [Commented] (YARN-9394) Use new API of RackResolver to get better performance

2019-04-03 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809476#comment-16809476 ] Lantao Jin commented on YARN-9394: -- Attache [^YARN-9394.003.patch] to address checkstyle. > Use new API

[jira] [Updated] (YARN-9394) Use new API of RackResolver to get better performance

2019-04-03 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-9394: - Attachment: YARN-9394.003.patch > Use new API of RackResolver to get better performance >

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809387#comment-16809387 ] Vrushali C commented on YARN-9382: -- thanks Abhishek, patch v2 looks good. Will commit it shortly >

[jira] [Commented] (YARN-9373) HBaseTimelineSchemaCreator has to allow user to configure pre-splits

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809390#comment-16809390 ] Vrushali C commented on YARN-9373: -- Thanks Prabhu, overall patch v2 looks good. I want to look at it a

[jira] [Created] (YARN-9437) RMNodeImpls occupy too much memory and causes RM GC to take a long time

2019-04-03 Thread qiuliang (JIRA)
qiuliang created YARN-9437: -- Summary: RMNodeImpls occupy too much memory and causes RM GC to take a long time Key: YARN-9437 URL: https://issues.apache.org/jira/browse/YARN-9437 Project: Hadoop YARN

[jira] [Updated] (YARN-9303) Username splits won't help timelineservice.app_flow table

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9303: - Labels: atsv2 atsv2-hbase (was: atsv2) > Username splits won't help timelineservice.app_flow table >

[jira] [Updated] (YARN-9303) Username splits won't help timelineservice.app_flow table

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9303: - Labels: atsv2 (was: ) > Username splits won't help timelineservice.app_flow table >

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-03 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809536#comment-16809536 ] Abhishek Modi commented on YARN-9382: - Thanks Vrushali - let me check at my end. > Publish container

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809527#comment-16809527 ] Vrushali C commented on YARN-9382: -- Hi Abhishek, I am somehow not able to apply the patch (with p0 or

[jira] [Updated] (YARN-9303) Username splits won't help timelineservice.app_flow table

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9303: - Fix Version/s: 3.3.0 > Username splits won't help timelineservice.app_flow table >

[jira] [Commented] (YARN-9408) @Path("/apps/{appid}/appattempts") error message misleads

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809525#comment-16809525 ] Vrushali C commented on YARN-9408: -- Hmm, so I am trying understand this error. Looks like it may be

[jira] [Commented] (YARN-9403) GET /apps/{appid}/entities/YARN_APPLICATION accesses application table instead of entity table

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809526#comment-16809526 ] Vrushali C commented on YARN-9403: -- I am not sure I understand the issue correctly. For YARN_APPLICATIOn

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-03 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809539#comment-16809539 ] Abhishek Modi commented on YARN-9335: - Thanks [~vrushalic]. I will check at my end.  Let me also run

[jira] [Commented] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809538#comment-16809538 ] Vrushali C commented on YARN-3488: -- Hi Abhishek Yes I will try to get to this soon. > AM get timeline

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809528#comment-16809528 ] Vrushali C commented on YARN-9335: -- Hi Abhishek, Could you check applying this patch as well? It seems to

[jira] [Updated] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

2019-04-03 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-4901: - Summary: QueueMetrics needs to be cleared before MockRM is initialized (was: MockRM should clear

[jira] [Commented] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

2019-04-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808733#comment-16808733 ] Hudson commented on YARN-4901: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16334 (See

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-03 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808747#comment-16808747 ] Peter Bacsko commented on YARN-9080: I'd like to join Szilard in suggesting making the code more

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-03 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808714#comment-16808714 ] Szilard Nemeth commented on YARN-9080: -- Hi [~Prabhu Joseph]! Here are my comments: 1. The depth of