[jira] [Commented] (YARN-9403) GET /apps/{appid}/entities/YARN_APPLICATION accesses application table instead of entity table

[ https://issues.apache.org/jira/browse/YARN-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809557#comment-16809557 ] Prabhu Joseph commented on YARN-9403: - Thanks [~vrushalic] for reviewing this. The re

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Description: [Design doc|https://docs.google.com/document/d/1pwf-n3BCLW76bGrmNPM4T6pQ3vC4dVMcN2Ud1hq1t2M/edit#

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Description: [Design doc|https://docs.google.com/document/d/1pwf-n3BCLW76bGrmNPM4T6pQ3vC4dVMcN2Ud1hq1t2M/edit#

[jira] [Created] (YARN-9440) Improve diagnostics for scheduler and app activities

Tao Yang created YARN-9440: -- Summary: Improve diagnostics for scheduler and app activities Key: YARN-9440 URL: https://issues.apache.org/jira/browse/YARN-9440 Project: Hadoop YARN Issue Type: Sub-ta

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.001.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for ap

[jira] [Updated] (YARN-9437) RMNodeImpls occupy too much memory and causes RM GC to take a long time

[ https://issues.apache.org/jira/browse/YARN-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qiuliang updated YARN-9437: --- Description: We use hadoop-2.9.1 in our production environment with 1600+ nodes. 95.63% of RM memory is occupi

[jira] [Created] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

Tao Yang created YARN-9439: -- Summary: Support asynchronized scheduling mode and multi-node lookup mechanism for app activities Key: YARN-9439 URL: https://issues.apache.org/jira/browse/YARN-9439 Project: Had

[jira] [Commented] (YARN-9303) Username splits won't help timelineservice.app_flow table

[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809545#comment-16809545 ] Prabhu Joseph commented on YARN-9303: - Thanks [~vrushalic]! > Username splits won't h

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809539#comment-16809539 ] Abhishek Modi commented on YARN-9335: - Thanks [~vrushalic]. I will check at my end. 

[jira] [Commented] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809538#comment-16809538 ] Vrushali C commented on YARN-3488: -- Hi Abhishek Yes I will try to get to this soon. > A

[jira] [Updated] (YARN-9303) Username splits won't help timelineservice.app_flow table

[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9303: - Labels: atsv2 atsv2-hbase (was: atsv2) > Username splits won't help timelineservice.app_flow table >

[jira] [Updated] (YARN-9303) Username splits won't help timelineservice.app_flow table

[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9303: - Labels: atsv2 (was: ) > Username splits won't help timelineservice.app_flow table > -

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809536#comment-16809536 ] Abhishek Modi commented on YARN-9382: - Thanks Vrushali - let me check at my end. > Pu

[jira] [Updated] (YARN-9303) Username splits won't help timelineservice.app_flow table

[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9303: - Fix Version/s: 3.3.0 > Username splits won't help timelineservice.app_flow table > ---

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809528#comment-16809528 ] Vrushali C commented on YARN-9335: -- Hi Abhishek, Could you check applying this patch as w

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809527#comment-16809527 ] Vrushali C commented on YARN-9382: -- Hi Abhishek, I am somehow not able to apply the patc

[jira] [Commented] (YARN-9403) GET /apps/{appid}/entities/YARN_APPLICATION accesses application table instead of entity table

[ https://issues.apache.org/jira/browse/YARN-9403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809526#comment-16809526 ] Vrushali C commented on YARN-9403: -- I am not sure I understand the issue correctly. For Y

[jira] [Commented] (YARN-9408) @Path("/apps/{appid}/appattempts") error message misleads

[ https://issues.apache.org/jira/browse/YARN-9408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809525#comment-16809525 ] Vrushali C commented on YARN-9408: -- Hmm, so I am trying understand this error. Looks like

[jira] [Commented] (YARN-9303) Username splits won't help timelineservice.app_flow table

[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809497#comment-16809497 ] Prabhu Joseph commented on YARN-9303: - Thanks [~vrushalic] for reviewing. > Username

[jira] [Commented] (YARN-9394) Use new API of RackResolver to get better performance

[ https://issues.apache.org/jira/browse/YARN-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809476#comment-16809476 ] Lantao Jin commented on YARN-9394: -- Attache [^YARN-9394.003.patch] to address checkstyle

[jira] [Updated] (YARN-9394) Use new API of RackResolver to get better performance

[ https://issues.apache.org/jira/browse/YARN-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-9394: - Attachment: YARN-9394.003.patch > Use new API of RackResolver to get better performance >

[jira] [Created] (YARN-9438) launchTime not written to state store for running applications

Jonathan Hung created YARN-9438: --- Summary: launchTime not written to state store for running applications Key: YARN-9438 URL: https://issues.apache.org/jira/browse/YARN-9438 Project: Hadoop YARN

[jira] [Created] (YARN-9437) RMNodeImpls occupy too much memory and causes RM GC to take a long time

qiuliang created YARN-9437: -- Summary: RMNodeImpls occupy too much memory and causes RM GC to take a long time Key: YARN-9437 URL: https://issues.apache.org/jira/browse/YARN-9437 Project: Hadoop YARN

[jira] [Commented] (YARN-9303) Username splits won't help timelineservice.app_flow table

[ https://issues.apache.org/jira/browse/YARN-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809392#comment-16809392 ] Vrushali C commented on YARN-9303: -- +1 to patch v1. I am reviewing the other patch. But t

[jira] [Commented] (YARN-9373) HBaseTimelineSchemaCreator has to allow user to configure pre-splits

[ https://issues.apache.org/jira/browse/YARN-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809390#comment-16809390 ] Vrushali C commented on YARN-9373: -- Thanks Prabhu, overall patch v2 looks good. I want to

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809387#comment-16809387 ] Vrushali C commented on YARN-9382: -- thanks Abhishek, patch v2 looks good. Will commit it

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809385#comment-16809385 ] Vrushali C commented on YARN-9335: -- Thanks for the patch v3 Abhishek, lgtm. Will commit s

[jira] [Assigned] (YARN-8466) Add Chaos Monkey unit test framework for feature validation in scale

[ https://issues.apache.org/jira/browse/YARN-8466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora reassigned YARN-8466: Assignee: Yesha Vora > Add Chaos Monkey unit test framework for feature validation in scale > -

[jira] [Commented] (YARN-9254) Externalize Solr data storage

[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809341#comment-16809341 ] Hadoop QA commented on YARN-9254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5670) Add support for Docker image clean up

[ https://issues.apache.org/jira/browse/YARN-5670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809338#comment-16809338 ] Eric Yang commented on YARN-5670: - In today's YARN Docker meeting, there is consensus on u

[jira] [Updated] (YARN-9254) Externalize Solr data storage

[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9254: Attachment: YARN-9254.002.patch > Externalize Solr data storage > - > >

[jira] [Commented] (YARN-9254) Externalize Solr data storage

[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16809154#comment-16809154 ] Hadoop QA commented on YARN-9254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-9254) Externalize Solr data storage

[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9254: --- Assignee: Eric Yang > Externalize Solr data storage > - > >

[jira] [Updated] (YARN-9254) Externalize Solr data storage

[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9254: Attachment: YARN-9254.001.patch > Externalize Solr data storage > - > >

[jira] [Commented] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808951#comment-16808951 ] Hadoop QA commented on YARN-9435: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808945#comment-16808945 ] Eric Yang commented on YARN-9421: - [~snemeth] SLA are predefined time window that a progra

[jira] [Resolved] (YARN-9436) Flaky test testApplicationLifetimeMonitor

[ https://issues.apache.org/jira/browse/YARN-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9436. Resolution: Duplicate > Flaky test testApplicationLifetimeMonitor >

[jira] [Commented] (YARN-9436) Flaky test testApplicationLifetimeMonitor

[ https://issues.apache.org/jira/browse/YARN-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808805#comment-16808805 ] Peter Bacsko commented on YARN-9436: Whoah, thanks [~Prabhu Joseph] - yes it's exactly

[jira] [Commented] (YARN-9436) Flaky test testApplicationLifetimeMonitor

[ https://issues.apache.org/jira/browse/YARN-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808803#comment-16808803 ] Prabhu Joseph commented on YARN-9436: - [~pbacsko] I think this issue will be fixed by

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808801#comment-16808801 ] Prabhu Joseph commented on YARN-9080: - Thanks [~snemeth] and [~pbacsko] for the detail

[jira] [Updated] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-9435: Attachment: YARN-9435.003.patch > Add Opportunistic Scheduler metrics in ResourceManager. >

[jira] [Created] (YARN-9436) Flaky test testApplicationLifetimeMonitor

Peter Bacsko created YARN-9436: -- Summary: Flaky test testApplicationLifetimeMonitor Key: YARN-9436 URL: https://issues.apache.org/jira/browse/YARN-9436 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808747#comment-16808747 ] Peter Bacsko commented on YARN-9080: I'd like to join Szilard in suggesting making the

[jira] [Commented] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808733#comment-16808733 ] Hudson commented on YARN-4901: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #163

[jira] [Updated] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-4901: - Summary: QueueMetrics needs to be cleared before MockRM is initialized (was: MockRM should clear

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808714#comment-16808714 ] Szilard Nemeth commented on YARN-9080: -- Hi [~Prabhu Joseph]! Here are my comments:

[jira] [Commented] (YARN-9430) Recovering containers does not check available resources on node

[ https://issues.apache.org/jira/browse/YARN-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808578#comment-16808578 ] Szilard Nemeth commented on YARN-9430: -- As per our further discussion with [~wilfreds

[jira] [Comment Edited] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808567#comment-16808567 ] Szilard Nemeth edited comment on YARN-9421 at 4/3/19 10:05 AM: -

[jira] [Commented] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808567#comment-16808567 ] Szilard Nemeth commented on YARN-9421: -- [~adam.antal]: Coming back to your corner cas

[jira] [Commented] (YARN-9421) Implement SafeMode for ResourceManager by defining a resource threshold

[ https://issues.apache.org/jira/browse/YARN-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808563#comment-16808563 ] Szilard Nemeth commented on YARN-9421: -- As per our further discussion with [~wilfreds

[jira] [Assigned] (YARN-9430) Recovering containers does not check available resources on node

[ https://issues.apache.org/jira/browse/YARN-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-9430: Assignee: (was: Szilard Nemeth) > Recovering containers does not check available resour

[jira] [Commented] (YARN-9281) Add express upgrade button to Appcatalog UI

[ https://issues.apache.org/jira/browse/YARN-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808557#comment-16808557 ] Adam Antal commented on YARN-9281: -- Thanks for taking care of the items, LGTM (non-bindin

[jira] [Commented] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808453#comment-16808453 ] Hadoop QA commented on YARN-9435: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9394) Use new API of RackResolver to get better performance

[ https://issues.apache.org/jira/browse/YARN-9394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16808423#comment-16808423 ] Hadoop QA commented on YARN-9394: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote