[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810524#comment-16810524 ] Abhishek Modi commented on YARN-9382: - None of the findbugs warning are related to this patch. >

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810657#comment-16810657 ] Prabhu Joseph commented on YARN-6929: - [~snemeth] [~pbacsko] [~eyang] Can you review this jira when

[jira] [Updated] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9133: - Attachment: YARN-9133.006.patch > Make tests more easy to comprehend in TestGpuResourceHandler >

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9127: - Attachment: YARN-9127.003.patch > Create more tests to verify GpuDeviceInformationParser >

[jira] [Created] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Gergely Pollak (JIRA)
Gergely Pollak created YARN-9444: Summary: YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type Key: YARN-9444 URL:

[jira] [Resolved] (YARN-8647) Add a flag to disable move app between queues

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi resolved YARN-8647. - Resolution: Won't Fix > Add a flag to disable move app between queues >

[jira] [Updated] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Gergely Pollak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-9444: - Attachment: (was: YARN-9444.001.patch) > YARN Api Resource Utils's

[jira] [Updated] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Gergely Pollak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak updated YARN-9444: - Attachment: YARN-9444.001.patch > YARN Api Resource Utils's getRequestedResourcesFromConfig

[jira] [Commented] (YARN-9050) [Umbrella] Usability improvements for scheduler activities

2019-04-05 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810691#comment-16810691 ] Adam Antal commented on YARN-9050: -- Hi, I just came across this jira, and looked into the design doc you

[jira] [Commented] (YARN-7769) FS QueueManager should not create default queue at init

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810720#comment-16810720 ] Szilard Nemeth commented on YARN-7769: -- Hi [~wilfreds]! YARN-8951 is blocked on this. Any chance that

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9134: - Attachment: YARN-9134.002.patch > No test coverage for redefining FPGA / GPU resource types in

[jira] [Comment Edited] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Gergely Pollak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810751#comment-16810751 ] Gergely Pollak edited comment on YARN-9444 at 4/5/19 12:19 PM: --- My proposed

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810725#comment-16810725 ] Hadoop QA commented on YARN-6929: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9098) Separate mtab file reader code and cgroups file system hierarchy parser code from CGroupsHandlerImpl and ResourceHandlerModule

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9098: - Attachment: YARN-9098.008.patch > Separate mtab file reader code and cgroups file system

[jira] [Commented] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810791#comment-16810791 ] Hadoop QA commented on YARN-9096: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-9443) Fast RM Failover using Ratis (Raft protocol)

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph reassigned YARN-9443: --- Assignee: Prabhu Joseph > Fast RM Failover using Ratis (Raft protocol) >

[jira] [Updated] (YARN-9096) Some GpuResourcePlugin and ResourcePluginManager methods are synchronized unnecessarily

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9096: - Attachment: YARN-9096.002.patch > Some GpuResourcePlugin and ResourcePluginManager methods are

[jira] [Updated] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9135: - Attachment: YARN-9135.005.patch > NM State store ResourceMappings serialization are tested with

[jira] [Assigned] (YARN-9445) yarn.admin.acl is futile

2019-04-05 Thread Gergely Pollak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Pollak reassigned YARN-9445: Assignee: Gergely Pollak > yarn.admin.acl is futile > > >

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810814#comment-16810814 ] Hadoop QA commented on YARN-9127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9444: - Description: The original issue was the jobclient test did not send the requested resource type,

[jira] [Commented] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810826#comment-16810826 ] Szilard Nemeth commented on YARN-9444: -- Hi [~shuzirra]! Thanks for the patch! Few comments: 1. You

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-05 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810890#comment-16810890 ] Peter Bacsko commented on YARN-9080: Thanks for updating the patch [~Prabhu Joseph]. This is much

[jira] [Commented] (YARN-9445) yarn.admin.acl is futile

2019-04-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810922#comment-16810922 ] Szilard Nemeth commented on YARN-9445: -- Hi [~shuzirra]! Some comments: In

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810945#comment-16810945 ] Hadoop QA commented on YARN-9135: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-3488: Attachment: YARN-3488.004.patch > AM get timeline service info from RM rather than Application

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811033#comment-16811033 ] Eric Yang commented on YARN-9442: - [~Jim_Brennan] I got the patch working with terasort. I was puzzled

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810836#comment-16810836 ] Hadoop QA commented on YARN-9134: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9446) TestMiniMRClientCluster.testRestart is flaky

2019-04-05 Thread Peter Bacsko (JIRA)
Peter Bacsko created YARN-9446: -- Summary: TestMiniMRClientCluster.testRestart is flaky Key: YARN-9446 URL: https://issues.apache.org/jira/browse/YARN-9446 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9447: Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > RM Crashes with NPE at

[jira] [Commented] (YARN-9444) YARN Api Resource Utils's getRequestedResourcesFromConfig doesn't recognise yarn.io/gpu as a valid resource type

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810875#comment-16810875 ] Hadoop QA commented on YARN-9444: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-04-05 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811011#comment-16811011 ] Jim Brennan commented on YARN-9442: --- I have put up patch.002 which adds a check to the 

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810912#comment-16810912 ] Hadoop QA commented on YARN-9133: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810986#comment-16810986 ] Eric Yang commented on YARN-6929: - If I understand the patch correctly,

[jira] [Updated] (YARN-9442) container working directory has group read permissions

2019-04-05 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-9442: -- Attachment: YARN-9442.002.patch > container working directory has group read permissions >

[jira] [Created] (YARN-9445) yarn.admin.acl is futile

2019-04-05 Thread Peter Simon (JIRA)
Peter Simon created YARN-9445: - Summary: yarn.admin.acl is futile Key: YARN-9445 URL: https://issues.apache.org/jira/browse/YARN-9445 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-9098) Separate mtab file reader code and cgroups file system hierarchy parser code from CGroupsHandlerImpl and ResourceHandlerModule

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810802#comment-16810802 ] Hadoop QA commented on YARN-9098: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-05 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9447: --- Summary: RM Crashes with NPE at TimelineServiceV2Publisher.putEntity Key: YARN-9447 URL: https://issues.apache.org/jira/browse/YARN-9447 Project: Hadoop YARN

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

2019-04-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810949#comment-16810949 ] Eric Badger commented on YARN-9379: --- Thanks for the patch update, [~caozhiqiang]! It looks like the unit

[jira] [Commented] (YARN-7848) Force removal of docker containers that do not get removed on first try

2019-04-05 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16810951#comment-16810951 ] Eric Badger commented on YARN-7848: --- We talked about the use of {{-f}} in our most recent docker meeting

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-04-05 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811021#comment-16811021 ] Jim Brennan commented on YARN-9442: --- {quote} I think the group read permission is used by shuffle

[jira] [Commented] (YARN-9445) yarn.admin.acl is futile

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811062#comment-16811062 ] Eric Yang commented on YARN-9445: - [~shuzirra] Thank you for the patch. From code logic point of view,

[jira] [Updated] (YARN-9254) Externalize Solr data storage

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9254: Attachment: YARN-9254.004.patch > Externalize Solr data storage > - > >

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-04-05 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811131#comment-16811131 ] Jim Brennan commented on YARN-9442: --- [~eyang] thanks for testing!  I also ran terasort as part of my

[jira] [Updated] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9447: Attachment: YARN-9447-001.patch > RM Crashes with NPE at TimelineServiceV2Publisher.putEntity >

[jira] [Created] (YARN-9449) Non-exclusive labels can create reservation loop on cluster without unlabeled node

2019-04-05 Thread Brandon Scheller (JIRA)
Brandon Scheller created YARN-9449: -- Summary: Non-exclusive labels can create reservation loop on cluster without unlabeled node Key: YARN-9449 URL: https://issues.apache.org/jira/browse/YARN-9449

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811143#comment-16811143 ] Prabhu Joseph commented on YARN-6929: - Thanks [~eyang] for detailed review. Working on it, will update

[jira] [Updated] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9080: Attachment: YARN-9080-008.patch > Bucket Directories as part of ATS done accumulates >

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811160#comment-16811160 ] Prabhu Joseph commented on YARN-9080: - Thanks [~pbacsko] for reviewing again. Attached 008 patch

[jira] [Comment Edited] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811171#comment-16811171 ] Giovanni Matteo Fumarola edited comment on YARN-999 at 4/5/19 7:06 PM:

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-05 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811176#comment-16811176 ] Vrushali C commented on YARN-9335: -- Thanks for updating the patch Abhishek!. Committing v4 shortly >

[jira] [Updated] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-05 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9382: - Labels: atsv2 (was: ) > Publish container killed, paused and resumed events to ATSv2. >

[jira] [Updated] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-05 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-999: - Attachment: YARN-999.010.patch > In case of long running tasks, reduce node resource should balloon out >

[jira] [Updated] (YARN-9449) Non-exclusive labels can create reservation loop on cluster without unlabeled node

2019-04-05 Thread Brandon Scheller (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Scheller updated YARN-9449: --- Description: https://issues.apache.org/jira/browse/YARN-5342 Added a counter to Yarn so that

[jira] [Updated] (YARN-9449) Non-exclusive labels can create reservation loop on cluster without unlabeled node

2019-04-05 Thread Brandon Scheller (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Scheller updated YARN-9449: --- Description: https://issues.apache.org/jira/browse/YARN-5342 Added a counter to Yarn so that

[jira] [Comment Edited] (YARN-9445) yarn.admin.acl is futile

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811062#comment-16811062 ] Eric Yang edited comment on YARN-9445 at 4/5/19 5:16 PM: - [~shuzirra] Thank you

[jira] [Created] (YARN-9448) Fix Opportunistic Scheduling for node local allocations.

2019-04-05 Thread Abhishek Modi (JIRA)
Abhishek Modi created YARN-9448: --- Summary: Fix Opportunistic Scheduling for node local allocations. Key: YARN-9448 URL: https://issues.apache.org/jira/browse/YARN-9448 Project: Hadoop YARN

[jira] [Commented] (YARN-9445) yarn.admin.acl is futile

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811078#comment-16811078 ] Hadoop QA commented on YARN-9445: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-05 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811161#comment-16811161 ] Vrushali C commented on YARN-9382: -- Thanks Abhishek! Committing v03 shortly > Publish container killed,

[jira] [Commented] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811166#comment-16811166 ] Abhishek Modi commented on YARN-3488: - Attached a new patch after merging with trunk. > AM get

[jira] [Commented] (YARN-7848) Force removal of docker containers that do not get removed on first try

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811188#comment-16811188 ] Eric Yang commented on YARN-7848: - Patch 002 added the force option to cmd file, and invoke from Java

[jira] [Commented] (YARN-8551) Build Common module for MaWo application

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811232#comment-16811232 ] Eric Yang commented on YARN-8551: - [~yeshavora] Thank you for the patch 016. A few nitpicks: # Add to

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811171#comment-16811171 ] Giovanni Matteo Fumarola commented on YARN-999: --- Thanks [~elgoiri] for the hard work to add

[jira] [Updated] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-05 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-9335: - Labels: atvs (was: ) > [atsv2] Restrict the number of elements held in timeline collector when >

[jira] [Updated] (YARN-7848) Force removal of docker containers that do not get removed on first try

2019-04-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7848: Attachment: YARN-7848.002.patch > Force removal of docker containers that do not get removed on first try >

[jira] [Updated] (YARN-9437) RMNodeImpls occupy too much memory and causes RM GC to take a long time

2019-04-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-9437: --- Priority: Minor (was: Blocker) > RMNodeImpls occupy too much memory and

[jira] [Commented] (YARN-9080) Bucket Directories as part of ATS done accumulates

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811345#comment-16811345 ] Hadoop QA commented on YARN-9080: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7848) Force removal of docker containers that do not get removed on first try

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811375#comment-16811375 ] Hadoop QA commented on YARN-7848: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-05 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811353#comment-16811353 ] Íñigo Goiri commented on YARN-999: -- Thanks [~giovanni.fumarola] for the review. I target all of them

[jira] [Commented] (YARN-9254) Externalize Solr data storage

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811322#comment-16811322 ] Hadoop QA commented on YARN-9254: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9448) Fix Opportunistic Scheduling for node local allocations.

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811323#comment-16811323 ] Hadoop QA commented on YARN-9448: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9442) container working directory has group read permissions

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811324#comment-16811324 ] Hadoop QA commented on YARN-9442: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811370#comment-16811370 ] Hadoop QA commented on YARN-9447: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811272#comment-16811272 ] Hudson commented on YARN-9382: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16355 (See

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811273#comment-16811273 ] Hudson commented on YARN-9335: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16355 (See

[jira] [Commented] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811371#comment-16811371 ] Hadoop QA commented on YARN-3488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3488) AM get timeline service info from RM rather than Application specific configuration.

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811452#comment-16811452 ] Abhishek Modi commented on YARN-3488: - Findbugs warnings are not related to this patch. > AM get

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-05 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811459#comment-16811459 ] Íñigo Goiri commented on YARN-999: -- The tests run fine and in less than 30 seconds each: *

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

2019-04-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811411#comment-16811411 ] Hadoop QA commented on YARN-999: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9382) Publish container killed, paused and resumed events to ATSv2.

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811445#comment-16811445 ] Abhishek Modi commented on YARN-9382: - Thanks [~vrushalic] for reviewing and committing it. > Publish

[jira] [Commented] (YARN-9335) [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls

2019-04-05 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811444#comment-16811444 ] Abhishek Modi commented on YARN-9335: - Thanks [~vrushalic] for review and committing it.  > [atsv2]

[jira] [Commented] (YARN-9447) RM Crashes with NPE at TimelineServiceV2Publisher.putEntity

2019-04-05 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16811454#comment-16811454 ] Prabhu Joseph commented on YARN-9447: - The Null check for timeline collector is done in other places

[jira] [Updated] (YARN-8551) Build Common module for MaWo application

2019-04-05 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8551: - Attachment: YARN-8551.0017.patch > Build Common module for MaWo application >

[jira] [Created] (YARN-9450) TestCapacityOverTimePolicy#testAllocation fails sporadically

2019-04-05 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9450: --- Summary: TestCapacityOverTimePolicy#testAllocation fails sporadically Key: YARN-9450 URL: https://issues.apache.org/jira/browse/YARN-9450 Project: Hadoop YARN