[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813674#comment-16813674 ] Giovanni Matteo Fumarola commented on YARN-999: --- Committed to trunk. > In case of long

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813683#comment-16813683 ] Hudson commented on YARN-999: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #16367 (See

[jira] [Commented] (YARN-9435) Add Opportunistic Scheduler metrics in ResourceManager.

[ https://issues.apache.org/jira/browse/YARN-9435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813679#comment-16813679 ] Giovanni Matteo Fumarola commented on YARN-9435: Thanks [~abmodi] for the patch. Why do

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813826#comment-16813826 ] Giovanni Matteo Fumarola commented on YARN-999: --- Committed the addendum to trunk. Thanks

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813733#comment-16813733 ] Steve Loughran commented on YARN-999: - I think this has broken the build {code} [INFO]

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813811#comment-16813811 ] Íñigo Goiri commented on YARN-999: -- Compiled locally. Let's go with [^YARN-999.addendum.patch]. > In case

[jira] [Updated] (YARN-9466) App catalog navigation stylesheet does not display correctly in Safari

[ https://issues.apache.org/jira/browse/YARN-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9466: Attachment: YARN-9466.001.patch > App catalog navigation stylesheet does not display correctly in Safari >

[jira] [Commented] (YARN-9463) Add queueName info when failing with queue capacity sanity check

[ https://issues.apache.org/jira/browse/YARN-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813843#comment-16813843 ] Hadoop QA commented on YARN-9463: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813752#comment-16813752 ] Íñigo Goiri commented on YARN-999: -- Do you prefer addendum or a new JIRA? > In case of long running

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813740#comment-16813740 ] Giovanni Matteo Fumarola commented on YARN-999: --- Thanks [~ste...@apache.org], we are fixing

[jira] [Created] (YARN-9466) App catalog navigation stylesheet does not display correctly in Safari

Eric Yang created YARN-9466: --- Summary: App catalog navigation stylesheet does not display correctly in Safari Key: YARN-9466 URL: https://issues.apache.org/jira/browse/YARN-9466 Project: Hadoop YARN

[jira] [Updated] (YARN-9466) App catalog navigation stylesheet does not display correctly in Safari

[ https://issues.apache.org/jira/browse/YARN-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9466: Attachment: catalog-chrome.png > App catalog navigation stylesheet does not display correctly in Safari >

[jira] [Updated] (YARN-9466) App catalog navigation stylesheet does not display correctly in Safari

[ https://issues.apache.org/jira/browse/YARN-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9466: Attachment: catalog-safari.png > App catalog navigation stylesheet does not display correctly in Safari >

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813900#comment-16813900 ] Hudson commented on YARN-999: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #16369 (See

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813676#comment-16813676 ] Íñigo Goiri commented on YARN-999: -- Thank you very much [~giovanni.fumarola]! > In case of long running

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813797#comment-16813797 ] Eric Badger commented on YARN-9379: --- Thanks for the update, [~caozhiqiang]. The findbugs is indeed

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813795#comment-16813795 ] Giovanni Matteo Fumarola commented on YARN-999: --- The addendum looks ok. Should we commit to

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813822#comment-16813822 ] Hadoop QA commented on YARN-6929: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-999: -- Fix Version/s: 3.3.0 > In case of long running tasks, reduce node resource

[jira] [Reopened] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reopened YARN-999: - > In case of long running tasks, reduce node resource should balloon out > resource quickly by

[jira] [Commented] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813745#comment-16813745 ] Steve Loughran commented on YARN-999: - no worries, gone back one commit locally > In case of long

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813737#comment-16813737 ] Hadoop QA commented on YARN-9464: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-999) In case of long running tasks, reduce node resource should balloon out resource quickly by calling preemption API and suspending running task.

[ https://issues.apache.org/jira/browse/YARN-999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-999: - Attachment: YARN-999.addendum.patch > In case of long running tasks, reduce node resource should balloon

[jira] [Created] (YARN-9467) TestCapacitySchedulerNodeLabelUpdate.testResourceUsageWhenNodeUpdatesPartition fails intermittent

Prabhu Joseph created YARN-9467: --- Summary: TestCapacitySchedulerNodeLabelUpdate.testResourceUsageWhenNodeUpdatesPartition fails intermittent Key: YARN-9467 URL: https://issues.apache.org/jira/browse/YARN-9467

[jira] [Commented] (YARN-9466) App catalog navigation stylesheet does not display correctly in Safari

[ https://issues.apache.org/jira/browse/YARN-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813920#comment-16813920 ] Hadoop QA commented on YARN-9466: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813997#comment-16813997 ] Tao Yang commented on YARN-9439: Hi, [~cheersyang]. Findbugs warnings are not related to this patch. They

[jira] [Updated] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9464: Attachment: YARN-9464-002.patch > Support "Pending Resource" metrics in RM's RESTful API >

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814000#comment-16814000 ] caozhiqiang commented on YARN-9379: --- OK, your suggest is very good, and I will follow it. Thank you! >

[jira] [Updated] (YARN-9440) Improve diagnostics for scheduler and app activities

[ https://issues.apache.org/jira/browse/YARN-9440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9440: --- Attachment: YARN-9440.001.patch > Improve diagnostics for scheduler and app activities >

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814031#comment-16814031 ] Prabhu Joseph commented on YARN-9464: - [~tangzhankun] Failed test cases are not related - have

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814033#comment-16814033 ] Prabhu Joseph commented on YARN-6929: - Build Failure is due to YARN-999 and fixed in the

[jira] [Updated] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-6929: Attachment: YARN-6929-009.patch > yarn.nodemanager.remote-app-log-dir structure is not scalable >

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813038#comment-16813038 ] Zhankun Tang commented on YARN-9464: [~Prabhu Joseph] , Sure. Thanks for taking this. > Support

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813063#comment-16813063 ] Hadoop QA commented on YARN-9379: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9379) Can't specify docker runtime through environment

[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] caozhiqiang updated YARN-9379: -- Target Version/s: (was: 3.2.1) > Can't specify docker runtime through environment >

[jira] [Commented] (YARN-9379) Can't specify docker runtime through environment

[ https://issues.apache.org/jira/browse/YARN-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813113#comment-16813113 ] caozhiqiang commented on YARN-9379: --- Hello, [~ebadger], hadoopqa show findbugs in 

[jira] [Assigned] (YARN-950) Ability to limit or avoid aggregating logs beyond a certain size

[ https://issues.apache.org/jira/browse/YARN-950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-950: --- Assignee: Adam Antal > Ability to limit or avoid aggregating logs beyond a certain size >

[jira] [Commented] (YARN-9443) Fast RM Failover using Ratis (Raft protocol)

[ https://issues.apache.org/jira/browse/YARN-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813127#comment-16813127 ] Prabhu Joseph commented on YARN-9443: - [~adam.antal] Thanks for checking this one. Have planned to

[jira] [Commented] (YARN-9433) Remove unused constants from RMAuditLogger

[ https://issues.apache.org/jira/browse/YARN-9433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813355#comment-16813355 ] Igor Rudenko commented on YARN-9433: Regarding to hadoop-yetus

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813406#comment-16813406 ] Hadoop QA commented on YARN-8920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6356) Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs

[ https://issues.apache.org/jira/browse/YARN-6356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-6356: Assignee: Adam Antal > Allow different values of yarn.log-aggregation.retain-seconds for succeeded

[jira] [Commented] (YARN-8920) LogAggregation should be configurable to allow writing to underlying storage as appOwner or yarn user

[ https://issues.apache.org/jira/browse/YARN-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813320#comment-16813320 ] Adam Antal commented on YARN-8920: -- Hi [~suma.shivaprasad], Are you still working on this issue? >

[jira] [Commented] (YARN-9102) Log Aggregation is failing with S3A FileSystem for IFile Format

[ https://issues.apache.org/jira/browse/YARN-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813330#comment-16813330 ] Adam Antal commented on YARN-9102: -- Could you please provide us with a full stack trace

[jira] [Updated] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9464: Description: Knowing only the "available", "used" resource is not enough for YARN management tools

[jira] [Commented] (YARN-7282) Shared Cache Phase 2

[ https://issues.apache.org/jira/browse/YARN-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813446#comment-16813446 ] Laurenceau Julien commented on YARN-7282: - Hi, Any chance to extend (in the long term) this Yarn

[jira] [Updated] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9464: Attachment: YARN-9464-001.patch > Support "Pending Resource" metrics in RM's RESTful API >

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813460#comment-16813460 ] Prabhu Joseph commented on YARN-9464: - [~tangzhankun] Have updated pending resource for Cluster

[jira] [Created] (YARN-9465) Support to alter table properties in HBaseTimelineSchemaCreator

Tarun Parimi created YARN-9465: -- Summary: Support to alter table properties in HBaseTimelineSchemaCreator Key: YARN-9465 URL: https://issues.apache.org/jira/browse/YARN-9465 Project: Hadoop YARN

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813531#comment-16813531 ] Hadoop QA commented on YARN-9439: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813306#comment-16813306 ] Tao Yang commented on YARN-9439: Attached v3 patch to fix UT errors. > Support asynchronized scheduling

[jira] [Updated] (YARN-9439) Support asynchronized scheduling mode and multi-node lookup mechanism for app activities

[ https://issues.apache.org/jira/browse/YARN-9439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9439: --- Attachment: YARN-9439.003.patch > Support asynchronized scheduling mode and multi-node lookup mechanism for

[jira] [Commented] (YARN-7848) Force removal of docker containers that do not get removed on first try

[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813627#comment-16813627 ] Eric Yang commented on YARN-7848: - [~ebadger] [~Jim_Brennan] The failed unit test is not related to patch

[jira] [Updated] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-6929: Attachment: YARN-6929-008.patch > yarn.nodemanager.remote-app-log-dir structure is not scalable >

[jira] [Commented] (YARN-9463) Add queueName info when failing with queue capacity sanity check

[ https://issues.apache.org/jira/browse/YARN-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813645#comment-16813645 ] Aihua Xu commented on YARN-9463: Simple fix: the error will print out queue info as well now. > Add

[jira] [Updated] (YARN-9463) Add queueName info when failing with queue capacity sanity check

[ https://issues.apache.org/jira/browse/YARN-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aihua Xu updated YARN-9463: --- Attachment: YARN-9463.1.patch > Add queueName info when failing with queue capacity sanity check >

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813661#comment-16813661 ] Prabhu Joseph commented on YARN-6929: - [~pbacsko] Thanks for reviewing. Have attached 008 patch