[jira] [Updated] (YARN-8456) Fix a bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable

[ https://issues.apache.org/jira/browse/YARN-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8456: --- Summary: Fix a bug when user leave FPGA discover executable path configuration default but set OpenCL

[jira] [Created] (YARN-8456) Fix a bug when user leave FPGA discover executable path configuration empty but set OpenCL SDK path environment variable

Zhankun Tang created YARN-8456: -- Summary: Fix a bug when user leave FPGA discover executable path configuration empty but set OpenCL SDK path environment variable Key: YARN-8456 URL:

[jira] [Assigned] (YARN-8456) Fix a bug when user leave FPGA discover executable path configuration empty but set OpenCL SDK path environment variable

[ https://issues.apache.org/jira/browse/YARN-8456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8456: -- Assignee: Zhankun Tang > Fix a bug when user leave FPGA discover executable path configuration

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Attachment: YARN-6672-YARN-1011.02.patch > Add NM preemption of opportunistic containers when utilization

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520973#comment-16520973 ] genericqa commented on YARN-6672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8423) GPU does not get released even though the application gets killed.

[ https://issues.apache.org/jira/browse/YARN-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520968#comment-16520968 ] Wangda Tan commented on YARN-8423: -- Thanks [~sunilg],  Overall looks good, except:  {code:java} 266

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Attachment: YARN-6672-YARN-1011.01.patch > Add NM preemption of opportunistic containers when utilization

[jira] [Commented] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520939#comment-16520939 ] Shane Kumpf commented on YARN-8326: --- Thank you for reporting the issue, [~hlhu...@us.ibm.com], and

[jira] [Commented] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520933#comment-16520933 ] genericqa commented on YARN-8452: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520916#comment-16520916 ] genericqa commented on YARN-6672: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520898#comment-16520898 ] Hudson commented on YARN-8326: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14469 (See

[jira] [Created] (YARN-8455) Add basic acl check for all TS v2 REST APIs

Rohith Sharma K S created YARN-8455: --- Summary: Add basic acl check for all TS v2 REST APIs Key: YARN-8455 URL: https://issues.apache.org/jira/browse/YARN-8455 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8103) Add CLI interface to query node attributes

[ https://issues.apache.org/jira/browse/YARN-8103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520880#comment-16520880 ] Naganarasimha G R commented on YARN-8103: - Thanks for the patch [~bibinchundatt], Sorry my bad had

[jira] [Commented] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520853#comment-16520853 ] Haibo Chen commented on YARN-6672: -- Attached a patch to do the NM periodical preemption. In the meantime,

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520852#comment-16520852 ] Subru Krishnan commented on YARN-8434: -- [~bibinchundatt], thanks for reporting this. I would like to

[jira] [Updated] (YARN-6672) Add NM preemption of opportunistic containers when utilization goes high

[ https://issues.apache.org/jira/browse/YARN-6672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6672: - Attachment: YARN-6672-YARN-1011.00.patch > Add NM preemption of opportunistic containers when utilization

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520822#comment-16520822 ] Eric Payne commented on YARN-4606: -- [~maniraj...@gmail.com], we can fix the queue application starvation

[jira] [Commented] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520819#comment-16520819 ] genericqa commented on YARN-8392: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4606: - Attachment: YARN-4606.POC.3.patch > CapacityScheduler: applications could get starved because computation

[jira] [Commented] (YARN-8427) Don't start opportunistic containers at container scheduler/finish event with over-allocation

[ https://issues.apache.org/jira/browse/YARN-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520817#comment-16520817 ] Haibo Chen commented on YARN-8427: -- Thanks [~szegedim] for your review! > Don't start opportunistic

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520815#comment-16520815 ] Miklos Szegedi commented on YARN-8438: -- I think it is legitimate that a code is fast. I would vote

[jira] [Updated] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8452: - Attachment: YARN-8452.000.patch > FairScheduler.update can take long time if >

[jira] [Assigned] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-8452: Assignee: Miklos Szegedi > FairScheduler.update can take long time if >

[jira] [Commented] (YARN-8454) WeightedLocalityPolicyManager should manage empty configurations

[ https://issues.apache.org/jira/browse/YARN-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520806#comment-16520806 ] Íñigo Goiri commented on YARN-8454: --- The full trace is: {code}

[jira] [Updated] (YARN-8454) WeightedLocalityPolicyManager should manage empty configurations

[ https://issues.apache.org/jira/browse/YARN-8454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-8454: -- Affects Version/s: 2.9.1 > WeightedLocalityPolicyManager should manage empty configurations >

[jira] [Created] (YARN-8454) WeightedLocalityPolicyManager should manage empty configurations

Íñigo Goiri created YARN-8454: - Summary: WeightedLocalityPolicyManager should manage empty configurations Key: YARN-8454 URL: https://issues.apache.org/jira/browse/YARN-8454 Project: Hadoop YARN

[jira] [Commented] (YARN-8184) Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator

[ https://issues.apache.org/jira/browse/YARN-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520798#comment-16520798 ] Hudson commented on YARN-8184: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14468 (See

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520790#comment-16520790 ] genericqa commented on YARN-8451: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8184) Too many metrics if containerLocalizer/ResourceLocalizationService uses ReadWriteDiskValidator

[ https://issues.apache.org/jira/browse/YARN-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520773#comment-16520773 ] Yufei Gu commented on YARN-8184: Committed to trunk. Thanks for the review, [~haibochen]. > Too many

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520772#comment-16520772 ] Szilard Nemeth commented on YARN-8438: -- Hi [~miklos.szeg...@cloudera.com]! To be honest, fixing the

[jira] [Assigned] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

[ https://issues.apache.org/jira/browse/YARN-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-8452: Assignee: (was: Szilard Nemeth) > FairScheduler.update can take long time if >

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520758#comment-16520758 ] Miklos Szegedi commented on YARN-8438: -- Thank you for the updated patch [~snemeth]. Why do not you

[jira] [Commented] (YARN-8423) GPU does not get released even though the application gets killed.

[ https://issues.apache.org/jira/browse/YARN-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520754#comment-16520754 ] genericqa commented on YARN-8423: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8392: - Attachment: YARN-8392.2.patch > Allow multiple tags for anti-affinity placement policy in service

[jira] [Commented] (YARN-8453) Allocation to a queue is dishonored if one resource is at the limit

[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520753#comment-16520753 ] Sunil Govindan commented on YARN-8453: -- cc / [~leftnoteasy] > Allocation to a queue is dishonored if

[jira] [Created] (YARN-8453) Allocation to a queue is dishonored if one resource is at the limit

Sunil Govindan created YARN-8453: Summary: Allocation to a queue is dishonored if one resource is at the limit Key: YARN-8453 URL: https://issues.apache.org/jira/browse/YARN-8453 Project: Hadoop YARN

[jira] [Created] (YARN-8452) FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on

Miklos Szegedi created YARN-8452: Summary: FairScheduler.update can take long time if yarn.scheduler.fair.sizebasedweight is on Key: YARN-8452 URL: https://issues.apache.org/jira/browse/YARN-8452

[jira] [Updated] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8451: --- Attachment: YARN-8451.v1.patch > Multiple NM heartbeat thread created when a slow NM resync with RM >

[jira] [Commented] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

[ https://issues.apache.org/jira/browse/YARN-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520727#comment-16520727 ] Botong Huang commented on YARN-8451: Here’s an example where more than one heartbeat thread is

[jira] [Created] (YARN-8451) Multiple NM heartbeat thread created when a slow NM resync with RM

Botong Huang created YARN-8451: -- Summary: Multiple NM heartbeat thread created when a slow NM resync with RM Key: YARN-8451 URL: https://issues.apache.org/jira/browse/YARN-8451 Project: Hadoop YARN

[jira] [Commented] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520719#comment-16520719 ] genericqa commented on YARN-8392: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520718#comment-16520718 ] genericqa commented on YARN-8326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8450) Blocking resources such as GPU/FPGA etc tend to release actual device slowly even after RM identifies it as COMPLETED

[ https://issues.apache.org/jira/browse/YARN-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8450: - Summary: Blocking resources such as GPU/FPGA etc tend to release actual device slowly even after

[jira] [Commented] (YARN-8423) GPU does not get released even though the application gets killed.

[ https://issues.apache.org/jira/browse/YARN-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520682#comment-16520682 ] Sunil Govindan commented on YARN-8423: -- Thanks [~vinodkv] Attaching new patch after addressing all

[jira] [Updated] (YARN-8423) GPU does not get released even though the application gets killed.

[ https://issues.apache.org/jira/browse/YARN-8423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8423: - Attachment: YARN-8423.002.patch > GPU does not get released even though the application gets

[jira] [Created] (YARN-8450) Blocking resources such as GPU/FPGA etc tend to release actual device even after RM identifies it as COMPLETED

Sunil Govindan created YARN-8450: Summary: Blocking resources such as GPU/FPGA etc tend to release actual device even after RM identifies it as COMPLETED Key: YARN-8450 URL:

[jira] [Commented] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520660#comment-16520660 ] Billie Rinaldi commented on YARN-8392: -- This patch removes the validation code in ServiceApiUtil that

[jira] [Updated] (YARN-8392) Allow multiple tags for anti-affinity placement policy in service specification

[ https://issues.apache.org/jira/browse/YARN-8392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-8392: - Attachment: YARN-8392.1.patch > Allow multiple tags for anti-affinity placement policy in service

[jira] [Commented] (YARN-8444) NodeResourceMonitor crashes on bad swapFree value

[ https://issues.apache.org/jira/browse/YARN-8444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520616#comment-16520616 ] Hudson commented on YARN-8444: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14463 (See

[jira] [Updated] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-8326: -- Attachment: YARN-8326.001.patch > Yarn 3.0 seems runs slower than Yarn 2.6 >

[jira] [Assigned] (YARN-8326) Yarn 3.0 seems runs slower than Yarn 2.6

[ https://issues.apache.org/jira/browse/YARN-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reassigned YARN-8326: - Assignee: Shane Kumpf > Yarn 3.0 seems runs slower than Yarn 2.6 >

[jira] [Commented] (YARN-8427) Don't start opportunistic containers at container scheduler/finish event with over-allocation

[ https://issues.apache.org/jira/browse/YARN-8427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520607#comment-16520607 ] Miklos Szegedi commented on YARN-8427: -- +1 LGTM. If there are no concerns, I will commit this

[jira] [Commented] (YARN-8444) NodeResourceMonitor crashes on bad swapFree value

[ https://issues.apache.org/jira/browse/YARN-8444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520597#comment-16520597 ] Eric Payne commented on YARN-8444: -- Thanks [~Jim_Brennan] for the work on this JIRA. +1. I will commit

[jira] [Commented] (YARN-8446) Support of managing multi-dimensional resources

[ https://issues.apache.org/jira/browse/YARN-8446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520585#comment-16520585 ] Sunil Govindan commented on YARN-8446: -- This looks very interesting. Thanks [~cheersyang] for filing

[jira] [Commented] (YARN-8047) RMWebApp make external class pluggable

[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520368#comment-16520368 ] genericqa commented on YARN-8047: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520316#comment-16520316 ] genericqa commented on YARN-8438: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8047) RMWebApp make external class pluggable

[ https://issues.apache.org/jira/browse/YARN-8047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-8047: Attachment: YARN-8047-002.patch > RMWebApp make external class pluggable >

[jira] [Updated] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8438: - Attachment: YARN-8438.005.patch > TestContainer.testKillOnNew flaky on trunk >

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520182#comment-16520182 ] genericqa commented on YARN-8438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520096#comment-16520096 ] Szilard Nemeth commented on YARN-8438: -- Hi [~miklos.szeg...@cloudera.com]! Indeed it's a valid case

[jira] [Updated] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8438: - Attachment: YARN-8438.004.patch > TestContainer.testKillOnNew flaky on trunk >

[jira] [Updated] (YARN-8438) TestContainer.testKillOnNew flaky on trunk

[ https://issues.apache.org/jira/browse/YARN-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8438: - Attachment: YARN-8438.003.patch > TestContainer.testKillOnNew flaky on trunk >