[jira] [Updated] (YARN-11684) PriorityQueueComparator violates general contract

2024-04-20 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11684: -- Fix Version/s: 3.4.1 3.5.0 > PriorityQueueComparator violates general contract >

[jira] [Resolved] (YARN-11444) Improve YARN md documentation format

2024-04-07 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved YARN-11444. --- Fix Version/s: 3.4.1 3.5.0 Hadoop Flags: Reviewed Target

[jira] [Updated] (YARN-11444) Improve YARN md documentation format

2024-04-05 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11444: -- Description: 1. Modify some typo errors (was: 1. Improve the table format to make the readability

[jira] [Resolved] (YARN-11663) [Federation] Add Cache Entity Nums Limit.

2024-04-01 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved YARN-11663. --- Fix Version/s: 3.4.1 3.5.0 Target Version/s: 3.4.0 Assignee:

[jira] [Resolved] (YARN-11668) Potential concurrent modification exception for node attributes of node manager

2024-03-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved YARN-11668. --- Fix Version/s: 3.4.1 3.5.0 Hadoop Flags: Reviewed Target

[jira] [Updated] (YARN-11668) Potential concurrent modification exception for node attributes of node manager

2024-03-28 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11668: -- Affects Version/s: 3.4.0 > Potential concurrent modification exception for node attributes of node >

[jira] [Updated] (YARN-11663) [Federation] Add Cache Entity Nums Limit.

2024-03-23 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11663: -- Issue Type: Improvement (was: Bug) > [Federation] Add Cache Entity Nums Limit. >

[jira] [Updated] (YARN-11663) [Federation] Add Cache Entity Nums Limit.

2024-03-23 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11663: -- Summary: [Federation] Add Cache Entity Nums Limit. (was: Router cache expansion issue) >

[jira] [Comment Edited] (YARN-11387) [GPG] YARN GPG mistakenly deleted applicationid

2024-03-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830001#comment-17830001 ] Shilun Fan edited comment on YARN-11387 at 3/22/24 11:08 PM: - I will resubmit

[jira] [Commented] (YARN-11387) [GPG] YARN GPG mistakenly deleted applicationid

2024-03-22 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17830001#comment-17830001 ] Shilun Fan commented on YARN-11387: --- I will resubmit PR to follow up on this issue.I will resubmit PR

[jira] [Commented] (YARN-11663) Router cache expansion issue

2024-03-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17827300#comment-17827300 ] Shilun Fan commented on YARN-11663: --- [~luoyuan] Thank you for raising this question. how long the cache

[jira] [Resolved] (YARN-11660) SingleConstraintAppPlacementAllocator performance regression

2024-03-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan resolved YARN-11660. --- Resolution: Fixed > SingleConstraintAppPlacementAllocator performance regression >

[jira] [Updated] (YARN-11660) SingleConstraintAppPlacementAllocator performance regression

2024-03-14 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11660: -- Component/s: scheduler Fix Version/s: 3.4.1 Hadoop Flags: Reviewed Target

[jira] [Updated] (YARN-11037) Add configurable logic to split resource request to least loaded SC

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11037: -- Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add

[jira] [Updated] (YARN-11026) Make AppPlacementAllocator configurable in AppSchedulingInfo

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11026: -- Component/s: scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10805) Replace Guava Lists usage by Hadoop's own Lists in hadoop-yarn-project

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10805: -- Component/s: yarn-common Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10750) TestMetricsInvariantChecker.testManyRuns is broken since HADOOP-17524

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10750: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10746) RmWebApp add default-node-label-expression to the queue info

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10746: -- Component/s: resourcemanager webapp Target Version/s: 3.4.0

[jira] [Updated] (YARN-10278) CapacityScheduler test framework ProportionalCapacityPreemptionPolicyMockFramework need some review

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10278: -- Component/s: capacity scheduler test Hadoop Flags: Reviewed

[jira] [Updated] (YARN-10277) CapacityScheduler test TestUserGroupMappingPlacementRule should build proper hierarchy

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10277: -- Component/s: capacity scheduler Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (YARN-10279) Avoid unnecessary QueueMappingEntity creations

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10279: -- Component/s: resourcemanager Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Updated] (YARN-10281) Redundant QueuePath usage in UserGroupMappingPlacementRule and AppNameMappingPlacementRule

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10281: -- Component/s: capacity scheduler Target Version/s: 3.3.1, 3.4.0 Affects Version/s: 3.3.1

[jira] [Assigned] (YARN-10746) RmWebApp add default-node-label-expression to the queue info

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned YARN-10746: - Assignee: Gergely Pollák > RmWebApp add default-node-label-expression to the queue info >

[jira] [Assigned] (YARN-10777) Bump node-sass from 4.13.0 to 4.14.1 in /hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned YARN-10777: - Assignee: Wei-Chiu Chuang > Bump node-sass from 4.13.0 to 4.14.1 in >

[jira] [Assigned] (YARN-1115) Provide optional means for a scheduler to check real user ACLs

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-1115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned YARN-1115: Assignee: Eric Payne > Provide optional means for a scheduler to check real user ACLs >

[jira] [Updated] (YARN-9048) Add znode hierarchy in Federation ZK State Store

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-9048: - Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add znode

[jira] [Updated] (YARN-8980) Mapreduce application container start fail after AM restart.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-8980: - Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Mapreduce

[jira] [Updated] (YARN-11090) [GPG] Support Secure Mode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11090: -- Component/s: gpg Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > [GPG] Support

[jira] [Updated] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-8898: - Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-7720: - Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Race condition

[jira] [Updated] (YARN-5604) Add versioning for FederationStateStore

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-5604: - Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-8972: - Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-9049) Add application submit data to state store

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-9049: - Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add application

[jira] [Updated] (YARN-10946) AbstractCSQueue: Create separate class for constructing Queue API objects

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10946: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-6667) Handle containerId duplicate without failing the heartbeat in Federation Interceptor

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-6667: - Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-8482) [Router] Add cache for fast answers to getApps

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-8482: - Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-6539) Create SecureLogin inside Router

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-6539: - Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-6972) Adding RM ClusterId in AppInfo

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-6972: - Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Adding RM

[jira] [Updated] (YARN-10793) Upgrade Junit from 4 to 5 in hadoop-yarn-server-applicationhistoryservice

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10793: -- Component/s: test Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Upgrade Junit from

[jira] [Updated] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-8973: - Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10883) [Router] Router Audit Log Add Client IP Address.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10883: -- Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10487) Support getQueueUserAcls, listReservations, getApplicationAttempts, getContainerReport, getContainers, getResourceTypeInfo API's for Federation

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10487: -- Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10565) Follow-up to YARN-10504

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10565: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-11036) Do not inherit from TestRMWebServicesCapacitySched

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11036: -- Component/s: capacity scheduler test Target Version/s: 3.4.0

[jira] [Updated] (YARN-10049) FIFOOrderingPolicy Improvements

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10049: -- Component/s: scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10918) Simplify method: CapacitySchedulerQueueManager#parseQueue

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10918: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10945) Add javadoc to all methods of AbstractCSQueue

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10945: -- Component/s: capacity scheduler documentation Target Version/s: 3.4.0

[jira] [Updated] (YARN-10947) Simplify AbstractCSQueue#initializeQueueState

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10947: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10995) Move PendingApplicationComparator from GuaranteedOrZeroCapacityOverTimePolicy

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10995: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Move

[jira] [Updated] (YARN-10944) AbstractCSQueue: Eliminate code duplication in overloaded versions of setMaxCapacity

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10944: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10963) Split TestCapacityScheduler by test categories

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10963: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-11034) Add enhanced headroom in AllocateResponse

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11034: -- Component/s: federation Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Add enhanced

[jira] [Updated] (YARN-10632) Make auto queue creation maximum allowed depth configurable

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10632: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10907) Minimize usages of AbstractCSQueue#csContext

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10907: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10929) Do not use a separate config in legacy CS AQC

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10929: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Do

[jira] [Updated] (YARN-11043) Clean up checkstyle warnings from YARN-11024/10907/10929

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11043: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-11031) Improve the maintainability of RM webapp tests like TestRMWebServicesCapacitySched

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11031: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-11024) Create an AbstractLeafQueue to store the common LeafQueue + AutoCreatedLeafQueue functionality

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11024: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-11003) Make RMNode aware of all (OContainer inclusive) allocated resources

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-11003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-11003: -- Component/s: container resourcemanager Target Version/s: 3.4.0

[jira] [Updated] (YARN-10909) AbstractCSQueue: Annotate all methods with VisibleForTesting that are only used by test code

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10909: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10998) Add YARN_ROUTER_HEAPSIZE to yarn-env for routers

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10998: -- Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10948) Rename SchedulerQueue#activeQueue to activateQueue

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10948: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10958) Use correct configuration for Group service init in CSMappingPlacementRule

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10958: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10954) Remove commented code block from CSQueueUtils#loadCapacitiesByLabelsFromConf

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10954: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Assigned] (YARN-10954) Remove commented code block from CSQueueUtils#loadCapacitiesByLabelsFromConf

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan reassigned YARN-10954: - Assignee: Andras Gyori > Remove commented code block from

[jira] [Updated] (YARN-10957) Use invokeConcurrent Overload with Collection in getClusterMetrics

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10957: -- Component/s: federation router Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10913) AbstractCSQueue: Group preemption methods and fields into a separate class

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10913: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10917) Investigate and simplify CapacitySchedulerConfigValidator#validateQueueHierarchy

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10917: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10950) Code cleanup in QueueCapacities

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10950: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Code

[jira] [Updated] (YARN-10915) AbstractCSQueue: Simplify complex logic in methods: deriveCapacityFromAbsoluteConfigurations and updateEffectiveResources

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10915: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10912) AbstractCSQueue#updateConfigurableResourceRequirement: Separate validation logic from initialization logic

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10912: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10910) AbstractCSQueue#setupQueueConfigs: Separate validation logic from initialization logic

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10910: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10914) Simplify duplicated code for tracking ResourceUsage in AbstractCSQueue

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10914: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10893) Add metrics for getClusterMetrics and getApplications APIs in FederationClientInterceptor

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10893: -- Component/s: federation metrics router Target

[jira] [Updated] (YARN-10522) Document for Flexible Auto Queue Creation in Capacity Scheduler

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10522: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10576) Update Capacity Scheduler documentation with JSON-based placement mapping

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10576: -- Component/s: capacity scheduler documentation Target Version/s: 3.4.0

[jira] [Updated] (YARN-10919) Remove LeafQueue#scheduler field

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10919: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10838) Implement an optimised version of Configuration getPropsWithPrefix

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10838: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10790) CS Flexible AQC: Add separate parent and leaf template property.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10790: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > CS

[jira] [Updated] (YARN-10841) Fix token reset synchronization for UAM response token

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10841: -- Component/s: federation Hadoop Flags: Reviewed Target Version/s: 3.4.0 Affects

[jira] [Updated] (YARN-10727) ParentQueue does not validate the queue on removal

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10727: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10829) Support getApplications API in FederationClientInterceptor

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10829: -- Component/s: federation router Hadoop Flags: Reviewed Target

[jira] [Updated] (YARN-10801) Fix Auto Queue template to properly set all configuration properties

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10801: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix

[jira] [Updated] (YARN-10780) Optimise retrieval of configured node labels in CS queues

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10780: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10807) Parents node labels are incorrectly added to child queues in weight mode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10807: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10771) Add cluster metric for size of SchedulerEventQueue and RMEventQueue

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10771: -- Component/s: metrics resourcemanager Target Version/s: 3.4.0

[jira] [Updated] (YARN-10783) Allow definition of auto queue template properties in root

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10783: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10571) Refactor dynamic queue handling logic

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10571: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-9615) Add dispatcher metrics to RM

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-9615: - Component/s: metrics resourcemanager Target Version/s: 2.10.2, 3.3.1,

[jira] [Updated] (YARN-10637) fs2cs: add queue autorefresh policy during conversion

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10637: -- Component/s: fairscheduler fs-cs Hadoop Flags: Reviewed

[jira] [Updated] (YARN-10654) Dots '.' in CSMappingRule path variables should be replaced

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10654: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Dots

[jira] [Updated] (YARN-10564) Support Auto Queue Creation template configurations

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10564: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10714) Remove dangling dynamic queues on reinitialization

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10714: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-9618) NodesListManager event improvement

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-9618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-9618: - Component/s: resourcemanager Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10597) CSMappingPlacementRule should not create new instance of Groups

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10597: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10713) ClusterMetrics should support custom resource capacity related metrics.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10713: -- Component/s: metrics Hadoop Flags: Reviewed Target Version/s: 3.3.1, 3.4.0

[jira] [Updated] (YARN-10641) Refactor the max app related update, and fix maxApplications update error when add new queues.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10641: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

[jira] [Updated] (YARN-10659) Improve CS MappingRule %secondary_group evaluation

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10659: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 >

[jira] [Updated] (YARN-10689) Fix the findbugs issues in extractFloatValueFromWeightConfig.

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10689: -- Component/s: capacity scheduler Target Version/s: 3.4.0 Affects Version/s: 3.4.0 > Fix

[jira] [Updated] (YARN-10686) Fix TestCapacitySchedulerAutoQueueCreation#testAutoQueueCreationFailsForEmptyPathWithAQCAndWeightMode

2024-02-11 Thread Shilun Fan (Jira)
[ https://issues.apache.org/jira/browse/YARN-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shilun Fan updated YARN-10686: -- Component/s: capacity scheduler Hadoop Flags: Reviewed Target Version/s: 3.4.0

  1   2   3   4   5   6   7   8   9   10   >