Wilfred Spiegelenburg created YUNIKORN-3215:
-----------------------------------------------
Summary: Improve performance of Limit checking
Key: YUNIKORN-3215
URL: https://issues.apache.org/jira/browse/YUNIKORN-3215
Project: Apache YuniKorn
Issue Type: Improvement
Components: core - common
Reporter: Wilfred Spiegelenburg
Assignee: Wilfred Spiegelenburg
When adding large numbers of Limits (users and or group quotas) to configured
queues the validation code performance drops dramatically.
The issue causing processing to slow down seems to be linked to the amount of
garbage that gets generated. In small deployments with a regular updates it
pushes the up the overall memory usage and could cause CPU starvation for the
scheduler.
A large number of queues, 1500+ queues were tested, has limited to no real
impact on the performance of the validations. Large numbers of limits set on
non leaf seem to have the biggest impact.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
