yabola commented on PR #46713: URL: https://github.com/apache/spark/pull/46713#issuecomment-2232302650
I would like to describe the usage scenario: In a scenario where multiple users are sharing 2048 core long running SQL cluster. Some users may have non-standard queries that use a large number of cores, causing other users' smaller sql to get stuck. By globally limiting SQL to 500 core, it can help reduce the occurrence of starvation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
