John Zhuge created SPARK-56157:
----------------------------------
Summary: [STANDALONE] Add ActiveProcessorCount JVM option to
Standalone executor and driver
Key: SPARK-56157
URL: https://issues.apache.org/jira/browse/SPARK-56157
Project: Spark
Issue Type: New Feature
Components: Spark Core
Affects Versions: 4.2.0
Reporter: John Zhuge
SPARK-53209 added spark.driver.limitActiveProcessorCount.enabled and
spark.executor.limitActiveProcessorCount.enabled config flags that inject
-XX:ActiveProcessorCount into YARN AM/executor JVM launch commands.
This ticket extends support to Standalone cluster mode by applying the same
configs in ExecutorRunner.scala (for executors) and DriverRunner.scala (for
drivers in cluster mode), following the same pattern as the YARN implementation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
