[
https://issues.apache.org/jira/browse/SPARK-56157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Zhuge updated SPARK-56157:
-------------------------------
Summary: [CORE] Add ActiveProcessorCount JVM option to Standalone executor
and driver (was: [STANDALONE] Add ActiveProcessorCount JVM option to
Standalone executor and driver)
> [CORE] Add ActiveProcessorCount JVM option to Standalone executor and driver
> ----------------------------------------------------------------------------
>
> Key: SPARK-56157
> URL: https://issues.apache.org/jira/browse/SPARK-56157
> Project: Spark
> Issue Type: New Feature
> Components: Spark Core
> Affects Versions: 4.2.0
> Reporter: John Zhuge
> Priority: Major
>
> SPARK-53209 added spark.driver.limitActiveProcessorCount.enabled and
> spark.executor.limitActiveProcessorCount.enabled config flags that inject
> -XX:ActiveProcessorCount into YARN AM/executor JVM launch commands.
> This ticket extends support to Standalone cluster mode by applying the same
> configs in ExecutorRunner.scala (for executors) and DriverRunner.scala (for
> drivers in cluster mode), following the same pattern as the YARN
> implementation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
