Weichen Xu created SPARK-52056:
----------------------------------
Summary: Disable tuning algorithm sub-models in spark connect
Key: SPARK-52056
URL: https://issues.apache.org/jira/browse/SPARK-52056
Project: Spark
Issue Type: Sub-task
Components: Connect, ML, PySpark
Affects Versions: 4.1.0
Reporter: Weichen Xu
We should disable tuning algorithm sub-models in spark connect by default.
sub-model is not widely used, but it causes many sub-models cached in Spark
connect driver MLcache, which increases MLcache memory / disk burden.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
