Ruifeng Zheng created SPARK-61784:
-------------------------------------
Summary: Support configurable intermediate storage levels in
GaussianMixture
Key: SPARK-61784
URL: https://issues.apache.org/jira/browse/SPARK-61784
Project: Spark
Issue Type: Improvement
Components: ML
Affects Versions: 5.0.0
Reporter: Ruifeng Zheng
GaussianMixture currently persists its training instances with a hard-coded
MEMORY_AND_DISK storage level when the input dataset is not already cached.
Expose the existing intermediateStorageLevel parameter in the Scala and PySpark
GaussianMixture APIs so users can choose another supported storage level for
these intermediate instances. Keep MEMORY_AND_DISK as the default and preserve
the existing behavior for cached input datasets.
Include PySpark constructor, setParams, and setter support, and extend the
existing Scala and Python tests.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]