[
https://issues.apache.org/jira/browse/SPARK-61713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-61713:
---------------------------------
Fix Version/s: connect-rust-4.3.0
> Add PySpark's Params API, typed models and persistence to the native
> FPGrowth, PrefixSpan and ALS
> -------------------------------------------------------------------------------------------------
>
> Key: SPARK-61713
> URL: https://issues.apache.org/jira/browse/SPARK-61713
> Project: Spark
> Issue Type: Improvement
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
> Fix For: connect-rust-4.3.0
>
>
> Part of completing the native ML classes of pyspark.ml.connect to the full
> pyspark.ml 4.3.0 surface, after the PyO3 base (SPARK-61697).
> The native FPGrowth, PrefixSpan and ALS get PySpark's API of pyspark.ml.fpm
> and pyspark.ml.recommendation:
> - FPGrowth and ALS: the Params API, setParams, fitMultiple, param maps, and
> save and load;
> - FPGrowthModel (freqItemsets, associationRules) and ALSModel (rank,
> userFactors, itemFactors, the recommendations): typed models of their
> members, their setters, the defaults of their estimators, and save and load;
> - PrefixSpan: the Params API, as a class of Params;
> - the use of a fitted model with a DataFrame of another session follows
> PySpark's (the error of a transform is the server's, of its collect), instead
> of an eager error of the client.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]