Hyukjin Kwon created SPARK-61713:
------------------------------------
Summary: Add PySpark's Params API, typed models and persistence to
the native FPGrowth, PrefixSpan and ALS
Key: SPARK-61713
URL: https://issues.apache.org/jira/browse/SPARK-61713
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
Part of completing the native ML classes of pyspark.ml.connect to the full
pyspark.ml 4.3.0 surface, after the PyO3 base (SPARK-61697).
The native FPGrowth, PrefixSpan and ALS get PySpark's API of pyspark.ml.fpm and
pyspark.ml.recommendation:
- FPGrowth and ALS: the Params API, setParams, fitMultiple, param maps, and
save and load;
- FPGrowthModel (freqItemsets, associationRules) and ALSModel (rank,
userFactors, itemFactors, the recommendations): typed models of their members,
their setters, the defaults of their estimators, and save and load;
- PrefixSpan: the Params API, as a class of Params;
- the use of a fitted model with a DataFrame of another session follows
PySpark's (the error of a transform is the server's, of its collect), instead
of an eager error of the client.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]