[
https://issues.apache.org/jira/browse/SPARK-61710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-61710:
------------------------------------
Assignee: Hyukjin Kwon
> Add PySpark's Params API, param maps and persistence to the native feature
> transformers
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-61710
> URL: https://issues.apache.org/jira/browse/SPARK-61710
> Project: Spark
> Issue Type: Improvement
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Major
> Labels: pull-request-available
> Fix For: connect-rust-4.3.0
>
>
> Part of completing the native ML classes of pyspark.ml.connect to the full
> pyspark.ml 4.3.0 surface, after the PyO3 base (SPARK-61697).
> The 18 native feature transformers (Binarizer through VectorSlicer,
> StopWordsRemover included) get PySpark's API of pyspark.ml.feature:
> - the Params API, every getter and setter, and setParams;
> - the defaults of each instance (a load keeps the outputCol of the uid that
> the object was made of, as _resetUid keeps it);
> - transform(dataset, params), which transforms of a copy of a non-empty param
> map;
> - write, save, read and load, as RemoteMLWriter and RemoteMLReader save and
> load them.
> The feature estimators and their typed models follow in another change.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]