[ 
https://issues.apache.org/jira/browse/SPARK-61634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ruifeng Zheng updated SPARK-61634:
----------------------------------
    Fix Version/s: connect-rust-4.3.0

> Connect Rust: implement native ML feature stages
> ------------------------------------------------
>
>                 Key: SPARK-61634
>                 URL: https://issues.apache.org/jira/browse/SPARK-61634
>             Project: Spark
>          Issue Type: Improvement
>          Components: Connect
>    Affects Versions: connect-rust-4.3.0
>            Reporter: Ruifeng Zheng
>            Priority: Major
>             Fix For: connect-rust-4.3.0
>
>
> Add native Rust and Python execution for all 38 standard pyspark.ml.feature 
> estimators and transformers, following standard pyspark.ml over Spark 
> Connect. Add 34 missing Rust stages and complete the existing four, with 
> constructor parameters, named setters, server-backed fit/transform and 
> cached-model ownership. Expose all stages in the native Python feature 
> namespace, including standard Spark DataFrame-only scalers. Validate with 
> official PySpark 4.3.0 parameter fixtures and live output tests for all 
> stages. Specialized model inspection, persistence, LSH similarity methods and 
> pipeline/tuning execution remain separate.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to