Ruifeng Zheng created SPARK-61634:
-------------------------------------

             Summary: Connect Rust: implement native ML feature stages
                 Key: SPARK-61634
                 URL: https://issues.apache.org/jira/browse/SPARK-61634
             Project: Spark
          Issue Type: Improvement
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Ruifeng Zheng


Add native Rust and Python execution for all 38 standard pyspark.ml.feature 
estimators and transformers, following standard pyspark.ml over Spark Connect. 
Add 34 missing Rust stages and complete the existing four, with constructor 
parameters, named setters, server-backed fit/transform and cached-model 
ownership. Expose all stages in the native Python feature namespace, including 
standard Spark DataFrame-only scalers. Validate with official PySpark 4.3.0 
parameter fixtures and live output tests for all stages. Specialized model 
inspection, persistence, LSH similarity methods and pipeline/tuning execution 
remain separate.




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to