[ 
https://issues.apache.org/jira/browse/SPARK-61624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hyukjin Kwon updated SPARK-61624:
---------------------------------
    Fix Version/s: connect-rust-4.3.0

> Make setParams and the params argument of the native ML classes as PySpark 
> does
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-61624
>                 URL: https://issues.apache.org/jira/browse/SPARK-61624
>             Project: Spark
>          Issue Type: Improvement
>          Components: Connect
>    Affects Versions: connect-rust-4.3.0
>            Reporter: Hyukjin Kwon
>            Priority: Major
>             Fix For: connect-rust-4.3.0
>
>
> The native ML classes of the Python client's pyspark.ml.connect had no 
> setParams, and their fit, transform and evaluate took no params argument. So 
> GBTRegressor().setParams(maxIter=3) raised AttributeError, and 
> NaiveBayes().fit(df, None) raised TypeError, where PySpark 4.3.0 accepts 
> both. Add setParams where PySpark's class has one, with PySpark's 
> keyword-only signature, and accept params=None and an empty dict in fit, 
> transform and evaluate. A non-empty param map raises a clear TypeError, since 
> the native classes have no Param objects.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to