[
https://issues.apache.org/jira/browse/SPARK-43516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-43516:
-------------------------------
Description:
* Define basic interfaces of Evaluator / Transformer / Model / Evaluator, these
interfaces are designed to support both spark connect and legacy spark mode,
and are designed to support train / transform / evaluate over either spark
dataframe or pandas dataframe
* Implement a feature transformer {{{}MaxAbsScaler{}}}, {{ScalerScaler}}
* Implement a regressor evaluator {{RegressorEvaluator}} that supports MSE and
R2 metric evaluation
> Basic estimator / transformer / model / evaluator interfaces and basic
> transformer / evaluator implementation
> -------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-43516
> URL: https://issues.apache.org/jira/browse/SPARK-43516
> Project: Spark
> Issue Type: Sub-task
> Components: Connect, ML, PySpark
> Affects Versions: 3.5.0
> Reporter: Weichen Xu
> Assignee: Weichen Xu
> Priority: Major
> Fix For: 3.5.0
>
>
> * Define basic interfaces of Evaluator / Transformer / Model / Evaluator,
> these interfaces are designed to support both spark connect and legacy spark
> mode, and are designed to support train / transform / evaluate over either
> spark dataframe or pandas dataframe
> * Implement a feature transformer {{{}MaxAbsScaler{}}}, {{ScalerScaler}}
> * Implement a regressor evaluator {{RegressorEvaluator}} that supports MSE
> and R2 metric evaluation
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
