Bobby Wang created SPARK-50827:
----------------------------------
Summary: Support plugin for Spark Connect ML
Key: SPARK-50827
URL: https://issues.apache.org/jira/browse/SPARK-50827
Project: Spark
Issue Type: Sub-task
Components: Connect
Affects Versions: 4.0.0
Reporter: Bobby Wang
Since [https://github.com/apache/spark/pull/48791] has been merged into spark
master, now, Users could play around ML things on spark connect ML. That's a
cool feature. But the current Sparck Connect ML is using spark.ml as the
backend, which is not GPU-accelerated.
So I file this issue to propose a Spark Connect ML plugin feature which could
replace spark.ml with third-party implementation. With this feature, Users
don't need to change any the existing ml code to be accelerated by the
third-party implementations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
