Herman van Hövell created SPARK-49569:
-----------------------------------------
Summary: Introduce Shim for missing spark/core classes
Key: SPARK-49569
URL: https://issues.apache.org/jira/browse/SPARK-49569
Project: Spark
Issue Type: New Feature
Components: Connect, SQL
Affects Versions: 4.0.0
Reporter: Herman van Hövell
Introduce shims for SparkContext, RDD, and QueryExecution. This will have to be
a in a separate module, and is supposed to be a compile time dependency for
sql/api project, and an actual dependency for an independent Spark Connect
Client.
We need these three classes to support all user facing API in the sql/api
project. This will allow us to make the classes the primary interface for Scala
Dataset operations.
For connect these methods will throw an (actionable) error, and for the classic
client they will just work. On the connect side in the future we can use this
to build better errors, and provide (method specific) mitigations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
