Ismaël Mejía created BEAM-9282:
----------------------------------
Summary: Create new module for Spark 3 runner
Key: BEAM-9282
URL: https://issues.apache.org/jira/browse/BEAM-9282
Project: Beam
Issue Type: Sub-task
Components: runner-spark
Reporter: Ismaël Mejía
Assignee: Ismaël Mejía
GIven the big amount of different dependencies and some code incompatibilities
introduced by the Spark Structured Streaming runner reliance on the unsable
Spark Source V2 API it is a good idea to provide independent modules for the
Spark 3 runner.
Notice that the idea is still that the users can provide their Spark
dependencies.
We should probably rely on a structure similar to the one the Flink runner uses
to support their multiple versions.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)