Ismaël Mejía created BEAM-7837:
----------------------------------
Summary: Add an adapter class to support changes in Spark 3 API
Key: BEAM-7837
URL: https://issues.apache.org/jira/browse/BEAM-7837
Project: Beam
Issue Type: Sub-task
Components: runner-spark
Reporter: Ismaël Mejía
Assignee: Ismaël Mejía
As part of the API clean ups of Spark 3, there are some methods that do not
work as before. For details.
SPARK-19287 JavaPairRDD flatMapValues requires function returning Iterable, not
Iterator
SPARK-25737 Remove JavaSparkContextVarargsWorkaround and standardize union()
methods
If we want to support both Spark 2 and Spark 3 with the same runner code base
we should probably create an adapter class for API incompatible code between
Spark versions.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
