[
https://issues.apache.org/jira/browse/BEAM-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ismaël Mejía updated BEAM-7837:
-------------------------------
Status: Open (was: Triage Needed)
> Add an adapter class to support changes in Spark 3 API
> ------------------------------------------------------
>
> Key: BEAM-7837
> URL: https://issues.apache.org/jira/browse/BEAM-7837
> Project: Beam
> Issue Type: Sub-task
> Components: runner-spark
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Minor
>
> As part of the API clean ups of Spark 3, there are some methods that do not
> work as before. For details.
> SPARK-19287 JavaPairRDD flatMapValues requires function returning Iterable,
> not Iterator
> SPARK-25737 Remove JavaSparkContextVarargsWorkaround and standardize union()
> methods
> If we want to support both Spark 2 and Spark 3 with the same runner code base
> we should probably create an adapter class for API incompatible code between
> Spark versions.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
