[
https://issues.apache.org/jira/browse/BEAM-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ismaël Mejía resolved BEAM-7837.
--------------------------------
Resolution: Fixed
Fix Version/s: 2.15.0
> Add an adapter class to support changes in Spark 3 API
> ------------------------------------------------------
>
> Key: BEAM-7837
> URL: https://issues.apache.org/jira/browse/BEAM-7837
> Project: Beam
> Issue Type: Sub-task
> Components: runner-spark
> Reporter: Ismaël Mejía
> Assignee: Ismaël Mejía
> Priority: Minor
> Fix For: 2.15.0
>
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> As part of the API clean ups of Spark 3, there are some methods that do not
> work as before. For details.
> SPARK-19287 JavaPairRDD flatMapValues requires function returning Iterable,
> not Iterator
> SPARK-25737 Remove JavaSparkContextVarargsWorkaround and standardize union()
> methods
> If we want to support both Spark 2 and Spark 3 with the same runner code base
> we should probably create an adapter class for API incompatible code between
> Spark versions.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
