[
https://issues.apache.org/jira/browse/SPARK-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16564172#comment-16564172
]
Stavros Kontopoulos commented on SPARK-14643:
---------------------------------------------
Cool thanks!
> Remove overloaded methods which become ambiguous in Scala 2.12
> --------------------------------------------------------------
>
> Key: SPARK-14643
> URL: https://issues.apache.org/jira/browse/SPARK-14643
> Project: Spark
> Issue Type: Task
> Components: Build, Project Infra
> Affects Versions: 2.4.0
> Reporter: Josh Rosen
> Assignee: Josh Rosen
> Priority: Major
>
> Spark 1.x's Dataset API runs into subtle source incompatibility problems for
> Java 8 and Scala 2.12 users when Spark is built against Scala 2.12. In a
> nutshell, the current API has overloaded methods whose signatures are
> ambiguous when resolving calls that use the Java 8 lambda syntax (only if
> Spark is build against Scala 2.12).
> This issue is somewhat subtle, so there's a full writeup at
> https://docs.google.com/document/d/1P_wmH3U356f079AYgSsN53HKixuNdxSEvo8nw_tgLgM/edit?usp=sharing
> which describes the exact circumstances under which the current APIs are
> problematic. The writeup also proposes a solution which involves the removal
> of certain overloads only in Scala 2.12 builds of Spark and the introduction
> of implicit conversions for retaining source compatibility.
> We don't need to implement any of these changes until we add Scala 2.12
> support since the changes must only be applied when building against Scala
> 2.12 and will be done via traits + shims which are mixed in via
> per-Scala-version source directories (like how we handle the
> Scala-version-specific parts of the REPL). For now, this JIRA acts as a
> placeholder so that the parent JIRA reflects the complete set of tasks which
> need to be finished for 2.12 support.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
