On Thu, Apr 5, 2018 at 10:30 AM, Matei Zaharia <matei.zaha...@gmail.com> wrote: > Sorry, but just to be clear here, this is the 2.12 API issue: > https://issues.apache.org/jira/browse/SPARK-14643, with more details in this > doc: > https://docs.google.com/document/d/1P_wmH3U356f079AYgSsN53HKixuNdxSEvo8nw_tgLgM/edit. > > Basically, if we are allowed to change Spark’s API a little to have only one > version of methods that are currently overloaded between Java and Scala, we > can get away with a single source three for all Scala versions and Java ABI > compatibility against any type of Spark (whether using Scala 2.11 or 2.12).
Fair enough. To play devil's advocate, most of those methods seem to be marked "Experimental / Evolving", which could be used as a reason to change them for this purpose in a minor release. Not all of them are, though (e.g. foreach / foreachPartition are not experimental). -- Marcelo --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
