wypoon opened a new issue #3372: URL: https://github.com/apache/iceberg/issues/3372
It has been proposed to build Spark 3 support -- at least for Spark 3.2 -- against both Scala 2.12 and 2.13. The code in spark/v3.2 currently does not compile against Scala 2.13. Some of the sources of source incompatibility are: - `scala.Predef.conforms` (deprecated since 2.11) has been removed in 2.13. - `scala.Seq[+A]` in 2.13 is an alias for `scala.collection.immutable.Seq[A]` instead of `scala.collection.Seq[A]`. Some Spark APIs that Iceberg call take `scala.Seq` parameters, instead of parameters explicitly declared as `scala.collection.Seq`. (The problem is that the APIs are called from Java code, not Scala code. Java lacks the type alias, so the Java code currently use `scala.collection.Seq`, but that cannot be used in 2.13 where a `scala.Seq` is required.) Another manifestation of this issue is `scala.collection.mutable.Buffer` cannot be used where a `scala.Seq` is required. - `scala.collection.JavaConversions` has been removed in 2.13 (it is used in some tests). Incidentally, `scala.collection.JavaConverters` is still in 2.13 but is deprecated and use of `scala.jdk.CollectionConverters` is recommended instead (but that is only in 2.13, not in 2.12). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
