Although like you said, spark support for scala 2.12 is beta anyway then shouldn’t we get it to a working state by basing on 2.12.7? There shouldn’t be a stability issue since it is not officially “supported”
________________________________ From: Wenchen Fan <[email protected]> Sent: Monday, October 1, 2018 7:43 PM To: Sean Owen Cc: [email protected]; Spark dev list Subject: Re: On Scala 2.12.7 My major concern is how it will affect end-users if Spark 2.4 is built with Scala versions prior to 2.12.7. Generally I'm hesitating to upgrade Scala version when we are very close to a release, and Scala 2.12 build of Spark 2.4 is beta anyway. On Sat, Sep 29, 2018 at 6:46 AM Sean Owen <[email protected]<mailto:[email protected]>> wrote: I'm forking the discussion about Scala 2.12.7 from the 2.4.0 RC vote thread. 2.12.7 was released yesterday, and, is even labeled as fixing Spark 2.4 compatibility! https://www.scala-lang.org/news/2.12.7 We should look into it, yes. Darcy identified, and they fixed, this issue: https://github.com/scala/scala/pull/7156 while finishing the work for Scala 2.12. However we already worked around this in Spark, no? at https://github.com/apache/spark/commit/f29c2b5287563c0d6f55f936bd5a75707d7b2b1f So we should go ahead and update to use 2.12.7, yes, and undo this workaround? But this doesn't necessarily block a 2.4.0 release, if it's already worked around. --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]<mailto:[email protected]>
