Like what we did before to support both Scala 2.10 and 2.11 in Livy, I
think we should also have a new module to support 2.12.
于2019年6月4日周二 上午7:40写道：
> Yes, the spark binary we downloaded is built with default Scala 2.12. We
> want to use databricks delta which I think only support Scala 2.12.
Yes, the spark binary we downloaded is built with default Scala 2.12. We want
to use databricks delta which I think only support Scala 2.12. So, I'm stuck
with Scala 2.12. Moreover, Spark community is going to decommission Scala 2.11
completely from Spark 3.0 release. We might need to
Looks like the issue might be Spark 2.4.2 only? From
https://spark.apache.org/downloads.html, "Note that, Spark is pre-built
with Scala 2.11 except version 2.4.2, which is pre-built with Scala 2.12."
So maybe you just got unlucky with using Spark 2.4.2?
Kevin Risden
On Mon, Jun 3, 2019 at 6:19
Kevin,
I'm using Livy 0.6.0. The issues is related to not finding repl jars that
support scala 2.12. The error "requirement failed: Cannot find Livy REPL
jars." is thrown because it couldn't find folder repl_2.12-jars under LIVY
directory.
I performed a test to make sure this issue is
"requirement failed: Cannot find Livy REPL jars."
I didn't look where that error comes from, but my guess is that it looks
like you don't have Livy pointing to the right location anymore where it
can find Spark. Hopefully not sending you on a wild goose chase, but would
check there first.
Also
Hi,
We have just upgraded our spark cluster version 2.3 to 2.4.2 and it broke Livy.
It's throwing exception "Cannot Find Livy REPL Jars". Looks like I have to
build Livy using Scala 2.12 version.
Can anyone advise how to build Livy with Scala 2.12 with Maven? Will changing
the scala version
