[ 
https://issues.apache.org/jira/browse/LIVY-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700054#comment-17700054
 ] 

loic tregan commented on LIVY-593:
----------------------------------

After researching further:

   - first set of users will be on Spark 2 (latest currently 2.4.8): it is 
based on Scala 2.11; build output of Spark says: 
exec: curl --progress-bar -L 
[https://downloads.lightbend.com/scala/2.11.12/scala-2.11.12.tgz]

   - second set of users will be on Spark 3 (latest currently 3.2.2): it is 
based on Scala 2.12; build output of Spark says: 
exec: curl --silent --show-error -L 
[https://downloads.lightbend.com/scala/2.12.15/scala-2.12.15.tgz]

The most conservative / less error-prone option would thus be that 'mvn 
package' build both by default.

If for some reason we have to choose one version and cannot do both by default, 
then I'd use whatever '$SPARK_HOME/bin/spark-submit --version' returns (which 
also would be consistent with what sparkmagic does, as sparkmagic is I guess 
the most popular use case for livy-server it'd make sense they have both have 
the same strategy). 

 

> Adding Scala 2.12 support
> -------------------------
>
>                 Key: LIVY-593
>                 URL: https://issues.apache.org/jira/browse/LIVY-593
>             Project: Livy
>          Issue Type: Improvement
>    Affects Versions: 0.6.0
>            Reporter: Pateyron
>            Assignee: Sumit Kumar
>            Priority: Major
>             Fix For: 0.8.0
>
>
> Spark 2.4.2 is build with Scala 2.12 however Apache Livy 0.6.0 do not support 
> Scala 2.12.
> I am writing to let you know that Livy 0.6.0 do not work with Spark 2.4.2 
> Scala 2.12.
> Could you tell me when Livy will support Scala 2.12 ?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to