[ https://issues.apache.org/jira/browse/TOREE-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15876892#comment-15876892 ]
Jakob Odersky commented on TOREE-375: ------------------------------------- [~fschueler] so I'm actually not entirely sure what's the cause of this bug, however I can confirm it is not specific to Toree. It can be reproduces in a standard spark shell as well: ``` scala> :power Power mode enabled. :phase is at typer. import scala.tools.nsc._, intp.global._, definitions._ Try :help or completions for vals._ and power._ scala> power.intp.addUrlsToClassPath(jar) scala> import org.apache.sysml.api.MLContext import org.apache.sysml.api.MLContext scala> val ml = new MLContext(sc) <console>:50: error: overloaded method constructor MLContext with alternatives: (x$1: org.apache.spark.api.java.JavaSparkContext)org.apache.sysml.api.MLContext <and> (x$1: org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.SparkContext)org.apache.sysml.api.MLContext cannot be applied to (org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.SparkContext) val ml = new MLContext(sc) ``` > Incorrect fully qualified name for spark context > ------------------------------------------------ > > Key: TOREE-375 > URL: https://issues.apache.org/jira/browse/TOREE-375 > Project: TOREE > Issue Type: Bug > Environment: Jupyter Notebook with Toree latest master > (1a9c11f5f1381c15b691a716acd0e1f0432a9a35) and Spark 2.0.2, Scala 2.11 > Reporter: Felix Schüler > Priority: Critical > > When running below snippet in a cell I get a compile error for the MLContext > Constructor. Somehow the fully qualified name of the SparkContext gets messed > up. > The same does not happen when I start a Spark shell with the --jars command > and create the MLContext there. > Snippet (the systemml jar is build with the latest master of SystemML): > {code} > %addjar > file:///home/felix/repos/incubator-systemml/target/systemml-0.13.0-incubating-SNAPSHOT.jar > -f > import org.apache.sysml.api.mlcontext._ > import org.apache.sysml.api.mlcontext.ScriptFactory._ > val ml = new MLContext(sc) > Starting download from > file:///home/felix/repos/incubator-systemml/target/systemml-0.13.0-incubating-SNAPSHOT.jar > Finished download of systemml-0.13.0-incubating-SNAPSHOT.jar > Name: Compile Error > Message: <console>:25: error: overloaded method constructor MLContext with > alternatives: > (x$1: > org.apache.spark.api.java.JavaSparkContext)org.apache.sysml.api.mlcontext.MLContext > <and> > (x$1: > org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.SparkContext)org.apache.sysml.api.mlcontext.MLContext > cannot be applied to > (org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.org.apache.spark.SparkContext) > val ml = new MLContext(sc) > ^ > StackTrace: > {code} -- This message was sent by Atlassian JIRA (v6.3.15#6346)