Thanks, I'm using toree 0.2-dev prebuilt. I'll try to compile myself while keeping the scala version same across the parts and report back.
Could you please confirm that I'm using the 'toree_opts' correctly, because they don't seem to be parsed. (No debug-level output and no message about that the jar in path was loaded or not) sudo jupyter toree install --spark_home=/path/bin/spark-2.3.0 --toree_opts='--debug --jar-dir /path/target/scala-2.12' On Sat, May 19, 2018 at 3:32 AM, Luciano Resende <luckbr1...@gmail.com> wrote: > Current master, which is the one supporting Spark 2.x is currently compiled > with Scala 2.11. Also, if you are using Scala 2.12, you should make sure > that both Spark and Toree gets compiled properly with Scala 2.12 as I > believe Spark still provide binaries compiled with Scala 2.11. > > On Fri, May 18, 2018 at 3:39 PM, Igor Fialko <igorfia...@gmail.com> wrote: > > > Hello community, > > > > name is Igor and I'm working in my spare time on a trading system. So > far I > > used jupyter notebook with python kernel for visualisation/playing around > > with data. I wanted to go a step forward and reuse my existing scala > code, > > so I came up with toree as seemingly the only one still maintained > jupyter > > kernel. > > > > Therefore I've assembled a jar via sbt and tried to add it in the > notebook. > > It has failed with an exact same error as here. > > > > https://stackoverflow.com/questions/46403426/adding- > > dependency-to-apache-toree-fails-on-import > > > > 2018-05-18 23:43:51 WARN MagicManager:111 - Magic AddJar failed to > execute > > with error: > > object Predef does not have a member classOf > > scala.reflect.internal.FatalError: object Predef does not have a member > > classOf > > > > > > 2018-05-18 23:43:51 ERROR OneForOneStrategy:159 - object Predef does not > > have a member classOf > > scala.reflect.internal.FatalError: object Predef does not have a member > > classOf > > > > So I've tried to import the jar via toree_opts like > > > > sudo jupyter toree install --spark_home=/path/bin/spark-2.3.0 > > --toree_opts='--jar-dir /path/target/scala-2.12' > > > > which didn't make any impact unfortunately (from source code I could see > > that it should print a message that jar could not be loaded, neither did > an > > import work). > > > > I could assume that it's maybe a scala version issue? My project is > > compiled against 2.12.3, I couldn't find scala version that toree is > using. > > > > Did somebody face this issue? How could I debug what is wrong? > > > > Thanks > > Best regards, > > Igor > > > > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ >
