[jira] [Comment Edited] (TOREE-336) Toree not working with Apache Spark 2.0.0
[
https://issues.apache.org/jira/browse/TOREE-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252852#comment-16252852
]
Sivaram Konanki edited comment on TOREE-336 at 11/15/17 2:27 AM:
-
I get this error, when I use follow this:
{noformat}
3a. git clone https://github.com/apache/incubator-toree
3b. cd /path/to/incubator-toree
3c. make clean release APACHE_SPARK_VERSION=2.2.0
3d. pip install toree --no-index
--find-links=/path/to/incubator-toree/dist/toree-pip/toree0.2.0.dev1.tar.gz
3e. jupyter toree install --spark_home=$SPARK_HOME
--spark_opts='--master=local[2] --executor-memory=3G'
{noformat}
{code}
[info] Compiling 48 Scala sources to
/home/toree_source/incubator-toree/protocol/target/scala-2.11/classes ...
[info] Compiling 12 Scala sources and 6 Java sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes ...
[error] ## Exception when compiling 18 sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes
[error] Cannot run program "javac" (in directory
"/home/toree_source/incubator-toree"): error=2, No such file or directory
{code}
was (Author: sivakon):
I get this error, when I use follow this:
{noformat}
3a. git clone https://github.com/apache/incubator-toree
3b. cd /path/to/incubator-toree
3c. make clean release APACHE_SPARK_VERSION=2.1.0
3d. pip install toree --no-index
--find-links=/path/to/incubator-toree/dist/toree-pip/toree0.2.0.dev1.tar.gz
3e. jupyter toree install --spark_home=$SPARK_HOME
--spark_opts='--master=local[2] --executor-memory=3G'
{noformat}
{code}
[info] Compiling 48 Scala sources to
/home/toree_source/incubator-toree/protocol/target/scala-2.11/classes ...
[info] Compiling 12 Scala sources and 6 Java sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes ...
[error] ## Exception when compiling 18 sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes
[error] Cannot run program "javac" (in directory
"/home/toree_source/incubator-toree"): error=2, No such file or directory
{code}
> Toree not working with Apache Spark 2.0.0
> -
>
> Key: TOREE-336
> URL: https://issues.apache.org/jira/browse/TOREE-336
> Project: TOREE
> Issue Type: Bug
> Environment: OSX and ubuntu-14.04, both running scala 2.10.4 and
> spark 2.0.0
>Reporter: Tianhui Li
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Following the instructions on
> https://github.com/apache/incubator-toree/blob/master/README.md, I run
> ```
> pip install --pre toree
> jupyter toree install --spark-home=$SPARK_HOME
> ```
> I'm able to build fine. But upon starting the server and a new scala (or any
> other type of notebook), I an error (provided below). This seems related to
> using scala 2.10 rather than 2.11 (see
> http://stackoverflow.com/questions/29339005/run-main-0-java-lang-nosuchmethoderror-scala-collection-immutable-hashset-emp
> and
> http://stackoverflow.com/questions/30536759/running-a-spark-application-in-intellij-14-1-3).
> Below is the error:
> $ jupyter notebook
> [I 12:11:59.464 NotebookApp] Serving notebooks from local directory:
> /Users/tianhui
> [I 12:11:59.464 NotebookApp] 0 active kernels
> [I 12:11:59.465 NotebookApp] The Jupyter Notebook is running at:
> http://localhost:/
> [I 12:11:59.465 NotebookApp] Use Control-C to stop this server and shut down
> all kernels (twice to skip confirmation).
> [I 12:12:06.847 NotebookApp] 302 GET / (::1) 0.47ms
> [I 12:12:10.591 NotebookApp] Creating new notebook in
> [I 12:12:11.600 NotebookApp] Kernel started:
> 20ca2e71-781b-4208-ad88-bc04c1ca37d6
> Starting Spark Kernel with
> SPARK_HOME=/usr/local/Cellar/apache-spark/2.0.0/libexec/
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Kernel version:
> 0.1.0.dev9-incubating-SNAPSHOT
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Scala version: Some(2.10.4)
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - ZeroMQ (JeroMQ) version: 3.2.2
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Initializing internal actor
> system
> Exception in thread "main" java.lang.NoSuchMethodError:
> scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet;
> at akka.actor.ActorCell$.(ActorCell.scala:336)
> at akka.actor.ActorCell$.(ActorCell.scala)
> at akka.actor.RootActorPath.$div(ActorPath.scala:185)
> at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:465)
> at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:453)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
>
[jira] [Comment Edited] (TOREE-336) Toree not working with Apache Spark 2.0.0
[
https://issues.apache.org/jira/browse/TOREE-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252852#comment-16252852
]
Sivaram Konanki edited comment on TOREE-336 at 11/15/17 2:24 AM:
-
I get this error, when I use follow this:
{noformat}
3a. git clone https://github.com/apache/incubator-toree
3b. cd /path/to/incubator-toree
3c. make clean release APACHE_SPARK_VERSION=2.1.0
3d. pip install toree --no-index
--find-links=/path/to/incubator-toree/dist/toree-pip/toree0.2.0.dev1.tar.gz
3e. jupyter toree install --spark_home=$SPARK_HOME
--spark_opts='--master=local[2] --executor-memory=3G'
{noformat}
{code}
[info] Compiling 48 Scala sources to
/home/toree_source/incubator-toree/protocol/target/scala-2.11/classes ...
[info] Compiling 12 Scala sources and 6 Java sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes ...
[error] ## Exception when compiling 18 sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes
[error] Cannot run program "javac" (in directory
"/home/toree_source/incubator-toree"): error=2, No such file or directory
{code}
was (Author: sivakon):
I get this error, when I use follow this:
3a. git clone https://github.com/apache/incubator-toree
3b. cd /path/to/incubator-toree
3c. make clean release APACHE_SPARK_VERSION=2.1.0
3d. pip install toree --no-index
--find-links=/path/to/incubator-toree/dist/toree-pip/toree0.2.0.dev1.tar.gz
3e. jupyter toree install --spark_home=$SPARK_HOME
--spark_opts='--master=local[2] --executor-memory=3G'
{code}
[info] Compiling 48 Scala sources to
/home/toree_source/incubator-toree/protocol/target/scala-2.11/classes ...
[info] Compiling 12 Scala sources and 6 Java sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes ...
[error] ## Exception when compiling 18 sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes
[error] Cannot run program "javac" (in directory
"/home/toree_source/incubator-toree"): error=2, No such file or directory
{code}
> Toree not working with Apache Spark 2.0.0
> -
>
> Key: TOREE-336
> URL: https://issues.apache.org/jira/browse/TOREE-336
> Project: TOREE
> Issue Type: Bug
> Environment: OSX and ubuntu-14.04, both running scala 2.10.4 and
> spark 2.0.0
>Reporter: Tianhui Li
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Following the instructions on
> https://github.com/apache/incubator-toree/blob/master/README.md, I run
> ```
> pip install --pre toree
> jupyter toree install --spark-home=$SPARK_HOME
> ```
> I'm able to build fine. But upon starting the server and a new scala (or any
> other type of notebook), I an error (provided below). This seems related to
> using scala 2.10 rather than 2.11 (see
> http://stackoverflow.com/questions/29339005/run-main-0-java-lang-nosuchmethoderror-scala-collection-immutable-hashset-emp
> and
> http://stackoverflow.com/questions/30536759/running-a-spark-application-in-intellij-14-1-3).
> Below is the error:
> $ jupyter notebook
> [I 12:11:59.464 NotebookApp] Serving notebooks from local directory:
> /Users/tianhui
> [I 12:11:59.464 NotebookApp] 0 active kernels
> [I 12:11:59.465 NotebookApp] The Jupyter Notebook is running at:
> http://localhost:/
> [I 12:11:59.465 NotebookApp] Use Control-C to stop this server and shut down
> all kernels (twice to skip confirmation).
> [I 12:12:06.847 NotebookApp] 302 GET / (::1) 0.47ms
> [I 12:12:10.591 NotebookApp] Creating new notebook in
> [I 12:12:11.600 NotebookApp] Kernel started:
> 20ca2e71-781b-4208-ad88-bc04c1ca37d6
> Starting Spark Kernel with
> SPARK_HOME=/usr/local/Cellar/apache-spark/2.0.0/libexec/
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Kernel version:
> 0.1.0.dev9-incubating-SNAPSHOT
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Scala version: Some(2.10.4)
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - ZeroMQ (JeroMQ) version: 3.2.2
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Initializing internal actor
> system
> Exception in thread "main" java.lang.NoSuchMethodError:
> scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet;
> at akka.actor.ActorCell$.(ActorCell.scala:336)
> at akka.actor.ActorCell$.(ActorCell.scala)
> at akka.actor.RootActorPath.$div(ActorPath.scala:185)
> at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:465)
> at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:453)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at
[jira] [Comment Edited] (TOREE-336) Toree not working with Apache Spark 2.0.0
[
https://issues.apache.org/jira/browse/TOREE-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16252852#comment-16252852
]
Sivaram Konanki edited comment on TOREE-336 at 11/15/17 2:24 AM:
-
I get this error, when I use follow this:
3a. git clone https://github.com/apache/incubator-toree
3b. cd /path/to/incubator-toree
3c. make clean release APACHE_SPARK_VERSION=2.1.0
3d. pip install toree --no-index
--find-links=/path/to/incubator-toree/dist/toree-pip/toree0.2.0.dev1.tar.gz
3e. jupyter toree install --spark_home=$SPARK_HOME
--spark_opts='--master=local[2] --executor-memory=3G'
{code}
[info] Compiling 48 Scala sources to
/home/toree_source/incubator-toree/protocol/target/scala-2.11/classes ...
[info] Compiling 12 Scala sources and 6 Java sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes ...
[error] ## Exception when compiling 18 sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes
[error] Cannot run program "javac" (in directory
"/home/toree_source/incubator-toree"): error=2, No such file or directory
{code}
was (Author: sivakon):
I get this error, when I use follow this:
{code}
[info] Compiling 48 Scala sources to
/home/toree_source/incubator-toree/protocol/target/scala-2.11/classes ...
[info] Compiling 12 Scala sources and 6 Java sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes ...
[error] ## Exception when compiling 18 sources to
/home/toree_source/incubator-toree/plugins/target/scala-2.11/classes
[error] Cannot run program "javac" (in directory
"/home/toree_source/incubator-toree"): error=2, No such file or directory
{code}
> Toree not working with Apache Spark 2.0.0
> -
>
> Key: TOREE-336
> URL: https://issues.apache.org/jira/browse/TOREE-336
> Project: TOREE
> Issue Type: Bug
> Environment: OSX and ubuntu-14.04, both running scala 2.10.4 and
> spark 2.0.0
>Reporter: Tianhui Li
> Original Estimate: 168h
> Remaining Estimate: 168h
>
> Following the instructions on
> https://github.com/apache/incubator-toree/blob/master/README.md, I run
> ```
> pip install --pre toree
> jupyter toree install --spark-home=$SPARK_HOME
> ```
> I'm able to build fine. But upon starting the server and a new scala (or any
> other type of notebook), I an error (provided below). This seems related to
> using scala 2.10 rather than 2.11 (see
> http://stackoverflow.com/questions/29339005/run-main-0-java-lang-nosuchmethoderror-scala-collection-immutable-hashset-emp
> and
> http://stackoverflow.com/questions/30536759/running-a-spark-application-in-intellij-14-1-3).
> Below is the error:
> $ jupyter notebook
> [I 12:11:59.464 NotebookApp] Serving notebooks from local directory:
> /Users/tianhui
> [I 12:11:59.464 NotebookApp] 0 active kernels
> [I 12:11:59.465 NotebookApp] The Jupyter Notebook is running at:
> http://localhost:/
> [I 12:11:59.465 NotebookApp] Use Control-C to stop this server and shut down
> all kernels (twice to skip confirmation).
> [I 12:12:06.847 NotebookApp] 302 GET / (::1) 0.47ms
> [I 12:12:10.591 NotebookApp] Creating new notebook in
> [I 12:12:11.600 NotebookApp] Kernel started:
> 20ca2e71-781b-4208-ad88-bc04c1ca37d6
> Starting Spark Kernel with
> SPARK_HOME=/usr/local/Cellar/apache-spark/2.0.0/libexec/
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Kernel version:
> 0.1.0.dev9-incubating-SNAPSHOT
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Scala version: Some(2.10.4)
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - ZeroMQ (JeroMQ) version: 3.2.2
> 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Initializing internal actor
> system
> Exception in thread "main" java.lang.NoSuchMethodError:
> scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet;
> at akka.actor.ActorCell$.(ActorCell.scala:336)
> at akka.actor.ActorCell$.(ActorCell.scala)
> at akka.actor.RootActorPath.$div(ActorPath.scala:185)
> at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:465)
> at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:453)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
> at
> akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$2.apply(DynamicAccess.scala:78)
> at scala.util.Try$.apply(Try.scala:192)
> at
> akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:73)
> at
>
[jira] [Comment Edited] (TOREE-336) Toree not working with Apache Spark 2.0.0
[ https://issues.apache.org/jira/browse/TOREE-336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503594#comment-15503594 ] Dmitry Zhukov edited comment on TOREE-336 at 9/19/16 2:07 PM: -- According to Github (https://github.com/apache/incubator-toree/pull/56) PR is already merged. Should this ticket be resolved? Also I have a question. When we may expect a release with the change? Thanks! was (Author: dzhu...@gmail.com): According to Github (https://github.com/apache/incubator-toree/pull/56) PR is already merged. Should this ticket be resolved? Also I have a question. When we may expect the release with the change? Thanks! > Toree not working with Apache Spark 2.0.0 > - > > Key: TOREE-336 > URL: https://issues.apache.org/jira/browse/TOREE-336 > Project: TOREE > Issue Type: Bug > Environment: OSX and ubuntu-14.04, both running scala 2.10.4 and > spark 2.0.0 >Reporter: Tianhui Li > Original Estimate: 168h > Remaining Estimate: 168h > > Following the instructions on > https://github.com/apache/incubator-toree/blob/master/README.md, I run > ``` > pip install --pre toree > jupyter toree install --spark-home=$SPARK_HOME > ``` > I'm able to build fine. But upon starting the server and a new scala (or any > other type of notebook), I an error (provided below). This seems related to > using scala 2.10 rather than 2.11 (see > http://stackoverflow.com/questions/29339005/run-main-0-java-lang-nosuchmethoderror-scala-collection-immutable-hashset-emp > and > http://stackoverflow.com/questions/30536759/running-a-spark-application-in-intellij-14-1-3). > Below is the error: > $ jupyter notebook > [I 12:11:59.464 NotebookApp] Serving notebooks from local directory: > /Users/tianhui > [I 12:11:59.464 NotebookApp] 0 active kernels > [I 12:11:59.465 NotebookApp] The Jupyter Notebook is running at: > http://localhost:/ > [I 12:11:59.465 NotebookApp] Use Control-C to stop this server and shut down > all kernels (twice to skip confirmation). > [I 12:12:06.847 NotebookApp] 302 GET / (::1) 0.47ms > [I 12:12:10.591 NotebookApp] Creating new notebook in > [I 12:12:11.600 NotebookApp] Kernel started: > 20ca2e71-781b-4208-ad88-bc04c1ca37d6 > Starting Spark Kernel with > SPARK_HOME=/usr/local/Cellar/apache-spark/2.0.0/libexec/ > 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Kernel version: > 0.1.0.dev9-incubating-SNAPSHOT > 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Scala version: Some(2.10.4) > 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - ZeroMQ (JeroMQ) version: 3.2.2 > 16/09/03 12:12:12 [INFO] o.a.t.Main$$anon$1 - Initializing internal actor > system > Exception in thread "main" java.lang.NoSuchMethodError: > scala.collection.immutable.HashSet$.empty()Lscala/collection/immutable/HashSet; > at akka.actor.ActorCell$.(ActorCell.scala:336) > at akka.actor.ActorCell$.(ActorCell.scala) > at akka.actor.RootActorPath.$div(ActorPath.scala:185) > at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:465) > at akka.actor.LocalActorRefProvider.(ActorRefProvider.scala:453) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > at > akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$2.apply(DynamicAccess.scala:78) > at scala.util.Try$.apply(Try.scala:192) > at > akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:73) > at > akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84) > at > akka.actor.ReflectiveDynamicAccess$$anonfun$createInstanceFor$3.apply(DynamicAccess.scala:84) > at scala.util.Success.flatMap(Try.scala:231) > at > akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:84) > at akka.actor.ActorSystemImpl.liftedTree1$1(ActorSystem.scala:585) > at akka.actor.ActorSystemImpl.(ActorSystem.scala:578) > at akka.actor.ActorSystem$.apply(ActorSystem.scala:142) > at akka.actor.ActorSystem$.apply(ActorSystem.scala:109) > at > org.apache.toree.boot.layer.StandardBareInitialization$class.createActorSystem(BareInitialization.scala:71) > at org.apache.toree.Main$$anon$1.createActorSystem(Main.scala:35) > at > org.apache.toree.boot.layer.StandardBareInitialization$class.initializeBare(BareInitialization.scala:60) > at org.apache.toree.Main$$anon$1.initializeBare(Main.scala:35) > at > org.apache.toree.boot.KernelBootstrap.initialize(KernelBootstrap.scala:70) >
