Re: [VOTE] Apache Toree 0.4.0 RC1

And my +1 Tested a few things in a local docker setup. On Fri, Jul 17, 2020, 20:41 Kevin Bates wrote: > +1, Thanks Luciano! > > On Fri, Jul 17, 2020 at 10:32 AM Luciano Resende > wrote: > > > Off course, my +1 > > > > On Thu, Jul 16, 2020 at 12:25 PM Luciano Resende > > wrote: > > > > > >

Re: [VOTE] Apache Toree 0.3.0 RC1

ee - Scala" from the dropdown > under new > > > dev > > > 6. Run Scala/Spark commands such as `sc.parallelize(1 to 100).sum()` > in the > > > notebook > > > > > > ## Voting Instructions > > > > > > The vote is open for at least 72 hours and passes if a majority of at > least > > > 3 +1 PMC votes are cast. > > > > > > [ ] +1 Release this package as Apache Toree 0.3.0-incubating > > > [ ] -1 Do not release this package because ... > > > > > > > > > Off course, my +1 > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > -- regards Marius van Niekerk

Re: [VOTE] Apache Toree 0.2.0 RC6

mands such as `sc.parallelize(1 to 100).sum()` in the > notebook > > ## Voting Instructions > > The vote is open for at least 72 hours and passes if a majority of at > least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Toree 0.2.0-incubating > [ ] -1 Do not release this package because ... > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- regards Marius van Niekerk

Re: jar import issues

ld not be loaded, neither did an > import work). > > I could assume that it's maybe a scala version issue? My project is > compiled against 2.12.3, I couldn't find scala version that toree is using. > > Did somebody face this issue? How could I debug what is wrong? > > Thanks > Best regards, > Igor > -- regards Marius van Niekerk

Re: [VOTE] Apache Toree 0.2.0 RC5

e(1 to 100).sum()` in > the > > notebook > > > > ## Voting Instructions > > > > The vote is open for at least 72 hours and passes if a majority of at > > least > > 3 +1 PMC votes are cast. > > > > [ ] +1 Release this package as Apache Toree 0.2.0-incubating > > [ ] -1 Do not release this package because ... > > > > > > Off course, here is my +1. > > Other committers and mentors, please vote here. > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- regards Marius van Niekerk

Re: [VOTE] Apache Toree 0.2.0 RC4

Tested using binderhub, ran a few notebook tests. On Sat, Apr 7, 2018, 07:26 Marius van Niekerk <marius.v.niek...@gmail.com> wrote: > +1 > > On Wed, Apr 4, 2018, 21:45 Luciano Resende <luckbr1...@gmail.com> wrote: > >> Thanks Ryan, >> >> All others

Re: [VOTE] Apache Toree 0.2.0 RC3

tebook > > > > > > ## Voting Instructions > > > > > > The vote is open for at least 72 hours and passes if a majority of at > > > least > > > 3 +1 PMC votes are cast. > > > > > > [ ] +1 Release this package as Apache Toree 0.2.0-incubating > > > [ ] -1 Do not release this package because ... > > > > > > -- > > > Luciano Resende > > > http://twitter.com/lresende1975 > > > http://lresende.blogspot.com/ > > > > > > > > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > > > -- regards Marius van Niekerk

Re: Pyspark Support for magic commands

park. I noticed that the current > version of the pyspark kernel does not have magic commands, in particular > "%matplotlib inline" Will this feature be included in the future? If not, > is there anyway to show the matplotlib graphs in-line in the jupyter > notebook? > > Lili > > > -- regards Marius van Niekerk

Re: Toree Release 0.2

ting/merging them and prepare for a 0.2 release > maybe by middle to end of July ? > > Thoughts ? > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- regards Marius van Niekerk

Re: Running out of space on Travis.CI build

space left on > device > > tar: spark-2.0.0-bin-hadoop2.6/python/run-tests.py: Cannot open: No such > file or directory > > tar: spark-2.0.0-bin-hadoop2.6/python: Cannot mkdir: No space left on > device > > tar: spark-2.0.0-bin-hadoop2.6/python/test_support: Cannot mkdir: No such > file or directory > > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- regards Marius van Niekerk

Re: Uploading PIP for 0.1.0 release

case? Can we host official releases on > > Pypi? > > >>>>>>> > > >>>>>> > > >>>>>> Official releases are ok to go there. > > >>>>>> > > >>>>>> > > >>>>>> > > >>>>>>> If not, we can just indicate that they install via `pip install > > >>>>>>> > https://dist.apache.org/repos/dist/release/incubator/toree/0.1.0- > > >>>>>>> incubating/toree-pip/apache-toree-0.1.0.tar.gz` or whatever the > > >>>>>>> command is that Gino was mentioning. > > >>>>>>> > > >>>>>>> If we want and are allowed to publish on Pypi, I'll do that soon. > > >>>>>>> Just let me know. > > >>>>>>> > > >>>>>>> > > >>>>>> Yes, please. > > >>>>>> > > >>>>>> -- > > >>>>>> Luciano Resende > > >>>>>> http://twitter.com/lresende1975 > > >>>>>> http://lresende.blogspot.com/ > > >>>>>> > > >>>>> > > >>>> > > >>>> > > >>>> -- > > >>>> Luciano Resende > > >>>> http://twitter.com/lresende1975 > > >>>> http://lresende.blogspot.com/ > > >>>> > > >>> > > >> > > >> > > >> -- > > >> Luciano Resende > > >> http://twitter.com/lresende1975 > > >> http://lresende.blogspot.com/ > > >> > > > > > > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > > > -- regards Marius van Niekerk

[jira] [Commented] (TOREE-395) Provide a way to disable automatic printing of results in Toree Scala

[ https://issues.apache.org/jira/browse/TOREE-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15936967#comment-15936967 ] Marius Van Niekerk commented on TOREE-395: -- I'm perfectly fine with it being removed completely

Re: [VOTE] Apache Toree 0.1.0 RC6

the > interpreters via `jupyter toree install --interpreters=PySpark,SQL` > > 6. Run Scala/Spark commands such as `sc.parallelize(1 to 100).sum()` in the > notebook > > ## Voting Instructions > > The vote is open for at least 72 hours and passes if a majority of at least > 3 +1 PMC votes are cast. > > [ ] +1 Release this package as Apache Toree 0.1.0 > [ ] -1 Do not release this package because ... > -- regards Marius van Niekerk

Re: Toree for 1.6.x is broken

; not > > > > > > > bind on port 0. Attempting port 1. > > > > > > > 17/02/15 16:41:29 [ERROR] o.a.s.SparkContext - Error > initializing > > > > > > > SparkContext. > > > > > > > java.net.BindException: Can't assign requested address: Service > > > > > > > 'sparkDriver' failed after 16 retries! > > > > > > > at sun.nio.ch.Net.bind0(Native Method) > > > > > > > at sun.nio.ch.Net.bind(Net.java:433) > > > > > > > at sun.nio.ch.Net.bind(Net.java:425) > > > > > > > at > > > > > > > sun.nio.ch > > > > > > .ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) > > > > > > > at sun.nio.ch > > > .ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:485) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1089) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:430) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:415) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:903) > > > > > > > at > > io.netty.channel.AbstractChannel.bind(AbstractChannel.java:198) > > > > > > > at > > > > > > > io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:348) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) > > > > > > > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) > > > > > > > at > > > > > > > > > > > > > > > > > > > > > > > > > > > > io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) > > > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > regards > > Marius van Niekerk > > > -- regards Marius van Niekerk

Re: Toree for 1.6.x is broken

> > > > at > > > > > sun.nio.ch > > > > .ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223) > > > > > at sun.nio.ch > .ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) > > > > > at > > > > > > > > > > > > > > > io.netty.channel.socket.nio.NioServerSocketChannel.doBind(NioServerSocketChannel.java:125) > > > > > at > > > > > > > > > > > > > > > io.netty.channel.AbstractChannel$AbstractUnsafe.bind(AbstractChannel.java:485) > > > > > at > > > > > > > > > > > > > > > io.netty.channel.DefaultChannelPipeline$HeadContext.bind(DefaultChannelPipeline.java:1089) > > > > > at > > > > > > > > > > > > > > > io.netty.channel.AbstractChannelHandlerContext.invokeBind(AbstractChannelHandlerContext.java:430) > > > > > at > > > > > > > > > > > > > > > io.netty.channel.AbstractChannelHandlerContext.bind(AbstractChannelHandlerContext.java:415) > > > > > at > > > > > > > > > > > > > > > io.netty.channel.DefaultChannelPipeline.bind(DefaultChannelPipeline.java:903) > > > > > at io.netty.channel.AbstractChannel.bind(AbstractChannel.java:198) > > > > > at > > > io.netty.bootstrap.AbstractBootstrap$2.run(AbstractBootstrap.java:348) > > > > > at > > > > > > > > > > > > > > > io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357) > > > > > at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357) > > > > > at > > > > > > > > > > > > > > > io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111) > > > > > at java.lang.Thread.run(Thread.java:745) > > > > > > > > > > > > > > > -- regards Marius van Niekerk

Re: Classloader exceptions when testing

te any input as > to why the exceptions are raised in the first place and whether my > proposal is actually a clean fix or just some quick hack. > > cheers, > --Jakob > -- regards Marius van Niekerk

Re: Linking JIRA with GitHub

; --Jakob > -- regards Marius van Niekerk

[jira] [Commented] (TOREE-363) Syntax Highlighting Breaks

[ https://issues.apache.org/jira/browse/TOREE-363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857194#comment-15857194 ] Marius Van Niekerk commented on TOREE-363: -- So i believe we are passing the wrong mimetype

[jira] [Commented] (TOREE-374) Variables declared on the Notebook are not garbage collected

[ https://issues.apache.org/jira/browse/TOREE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856905#comment-15856905 ] Marius Van Niekerk commented on TOREE-374: -- As for actual fixes for the cell repl classes, I dont

[jira] [Commented] (TOREE-374) Variables declared on the Notebook are not garbage collected

[ https://issues.apache.org/jira/browse/TOREE-374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856898#comment-15856898 ] Marius Van Niekerk commented on TOREE-374: -- So zeppelin has a partial workaround

[jira] [Commented] (TOREE-375) Incorrect fully qualified name for spark context

[ https://issues.apache.org/jira/browse/TOREE-375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856688#comment-15856688 ] Marius Van Niekerk commented on TOREE-375: -- Yeah, zeppelin works around this with a pretty crazy

Re: Podling Report

Seems that my wiki user no longer works? Not sure what happened On Wed, 1 Feb 2017 at 13:00 Marius van Niekerk <marius.v.niek...@gmail.com> wrote: > I can take a stab at it. No real major changes from last time, other > than removal of the binary pieces > > On Wed, Feb 1

Calling a vote again?

I think we've cleared out the required static jar pieces. Should we call a vote again? -Marius -- regards Marius van Niekerk

Re: Development model

nv, etc Which will then make > it easy for newcomers that are used to sbt to get started while they learn > about the make magics. > > Thoughts ? > > > -- > Luciano Resende > http://twitter.com/lresende1975 > http://lresende.blogspot.com/ > -- regards Marius van Niekerk

Re: [VOTE] Apache Toree 0.1.0 RC4

+1 Ran some sample spark notebooks in yarn-client mode against the provided binaries and a locally built copy. -Marius van Niekerk On Wed, 11 Jan 2017 at 00:38 Luciano Resende <luckbr1...@gmail.com> wrote: > +1 > > Went over some legal files, verified some parts of the

Re: Should we start another release vote?

't in staging at the > > > > time of the vote for RC3, should we have another release vote? > > > > -- > Sent from my Mobile device > -- regards Marius van Niekerk

Re: [jira] [Created] (TOREE-354) Scala Error with Apache Spark when run in Jupyter

ver, I'm still > unable to get it working for some reason. > > I followed the instructions listed on their official site. > https://toree.apache.org/documentation/user/quick-start > > This is my path variables > {noformat} > scala> root@ubuntu-2gb-sgp1-01:~# echo $PATH > > /root/bin:/root/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/local/spark:/usr/local/spark/bin > {noformat} > > Thanks and much appreciated. > > > > > > -- > This message was sent by Atlassian JIRA > (v6.3.4#6332) > -- regards Marius van Niekerk

Re: Issue when running toree, with jupyterhub, and ambari

t; > > > > > > > > On 11/17/16, 3:15 PM, "Marius van Niekerk" <marius.v.niek...@gmail.com> > wrote: > > >So for the topology files are read by /usr/bin/env Python . You can > >change > >it to point at the system Python or make those

Re: Issue when running toree, with jupyterhub, and ambari

k notebook > and did not have the same issue, so it seems to be something related to > toree’s integration with jupyterhub. > > I’ve updated the files to handle both python 2 & 3, but they seem to be > recreated when ambari and the cluster restart. I’m looking for a more > stab

Re: toree does not work out of the box

t > > akka.actor.ReflectiveDynamicAccess.createInstanceFor(DynamicAccess.scala:84) > > at akka.actor.ActorSystemImpl.liftedTree1$1(ActorSystem.scala:585) > > at akka.actor.ActorSystemImpl.(ActorSystem.scala:578) > > at akka.actor.ActorSystem$.apply(ActorSystem.scala:142) > > at akka.actor.ActorSystem$.apply(ActorSystem.scala:109) > > at > > org.apache.toree.boot.layer.StandardBareInitialization$class.createActorSystem(BareInitialization.scala:71) > > at org.apache.toree.Main$$anon$1.createActorSystem(Main.scala:35) > > at > > org.apache.toree.boot.layer.StandardBareInitialization$class.initializeBare(BareInitialization.scala:60) > > at org.apache.toree.Main$$anon$1.initializeBare(Main.scala:35) > > at > org.apache.toree.boot.KernelBootstrap.initialize(KernelBootstrap.scala:72) > > at org.apache.toree.Main$delayedInit$body.apply(Main.scala:40) > > at scala.Function0$class.apply$mcV$sp(Function0.scala:34) > > at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12) > > at scala.App$$anonfun$main$1.apply(App.scala:76) > > at scala.App$$anonfun$main$1.apply(App.scala:76) > > at scala.collection.immutable.List.foreach(List.scala:381) > > at > > scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:35) > > at scala.App$class.main(App.scala:76) > > at org.apache.toree.Main$.main(Main.scala:24) > > at org.apache.toree.Main.main(Main.scala) > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > at > > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > > at java.lang.reflect.Method.invoke(Method.java:498) > > at > > org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:736) > > at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:185) > > at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:210) > > at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:124) > > at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) > > [W 10:57:42.178 NotebookApp] Timeout waiting for kernel_info reply from > ab31e5cc-068b-4884-ab31-bb0dc4cf8286 > > So at this point, I don't know how to use Toree. I tried to build it from > source but there are no instruction on how to install from source. > > Can you guys take a look at this? > > Thanks, > Ryan > -- regards Marius van Niekerk

[jira] [Created] (TOREE-352) Handle the `kernel_info_request` jupyter message

Marius Van Niekerk created TOREE-352: Summary: Handle the `kernel_info_request` jupyter message Key: TOREE-352 URL: https://issues.apache.org/jira/browse/TOREE-352 Project: TOREE Issue

Re: Podling Report Reminder - November 2016

access on general@incubator. > > Take last month report as a template (search for Toree) and create a > thread hear so that we can all contribute. > > Then edit this months wiki page. > > Gino B. > > > On Nov 1, 2016, at 6:03 PM, Marius van Niekerk < > mariusvniek...@a

Re: [VOTE] Apache Toree 0.1.0 RC3

On 2016-10-28 08:49 (-0400), Marius van Niekerk <marius.v.niek...@gmail.com> wrote: > +1 > On Thu, Oct 27, 2016 at 10:35 Gino Bustelo <g...@bustelos.com> wrote: > > > Please vote to approve the release of the following candidate as > > Apache Toree ver

[jira] [Commented] (TOREE-345) Spark 2.0.0 Fails when trying to use spark-avro

[ https://issues.apache.org/jira/browse/TOREE-345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620532#comment-15620532 ] Marius Van Niekerk commented on TOREE-345: -- Hi Hollin, I can help guide you on our gitter channel

Re: [VOTE] Apache Toree 0.1.0 RC3

+1 On Thu, Oct 27, 2016 at 10:35 Gino Bustelo wrote: > Please vote to approve the release of the following candidate as > Apache Toree version 0.1.0. Pay special attention to the LICENSE and > NOTICE files since this is our first release. > > > The tag to be voted on is

Re: [VOTE] Apache Toree 0.1.0 RC2

I believe we need to make another vote thread. On Wed, Oct 26, 2016 at 16:18 Gino Bustelo wrote: > I address the NOTICE and the KEYS issues above. Put out another RC at > https://dist.apache.org/repos/dist/dev/incubator/toree/0.1.0/rc3/. Do I > create another VOTE thread here

[jira] [Commented] (TOREE-349) ClassCastException when reading Avro from another thread (Toree master / Spark 2.0.0)

[ https://issues.apache.org/jira/browse/TOREE-349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583801#comment-15583801 ] Marius Van Niekerk commented on TOREE-349: -- So do you need to do the same thing for spark-shell

[jira] [Commented] (TOREE-349) ClassCastException when reading Avro from another thread (Toree master / Spark 2.0.0)

[ https://issues.apache.org/jira/browse/TOREE-349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15575398#comment-15575398 ] Marius Van Niekerk commented on TOREE-349: -- So for your separate thread do you set

Re: [VOTE] Apache Toree 0.1.0 RC2

+1 On Tue, 11 Oct 2016 at 16:22 Gino Bustelo wrote: > Tagged as v0.1.0-rc2 and points to the commit. I was trying to avoid overly > tagging and reserving them for actual releases. Instead... I was placing a > commit to mark the RC. > > On Tue, Oct 11, 2016 at 3:14 PM Luciano

[jira] [Created] (TOREE-342) Switch tab completer to the default used for scala 2.11 console

Marius Van Niekerk created TOREE-342: Summary: Switch tab completer to the default used for scala 2.11 console Key: TOREE-342 URL: https://issues.apache.org/jira/browse/TOREE-342 Project: TOREE

[jira] [Commented] (TOREE-343) Added support for jupyter message `is_complete_request`

[ https://issues.apache.org/jira/browse/TOREE-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526458#comment-15526458 ] Marius Van Niekerk commented on TOREE-343: -- Pull request started in https://github.com/apache

[jira] [Created] (TOREE-343) Added support for jupyter message `is_complete_request`

Marius Van Niekerk created TOREE-343: Summary: Added support for jupyter message `is_complete_request` Key: TOREE-343 URL: https://issues.apache.org/jira/browse/TOREE-343 Project: TOREE

[jira] [Commented] (TOREE-303) jupyter console requires extra blank lines following first command; throws warnings

[ https://issues.apache.org/jira/browse/TOREE-303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15526401#comment-15526401 ] Marius Van Niekerk commented on TOREE-303: -- This is addressed for the Scala kernel by https

[jira] [Created] (TOREE-341) Toree scala kernel doesn't handle exceptions correctly

Marius Van Niekerk created TOREE-341: Summary: Toree scala kernel doesn't handle exceptions correctly Key: TOREE-341 URL: https://issues.apache.org/jira/browse/TOREE-341 Project: TOREE

[jira] [Commented] (TOREE-112) Add Scala 2.11.7 support

[ https://issues.apache.org/jira/browse/TOREE-112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485214#comment-15485214 ] Marius Van Niekerk commented on TOREE-112: -- I think we can close this one now > Add Scala 2.1