While I understand the Spark 3.0 is new and not widely widespread yet, it would be good to have an official version of Toree supporting it. I have done some tests on a local Spark 3.0 + Hadoop 2.7 environment, and I was wondering if we as a community could verify that the overall legal and build aspects are ok so we could let users play with it and report any more serious issues?
Thanks. On Fri, Sep 4, 2020 at 3:33 PM Marius van Niekerk <[email protected]> wrote: > > Sadly I don't have an easy spark 3.0 test setup > > On Fri, Sep 4, 2020, 16:21 Luciano Resende <[email protected]> wrote: > > > We are still looking for one more vote. > > > > On Sun, Aug 23, 2020 at 11:03 AM Luciano Resende <[email protected]> > > wrote: > > > > > > Please vote to approve the release of Apache Toree 0.5.0-incubating > > (RC1). > > > > > > The changes in this release are mainly to add support for Spark 3.0.0. > > > > > > > > https://github.com/apache/incubator-toree/compare/v0.4.0-incubating-rc1...v0.5.0-incubating-rc1 > > > > > > > > > Tag: v0.5.0-incubating-rc1 (3825a6c260251f2a9f3684d4d88a328709430406) > > > > > > https://github.com/apache/incubator-toree/tree/v0.5.0-incubating-rc1 > > > > > > All distribution packages, including signatures, digests, etc. can be > > found at: > > > > > > > > https://dist.apache.org/repos/dist/dev/incubator/toree/0.5.0-incubating-rc1/ > > > > > > Staging artifacts can be found at: > > > > > > https://repository.apache.org/content/repositories/orgapachetoree-1017 > > > > > > ## Testing Instructions > > > > > > The fastest way to get up and running is to using Jupyter. > > > > > > 1. Install Jupyter if you haven't already ( > > http://jupyter.org/install.html) > > > > > > 2. Install Apache Toree via `pip install > > > > > https://dist.apache.org/repos/dist/dev/incubator/toree/0.5.0-incubating-rc1/toree-pip/toree-0.5.0.tar.gz` > > <https://dist.apache.org/repos/dist/dev/incubator/toree/0.5.0-incubating-rc1/toree-pip/toree-0.5.0.tar.gz> > > > followed by `jupyter toree install` > > > > > > - You need to set a valid Apache Spark 3.x home, which can be done via > > > `jupyter toree install --spark_home=/usr/local/spark` > > > > > > - You may need to run with `sudo` for installation permission > > > > > > - For all installation options, run `jupyter toree install --help-all` > > > > > > 4. Run a Jupyter notebook server via `jupyter notebook` > > > > > > - If the notebook portion of Jupyter is not installed but Jupyter is, > > > you can install via `pip install notebook` > > > > > > 5. Create a notebook using "Apache Toree - Scala" from the dropdown > > under new > > > dev > > > 6. Run Scala/Spark commands such as `sc.parallelize(1 to 100).sum()` in > > the > > > notebook > > > > > > ## Voting Instructions > > > > > > The vote is open for at least 72 hours and passes if a majority of at > > least > > > 3 +1 PMC votes are cast. > > > > > > [ ] +1 Release this package as Apache Toree 0.5.0-incubating > > > [ ] -1 Do not release this package because ... > > > > > > -- > > > Luciano Resende > > > http://twitter.com/lresende1975 > > > http://lresende.blogspot.com/ > > > > > > > > -- > > Luciano Resende > > http://twitter.com/lresende1975 > > http://lresende.blogspot.com/ > > -- Luciano Resende http://twitter.com/lresende1975 http://lresende.blogspot.com/
