Hi Moon Here is what I get with zeppelin-0.5.5-incubating-bin-all: res0: String = /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip
this looks fine Cheers Guillaume On 8 November 2015 at 01:46, moon soo Lee <[email protected]> wrote: > without -Ppyspark, interpreter/spark/pyspark/ directory is not being > created although PYTHONPATH populated to pointing pyspark.zip > and py4j-0.8.2.1-src.zip in that directory. > > with -Ppyspark, it will work. > > Thanks, > moon > > On Sun, Nov 8, 2015 at 10:40 AM Jeff Steinmetz < > [email protected]> > wrote: > > > Shows this (I did not build with -Ppyspark). I can rebuild again with > > -Ppyspark > > > > Either way, here is my output (I have a repo in a vagrant VM, and the > > build ends up zeppelin-distribution, which is where I run my test) > > > > %spark > > System.getenv("PYTHONPATH") > > > > > > res1: String = > > > /vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/pyspark.zip:/vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > > > > > > > > On 11/7/15, 5:34 PM, "moon soo Lee" <[email protected]> wrote: > > > > >Hi Guillaume, > > > > > >In my test with the machine that does not py4j installed, it worked > > without > > >problem. > > > > > >Could you try to run > > > > > >%spark > > >System.getenv("PYTHONPATH") > > > > > >in Zeppelin notebook and see output? > > >Mine is > > > > > >res1: String = > > > > > >/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > > > > > > >Thanks, > > >moon > > > > > >On Sat, Nov 7, 2015 at 7:13 PM tog <[email protected]> wrote: > > > > > >> Hi moon > > >> I had to install: "pip install py4j" and then it worked > > >> > > >> Cheers > > >> Guillaume > > >> > > >> > > >> On Nov 7, 2015 9:56 AM, "moon soo Lee" <[email protected]> wrote: > > >> > > >> > Thanks for verifying. > > >> > > > >> > Yes that's right. > > >> > pyspark in -all archive will work out of box without any > > configuration. > > >> > > > >> > Best, > > >> > moon > > >> > > > >> > On Sat, Nov 7, 2015 at 6:49 PM tog <[email protected]> > > wrote: > > >> > > > >> > > Hi > > >> > > > > >> > > Before casting my vote I was willing to give a try to pyspark > > (which I > > >> > have > > >> > > never done so far). Is it supposed to work out of the box in local > > just > > >> > > untaring the -all archive or do I have to configure something? > > >> > > > > >> > > Cheers > > >> > > Guillaume > > >> > > > > >> > > > > >> > > -- > > >> > > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net > > >> > > > > >> > > > >> > > > > > -- PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net
