yes, PYTHONPATH looks fine. If your filesystem has /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip
then, it supposed to work without py4j installed in your system. Could you share your OS? Thanks, moon On Sun, Nov 8, 2015 at 7:04 PM tog <[email protected]> wrote: > Hi Moon > > Here is what I get with zeppelin-0.5.5-incubating-bin-all: > res0: String = > > /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > this looks fine > Cheers > Guillaume > > > On 8 November 2015 at 01:46, moon soo Lee <[email protected]> wrote: > > > without -Ppyspark, interpreter/spark/pyspark/ directory is not being > > created although PYTHONPATH populated to pointing pyspark.zip > > and py4j-0.8.2.1-src.zip in that directory. > > > > with -Ppyspark, it will work. > > > > Thanks, > > moon > > > > On Sun, Nov 8, 2015 at 10:40 AM Jeff Steinmetz < > > [email protected]> > > wrote: > > > > > Shows this (I did not build with -Ppyspark). I can rebuild again with > > > -Ppyspark > > > > > > Either way, here is my output (I have a repo in a vagrant VM, and the > > > build ends up zeppelin-distribution, which is where I run my test) > > > > > > %spark > > > System.getenv("PYTHONPATH") > > > > > > > > > res1: String = > > > > > > /vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/pyspark.zip:/vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > > > > > > > > > > > > > On 11/7/15, 5:34 PM, "moon soo Lee" <[email protected]> wrote: > > > > > > >Hi Guillaume, > > > > > > > >In my test with the machine that does not py4j installed, it worked > > > without > > > >problem. > > > > > > > >Could you try to run > > > > > > > >%spark > > > >System.getenv("PYTHONPATH") > > > > > > > >in Zeppelin notebook and see output? > > > >Mine is > > > > > > > >res1: String = > > > > > > > > > >/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > > > > > > > > > >Thanks, > > > >moon > > > > > > > >On Sat, Nov 7, 2015 at 7:13 PM tog <[email protected]> > wrote: > > > > > > > >> Hi moon > > > >> I had to install: "pip install py4j" and then it worked > > > >> > > > >> Cheers > > > >> Guillaume > > > >> > > > >> > > > >> On Nov 7, 2015 9:56 AM, "moon soo Lee" <[email protected]> wrote: > > > >> > > > >> > Thanks for verifying. > > > >> > > > > >> > Yes that's right. > > > >> > pyspark in -all archive will work out of box without any > > > configuration. > > > >> > > > > >> > Best, > > > >> > moon > > > >> > > > > >> > On Sat, Nov 7, 2015 at 6:49 PM tog <[email protected]> > > > wrote: > > > >> > > > > >> > > Hi > > > >> > > > > > >> > > Before casting my vote I was willing to give a try to pyspark > > > (which I > > > >> > have > > > >> > > never done so far). Is it supposed to work out of the box in > local > > > just > > > >> > > untaring the -all archive or do I have to configure something? > > > >> > > > > > >> > > Cheers > > > >> > > Guillaume > > > >> > > > > > >> > > > > > >> > > -- > > > >> > > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net > > > >> > > > > > >> > > > > >> > > > > > > > > > > > > -- > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net >
