without -Ppyspark, interpreter/spark/pyspark/ directory is not being created although PYTHONPATH populated to pointing pyspark.zip and py4j-0.8.2.1-src.zip in that directory.
with -Ppyspark, it will work. Thanks, moon On Sun, Nov 8, 2015 at 10:40 AM Jeff Steinmetz <[email protected]> wrote: > Shows this (I did not build with -Ppyspark). I can rebuild again with > -Ppyspark > > Either way, here is my output (I have a repo in a vagrant VM, and the > build ends up zeppelin-distribution, which is where I run my test) > > %spark > System.getenv("PYTHONPATH") > > > res1: String = > /vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/pyspark.zip:/vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > > > On 11/7/15, 5:34 PM, "moon soo Lee" <[email protected]> wrote: > > >Hi Guillaume, > > > >In my test with the machine that does not py4j installed, it worked > without > >problem. > > > >Could you try to run > > > >%spark > >System.getenv("PYTHONPATH") > > > >in Zeppelin notebook and see output? > >Mine is > > > >res1: String = > > >/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip > > > > > >Thanks, > >moon > > > >On Sat, Nov 7, 2015 at 7:13 PM tog <[email protected]> wrote: > > > >> Hi moon > >> I had to install: "pip install py4j" and then it worked > >> > >> Cheers > >> Guillaume > >> > >> > >> On Nov 7, 2015 9:56 AM, "moon soo Lee" <[email protected]> wrote: > >> > >> > Thanks for verifying. > >> > > >> > Yes that's right. > >> > pyspark in -all archive will work out of box without any > configuration. > >> > > >> > Best, > >> > moon > >> > > >> > On Sat, Nov 7, 2015 at 6:49 PM tog <[email protected]> > wrote: > >> > > >> > > Hi > >> > > > >> > > Before casting my vote I was willing to give a try to pyspark > (which I > >> > have > >> > > never done so far). Is it supposed to work out of the box in local > just > >> > > untaring the -all archive or do I have to configure something? > >> > > > >> > > Cheers > >> > > Guillaume > >> > > > >> > > > >> > > -- > >> > > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net > >> > > > >> > > >> > >
