OK - tried again on abrand new Ubuntu VM ... and it worked like a charm Sorry must have been confused between my dev repo and the rc2 deployment
Cheers Guillaume On 8 November 2015 at 10:55, tog <[email protected]> wrote: > Yes I am puzzled - I removed py4j and it worked. > My OS is 10.11.1 (El Capitan) > Will try on a fresh Ubuntu VM and let you know. > > Cheers > Guillaume > > On 8 November 2015 at 10:10, moon soo Lee <[email protected]> wrote: > >> yes, PYTHONPATH looks fine. If your filesystem has >> >> >> /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip >> >> /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip >> >> then, it supposed to work without py4j installed in your system. >> >> Could you share your OS? >> >> Thanks, >> moon >> >> On Sun, Nov 8, 2015 at 7:04 PM tog <[email protected]> wrote: >> >> > Hi Moon >> > >> > Here is what I get with zeppelin-0.5.5-incubating-bin-all: >> > res0: String = >> > >> > >> /Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/tog/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip >> > >> > >> > this looks fine >> > Cheers >> > Guillaume >> > >> > >> > On 8 November 2015 at 01:46, moon soo Lee <[email protected]> wrote: >> > >> > > without -Ppyspark, interpreter/spark/pyspark/ directory is not being >> > > created although PYTHONPATH populated to pointing pyspark.zip >> > > and py4j-0.8.2.1-src.zip in that directory. >> > > >> > > with -Ppyspark, it will work. >> > > >> > > Thanks, >> > > moon >> > > >> > > On Sun, Nov 8, 2015 at 10:40 AM Jeff Steinmetz < >> > > [email protected]> >> > > wrote: >> > > >> > > > Shows this (I did not build with -Ppyspark). I can rebuild again >> with >> > > > -Ppyspark >> > > > >> > > > Either way, here is my output (I have a repo in a vagrant VM, and >> the >> > > > build ends up zeppelin-distribution, which is where I run my test) >> > > > >> > > > %spark >> > > > System.getenv("PYTHONPATH") >> > > > >> > > > >> > > > res1: String = >> > > > >> > > >> > >> /vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/pyspark.zip:/vagrant/incubator-zeppelin/zeppelin-distribution/target/zeppelin-0.5.6-incubating-SNAPSHOT/zeppelin-0.5.6-incubating-SNAPSHOT/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip >> > > > >> > > > >> > > > >> > > > >> > > > On 11/7/15, 5:34 PM, "moon soo Lee" <[email protected]> wrote: >> > > > >> > > > >Hi Guillaume, >> > > > > >> > > > >In my test with the machine that does not py4j installed, it worked >> > > > without >> > > > >problem. >> > > > > >> > > > >Could you try to run >> > > > > >> > > > >%spark >> > > > >System.getenv("PYTHONPATH") >> > > > > >> > > > >in Zeppelin notebook and see output? >> > > > >Mine is >> > > > > >> > > > >res1: String = >> > > > >> > > > >> > > >> > >> >/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/pyspark.zip:/Users/moon/Downloads/zeppelin-0.5.5-incubating-bin-all/interpreter/spark/pyspark/py4j-0.8.2.1-src.zip >> > > > > >> > > > > >> > > > >Thanks, >> > > > >moon >> > > > > >> > > > >On Sat, Nov 7, 2015 at 7:13 PM tog <[email protected]> >> > wrote: >> > > > > >> > > > >> Hi moon >> > > > >> I had to install: "pip install py4j" and then it worked >> > > > >> >> > > > >> Cheers >> > > > >> Guillaume >> > > > >> >> > > > >> >> > > > >> On Nov 7, 2015 9:56 AM, "moon soo Lee" <[email protected]> wrote: >> > > > >> >> > > > >> > Thanks for verifying. >> > > > >> > >> > > > >> > Yes that's right. >> > > > >> > pyspark in -all archive will work out of box without any >> > > > configuration. >> > > > >> > >> > > > >> > Best, >> > > > >> > moon >> > > > >> > >> > > > >> > On Sat, Nov 7, 2015 at 6:49 PM tog <[email protected] >> > >> > > > wrote: >> > > > >> > >> > > > >> > > Hi >> > > > >> > > >> > > > >> > > Before casting my vote I was willing to give a try to pyspark >> > > > (which I >> > > > >> > have >> > > > >> > > never done so far). Is it supposed to work out of the box in >> > local >> > > > just >> > > > >> > > untaring the -all archive or do I have to configure >> something? >> > > > >> > > >> > > > >> > > Cheers >> > > > >> > > Guillaume >> > > > >> > > >> > > > >> > > >> > > > >> > > -- >> > > > >> > > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net >> > > > >> > > >> > > > >> > >> > > > >> >> > > > >> > > > >> > > >> > >> > >> > >> > -- >> > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net >> > >> > > > > -- > PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net > -- PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net
