I have tested and with SPARK_HOME env variable specified, it works without problem.
but without SPARK_HOME, it does not work. To make it work with default configuration, need to activate spark-1.5 and hadoop-2.4 profile by default. I have created issue and pullrequest for it https://issues.apache.org/jira/browse/ZEPPELIN-397 as well as Felix mentioned one(pyspark) https://issues.apache.org/jira/browse/ZEPPELIN-396. Also i realized that rc1 package's embedded spark is version 1.4.1, instead of 1.5.1. All these issues are not a problem when user set SPARK_HOME environment variable. But with default configuration, the problem appear. Now, i'm more and more feeling restarting a vote with ZEPPELIN-397 and ZEPPELIN-396 applied is right choice. On Fri, Nov 6, 2015 at 11:59 AM Kevin (Sangwoo) Kim <[email protected]> wrote: > I got problem loading data from S3. > > sc.textFile(s"s3n://~~~").count > > java.lang.NoClassDefFoundError: org/jets3t/service/ServiceException > any idea? > > > 2015년 11월 6일 (금) 오전 11:57, Felix Cheung <[email protected]>님이 작성: > > > I see, it does sound like we should add -Ppyspark.I'm ok without it if we > > are shipping rc1 as is. But if we are to roll rc2 we should really build > > with it. > > > > > > _____________________________ > > From: moon soo Lee <[email protected]> > > Sent: Thursday, November 5, 2015 6:15 PM > > Subject: Re: [VOTE] Release Apache Zeppelin (incubating) 0.5.5-incubating > > To: <[email protected]> > > > > > > Thanks for verifying RC. > > > > pyspark is working when i set SPARK_HOME in rc1. Not working without it. > > > > I have tested adding "-Ppyspark" to release script > > > > > https://github.com/apache/incubator-zeppelin/blob/master/dev/create_release.sh#L125 > > . > > That makes pyspark work in default configuration. > > > > So, we can either a) continue the vote rc1 as is and apply the change in > > 0.5.6 with other updates, or b) change build profile and restart vote > with > > rc2. > > I'm okay with both ways. > > > > Thanks, > > moon > > > > On Fri, Nov 6, 2015 at 10:17 AM Felix Cheung <[email protected] > > > > wrote: > > > > > I couldn't get pyspark working this build, could someone cross check? > > > > > > > > > > > > > > > > > > > > > On Thu, Nov 5, 2015 at 4:31 PM -0800, "Corneau Damien" < > > > [email protected]> wrote: > > > +1 > > > On Nov 6, 2015 9:09 AM, "Alexander Bezzubov" <[email protected]> wrote: > > > > > > > +1 > > > > > > > > On Fri, Nov 6, 2015, 04:13 rohit choudhary <[email protected]> > > wrote: > > > > > > > > > +1 > > > > > > > > > > Thanks, > > > > > Rohit. > > > > > > > > > > On Thu, Nov 5, 2015 at 10:45 PM, Renjith Kamath < > > > > [email protected]> > > > > > wrote: > > > > > > > > > > > +1 > > > > > > Thanks & Regards, > > > > > > RK > > > > > > > > > > > > > > > > > > On Thu, Nov 5, 2015 at 10:39 PM, Paul Curtis < > > [email protected]> > > > > > wrote: > > > > > > > Would have liked my PR in there, but +1 > > > > > > > > > > > > > > On Thu, Nov 5, 2015 at 10:00 AM, moon soo Lee < > [email protected]> > > > > wrote: > > > > > > > > > > > > > >> Hi folks, > > > > > > >> > > > > > > >> I propose the following RC to be released for the Apache > > Zeppelin > > > > > > >> (incubating) 0.5.5-incubating release. > > > > > > >> > > > > > > >> > > > > > > >> The commit id is 72e38d0b3c3ba8b08ba1176c2eb2c38661a54d31 : > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=incubator-zeppelin.git;a=commit;h=72e38d0b3c3ba8b08ba1176c2eb2c38661a54d31 > > > > > > >> > > > > > > >> This corresponds to the tag: v0.5.5 : > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://git-wip-us.apache.org/repos/asf?p=incubator-zeppelin.git;a=tag;h=refs/tags/v0.5.5 > > > > > > >> > > > > > > >> The release archives (tgz), signature, and checksums are here > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://dist.apache.org/repos/dist/dev/incubator/zeppelin/0.5.5-incubating-rc1/ > > > > > > >> > > > > > > >> The release candidate consists of the following source > > > distribution > > > > > > archive > > > > > > >> zeppelin-0.5.5-incubating.tgz > > > > > > >> > > > > > > >> In addition, the following supplementary binary distributions > > are > > > > > > provided > > > > > > >> for user convenience at the same location > > > > > > >> zeppelin-0.5.5-incubating-bin-all.tgz > > > > > > >> > > > > > > >> > > > > > > >> The maven artifacts are here > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://repository.apache.org/content/repositories/orgapachezeppelin-1001/org/apache/zeppelin/ > > > > > > >> > > > > > > >> You can find the KEYS file here: > > > > > > >> > > > https://dist.apache.org/repos/dist/release/incubator/zeppelin/KEYS > > > > > > >> > > > > > > >> Release notes available at > > > > > > >> > > > > > > >> > > > > > > > > > > > > > > > > > > > > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316221&version=12333531 > > > > > > >> > > > > > > >> Vote will be open for next 72 hours (close at 7am 8/Nov PDT). > > > > > > >> > > > > > > >> [ ] +1 approve > > > > > > >> [ ] 0 no opinion > > > > > > >> [ ] -1 disapprove (and reason why) > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > *Paul Curtis *- Field Enablement Team > > > > > > > *O: *+1 203-660-0015 - *M:* +1 203-539-9705 > > > > > > > > > > > > > > Now Available - Free Hadoop On-Demand Training > > > > > > > < > > > > > > > > > > > > > > > > > > > > > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > > > > > > > > > > > > > > > > > > > > > > > > >
