The problem as I see it is that there appears to be no way to request Zeppelin to load the .egg file (Python module containing PySpark-Cassandra interface).
I opened ZEPPELIN-71 for this, but have seen no progress other than acknowledgement. Perhaps additional feedback in the JIRA ticket would help the Zeppelin team with prioritization. :-) I hope to find time over the upcoming holiday weekend (US) to look further into fixing it - my first attempt failed. On Tue, May 19, 2015 at 9:21 AM Jonathan Haddad <[email protected]> wrote: > What I meant was I couldn't figure out how to get the Cassandra connector > to work in pyspark. I had asked previously (including the flags I pass to > pyspark) and gotten no response. > > If you've got a recommendation as to how to make the equivilent of this > work in Zeppelin I'd love to give it a try: > > PYSPARK_ROOT=/Users/jhaddad/dev/pyspark-cassandra/target > export PYSPARK_DRIVER_PYTHON=ipython PYSPARK_DRIVER_PYTHON_OPTS="notebook" > > pyspark \ > --jars ${PYSPARK_ROOT}/pyspark_cassandra-0.1.4.jar \ > --driver-class-path ${PYSPARK_ROOT}/pyspark_cassandra-0.1.4.jar \ > --py-files ${PYSPARK_ROOT}/pyspark_cassandra-0.1.4-py2.7.egg \ > --conf spark.cassandra.connection.host=127.0.0.1 \ > --master spark://127.0.0.1:7077 \ > > Jon > > On Tue, May 19, 2015 at 4:30 AM moon soo Lee <[email protected]> wrote: > >> Hi, >> >> First, thanks for trying Zeppelin. >> >> You guys mean pyspark is not working? >> I'm developing zeppelin on OSX, so Zeppelin should work on it. >> >> If you can try latest code and post some log files, it'll be helpful to >> investigate the problems. >> >> Thanks, >> moon >> On 2015년 5월 12일 (화) at 오후 4:39 Jonathan Haddad <[email protected]> >> wrote: >> >>> How did you get it to work? I tried and failed miserably. >>> >>> Jon >>> >>> On May 12, 2015, at 12:25 AM, Tyler Mitchell <[email protected]> >>> wrote: >>> >>> I've been using Python with Spark 1.3.0 and copy of Zeppelin from >>> today, but I'm getting some weirdness. Before digging into it further I >>> also tried Spark 1.3.1 but got other strange things (output of notes not >>> showing anything). >>> >>> >>> So curious, what versions are recommended or preferred? I'm trying on >>> OSX so far. >>> >>> >>> Thanks! >>> >>> >>> Tyler >>> >>>
