Re: pyspark cassandra examples

2014-09-30 Thread David Vincelli
Thanks, that worked! I downloaded the version pre-built against hadoop1 and the examples worked. - David On Tue, Sep 30, 2014 at 5:08 PM, Kan Zhang wrote: > > java.lang.IncompatibleClassChangeError: Found interface > org.apache.hadoop.mapreduce.JobContext, but class was expected > > Most likel

Re: pyspark cassandra examples

2014-09-30 Thread Kan Zhang
> java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected Most likely it is the Hadoop 1 vs Hadoop 2 issue. The example was given for Hadoop 1 (default Hadoop version for Spark). You may try to set the output format class in conf for

pyspark cassandra examples

2014-09-30 Thread David Vincelli
I've been trying to get the cassandra_inputformat.py and cassandra_outputformat.py examples running for the past half day. I am running cassandra21 community from datastax on a single node (in my dev environment) with spark-1.1.0-bin-hadoop2.4. I can connect and use cassandra via cqlsh and I can r