Re: Spark cassandra connector with livy

2017-10-09 Thread Saisai Shao
592fe3b429b79365389d2354> Not using Mixmax yet? > <https://mixmax.com/r/592fe3b429b79365389d2354> > > > > On Mon, Oct 9, 2017 5:11 PM, Junaid Nasir jna...@an10.io wrote: > >> Hi, >> >> How can I include Cassandra-connect-package >> &

Re: Spark cassandra connector with livy

2017-10-09 Thread Junaid Nasir
more info regarding the problem.when i pass {"kind": "pyspark","jars":["datastax:spark-cassandra-connector:2.0.1-s_2.11"]} via post to /sessionssession status changes to dead. livy logs show this 17/10/09 18:45:15 WARN ContextLauncher: Child process exited with code 1.17/10/09

Spark cassandra connector with livy

2017-10-09 Thread Junaid Nasir
Hi, How can I include Cassandra-connect-package to Livy spark session? I use the following spark-submit command/spark-submit --master spark://10.128.1.1:7077 --packages datastax:spark-cassandra-connector:2.0.1-s_2.11 --conf spark.cassandra.connection.host="10.128.1.1,10.128.1.2,10.128.1.3" how