??????spark.executor.extraClassPath - Values not picked up by executors

2015-05-23 Thread wesley.miao
-- -- ??: Todd Nist tsind...@gmail.com : 2015??05??24?? 02:14 ??: yana.kadiyska yana.kadiy...@gmail.com : user@spark.apache.org user@spark.apache.org : Re: spark.executor.extraClassPath - Values not picked up by executors Hi Yana, Yes typeo in the eamil, file name is correct spark

Re: spark.executor.extraClassPath - Values not picked up by executors

2015-05-23 Thread Todd Nist
Hi Yana, Yes typeo in the eamil, file name is correct spark-defaults.conf; thanks though. So it appears to work if in the driver is specify it as part of the sparkConf: val conf = new SparkConf().setAppName(getClass.getSimpleName) .set(spark.executor.extraClassPath,

spark.executor.extraClassPath - Values not picked up by executors

2015-05-22 Thread Todd Nist
I'm using the spark-cassandra-connector from DataStax in a spark streaming job launched from my own driver. It is connecting a a standalone cluster on my local box which has two worker running. This is Spark 1.3.1 and spark-cassandra-connector-1.3.0-SNAPSHOT. I have added the following entry to

Re: spark.executor.extraClassPath - Values not picked up by executors

2015-05-22 Thread Yana Kadiyska
Todd, I don't have any answers for you...other than the file is actually named spark-defaults.conf (not sure if you made a typo in the email or misnamed the file...). Do any other options from that file get read? I also wanted to ask if you built the spark-cassandra-connector-assembly-1.3