Hi, does the version have to be the same down to the minor version, e.g. 1.6.1 and 1.6.2 will give this issue
On Thu, Aug 18, 2016 at 6:27 PM, Olivier Girardot < [email protected]> wrote: > your executors/driver must not have the multiple versions of spark in > classpath, it may come from the cassandra connector check the pom > dependencies of the version you fetched and if it's compatible with your > spark version. > > > > On Thu, Aug 18, 2016 6:05 AM, thbeh [email protected] wrote: > >> Running the query below I have been hitting - local class incompatible >> >> exception, anyone know the cause? >> >> >> val rdd = csc.cassandraSql("""select *, concat('Q', d_qoy) as qoy from >> >> store_sales join date_dim on ss_sold_date_sk = d_date_sk join item on >> >> ss_item_sk = >> >> i_item_sk""").groupBy("i_category").pivot("qoy").agg( >> round(sum("ss_sales_price")/1000000,2)) >> >> >> The source data is from TPCDS test data and I am running in Zeppelin. >> >> >> >> /INFO [2016-08-18 03:15:58,429] ({task-result-getter-2} >> >> Logging.scala[logInfo]:58) - Lost task 3.0 in stage 3.0 (TID 52) on >> executor >> >> ceph5.example.my: java.io.InvalidClassException >> >> (org.apache.spark.sql.catalyst.expressions.Literal; local class >> >> incompatible: stream classdesc serialVersionUID = 3305180847846277455, >> local >> >> class serialVersionUID = -4259705229845269663) [duplicate 1] >> >> INFO [2016-08-18 03:15:58,429] ({task-result-getter-3} >> >> Logging.scala[logInfo]:58) - Lost task 2.0 in stage 3.0 (TID 51) on >> executor >> >> ceph5.example.my: java.io.InvalidClassException >> >> (org.apache.spark.sql.catalyst.expressions.Literal; local class >> >> incompatible: stream classdesc serialVersionUID = 3305180847846277455, >> local >> >> class serialVersionUID = -4259705229845269663) [duplicate 2] >> >> INFO [2016-08-18 03:15:58,430] ({task-result-getter-3} >> >> Logging.scala[logInfo]:58) - Lost task 6.0 in stage 3.0 (TID 55) on >> executor >> >> ceph5.example.my: java.io.InvalidClassException >> >> (org.apache.spark.sql.catalyst.expressions.Literal; local class >> >> incompatible: stream classdesc serialVersionUID = 3305180847846277455, >> local >> >> class serialVersionUID = -4259705229845269663) [duplicate 3]/ >> >> >> Thanks >> >> >> >> >> -- >> >> View this message in context: http://apache-spark-user-list. >> 1001560.n3.nabble.com/Spark-SQL-1-6-1-issue-tp27554.html >> >> Sent from the Apache Spark User List mailing list archive at Nabble.com. >> >> >> --------------------------------------------------------------------- >> >> To unsubscribe e-mail: [email protected] >> >> >> >> > > *Olivier Girardot* | Associé > [email protected] > +33 6 24 09 17 94 >
