[jira] [Commented] (SPARK-10377) Cassandra connector affected by backport change

2015-08-31 Thread Yin Huai (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724612#comment-14724612
 ] 

Yin Huai commented on SPARK-10377:
--

[~frodeso] Is 
https://github.com/datastax/spark-cassandra-connector/blob/v1.4.0-M3/spark-cassandra-connector/src/main/scala/org/apache/spark/sql/cassandra/CassandraSQLContext.scala#L90
 the only place that we refer to TakeOrdered in Cassandra connector? If so, we 
can rename it back.

> Cassandra connector affected by backport change
> ---
>
> Key: SPARK-10377
> URL: https://issues.apache.org/jira/browse/SPARK-10377
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 1.4.2
>Reporter: Frode Sormo
>
> The backport in SPARK-7289 and SPARK-9949 includes the refactor of 
> TakeOrdered to TakeOrderedAndProject, which breaks code that refers to 
> TakeOrdered. In a minor version update that is perhaps not expected - 
> specifically, the Cassandra connector refers to this by name and no longer 
> works.
> Example use case it to use the Cassandra connector in Scala and creating a 
> CassandraSQLContext:
> import com.datastax.spark.connector._
> import sqlContext.implicits._
> import org.apache.spark.sql.cassandra.CassandraSQLContext
> val cassandraSQLContext = new CassandraSQLContext(sc);
> java.lang.NoSuchMethodError: 
> org.apache.spark.sql.cassandra.CassandraSQLContext$$anon$1.TakeOrdered()Lorg/apache/spark/sql/execution/SparkStrategies$TakeOrdered$;
>   at 
> org.apache.spark.sql.cassandra.CassandraSQLContext$$anon$1.(CassandraSQLContext.scala:90)
>   at 
> org.apache.spark.sql.cassandra.CassandraSQLContext.(CassandraSQLContext.scala:85)
> (Source code link: 
> https://github.com/datastax/spark-cassandra-connector/blob/v1.4.0-M3/spark-cassandra-connector/src/main/scala/org/apache/spark/sql/cassandra/CassandraSQLContext.scala)
>  
> This is with version 1.4.0M3 of the Datastax Cassandra connector, but affects 
> other 1.4 versions as well.
> Issue has also been reported to Datastax, here: 
> https://datastax-oss.atlassian.net/browse/SPARKC-238



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-10377) Cassandra connector affected by backport change

2015-08-31 Thread Apache Spark (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-10377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14724620#comment-14724620
 ] 

Apache Spark commented on SPARK-10377:
--

User 'yhuai' has created a pull request for this issue:
https://github.com/apache/spark/pull/8545

> Cassandra connector affected by backport change
> ---
>
> Key: SPARK-10377
> URL: https://issues.apache.org/jira/browse/SPARK-10377
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 1.4.2
>Reporter: Frode Sormo
>Assignee: Yin Huai
>
> The backport in SPARK-7289 and SPARK-9949 includes the refactor of 
> TakeOrdered to TakeOrderedAndProject, which breaks code that refers to 
> TakeOrdered. In a minor version update that is perhaps not expected - 
> specifically, the Cassandra connector refers to this by name and no longer 
> works.
> Example use case it to use the Cassandra connector in Scala and creating a 
> CassandraSQLContext:
> import com.datastax.spark.connector._
> import sqlContext.implicits._
> import org.apache.spark.sql.cassandra.CassandraSQLContext
> val cassandraSQLContext = new CassandraSQLContext(sc);
> java.lang.NoSuchMethodError: 
> org.apache.spark.sql.cassandra.CassandraSQLContext$$anon$1.TakeOrdered()Lorg/apache/spark/sql/execution/SparkStrategies$TakeOrdered$;
>   at 
> org.apache.spark.sql.cassandra.CassandraSQLContext$$anon$1.(CassandraSQLContext.scala:90)
>   at 
> org.apache.spark.sql.cassandra.CassandraSQLContext.(CassandraSQLContext.scala:85)
> (Source code link: 
> https://github.com/datastax/spark-cassandra-connector/blob/v1.4.0-M3/spark-cassandra-connector/src/main/scala/org/apache/spark/sql/cassandra/CassandraSQLContext.scala)
>  
> This is with version 1.4.0M3 of the Datastax Cassandra connector, but affects 
> other 1.4 versions as well.
> Issue has also been reported to Datastax, here: 
> https://datastax-oss.atlassian.net/browse/SPARKC-238



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org