[
https://issues.apache.org/jira/browse/PHOENIX-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14739335#comment-14739335
]
Josh Mahonin commented on PHOENIX-2246:
---------------------------------------
Taking a look at the phoenix-4.5.1-HBase-1.0-client.jar I do see that the
phoenix-spark dependencies are included:
{noformat}
$ jar tvf phoenix-4.5.1-HBase-1.0-client.jar | grep spark | head
0 Fri Aug 14 16:20:02 EDT 2015 org/apache/phoenix/spark/
1778 Fri Aug 14 16:20:02 EDT 2015 org/apache/phoenix/spark/package.class
1721 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/SparkContextFunctions$$anonfun$phoenixTableAsRDD$1.class
6597 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/DataFrameFunctions.class
3076 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/ProductRDDFunctions$$anonfun$1.class
1294 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/PhoenixRDD$$anonfun$1.class
1783 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/PhoenixRelation$.class
3196 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/DataFrameFunctions$$anonfun$1.class
5995 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/PhoenixRecordWritable.class
3404 Fri Aug 14 16:20:02 EDT 2015
org/apache/phoenix/spark/SparkContextFunctions.class
{noformat}
I'm in transit, so can't verify full functionality with spark-shell at the
moment. Can you verify that you are using the correct JAR and SPARK_CLASSPATH
settings are correct?
> error “object spark is not a member of package org.apache.phoenix"
> ------------------------------------------------------------------
>
> Key: PHOENIX-2246
> URL: https://issues.apache.org/jira/browse/PHOENIX-2246
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 4.5.1
> Reporter: alex kamil
> Priority: Minor
>
> phoenix binaries (phoenix-4.5.1-HBase-1.0-bin) do not include phoenix-spark
> jar,
> so after adding phoenix client jar on spark classpath getting " error “object
> spark is not a member of package org.apache.phoenix" in spark shell
> the solution was to build phoenix from source and add
> phoenix-4.5.1-HBase-1.0-src/phoenix-spark/target/phoenix-spark-4.5.1-HBase-1.0.jar
> to SPARK_CLASSPATH in spark-env.sh
> pls add phoenix spark jar to the binaries distribution and also add to
> documentation that phoenix-spark jar is required on the spark classpath
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
