[
https://issues.apache.org/jira/browse/HBASE-16179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530423#comment-15530423
]
Ted Yu commented on HBASE-16179:
--------------------------------
For JavaHBaseContext.scala , the change is needed since Spark 1.6 returns
Iterable while Spark 2.0 returns Iterator.
HBaseTableScanRDD extends RDD which has:
{code}
) extends Serializable with Logging {
{code}
So HBaseTableScanRDD uses Spark's Logging.
w.r.t. the spark & scala version properties, since hbase-spark1.6-compat and
hbase-spark2.0-compat modules are built first, the versions need to be
specified.
I found one commented out import in Utils.scala. It is removed in the next
patch.
> Fix compilation errors when building hbase-spark against Spark 2.0
> ------------------------------------------------------------------
>
> Key: HBASE-16179
> URL: https://issues.apache.org/jira/browse/HBASE-16179
> Project: HBase
> Issue Type: Bug
> Components: spark
> Reporter: Ted Yu
> Assignee: Ted Yu
> Fix For: 2.0.0
>
> Attachments: 16179.v0.txt, 16179.v1.txt, 16179.v1.txt, 16179.v4.txt,
> 16179.v5.txt, 16179.v7.txt, 16179.v8.txt, 16179.v9.txt
>
>
> I tried building hbase-spark module against Spark-2.0 snapshot and got the
> following compilation errors:
> http://pastebin.com/bg3w247a
> Some Spark classes such as DataTypeParser and Logging are no longer
> accessible to downstream projects.
> hbase-spark module should not depend on such classes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
