[
https://issues.apache.org/jira/browse/SPARK-2720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14077525#comment-14077525
]
Sean Owen edited comment on SPARK-2720 at 7/29/14 8:55 AM:
-----------------------------------------------------------
See also https://issues.apache.org/jira/browse/SPARK-2447, which contemplates
an upgrade to HBase 0.98.x along the way.
Yes, it sounds like the Hadoop 1 vs 2 difference. It's not just versions, but
modules. One usually solves that with a profile.
But what is people's appetite for just upgrading HBase? and to 0.98 even? I am
not 100% clear on the implications. It would impact only examples at this
point, which seems fairly safe.
was (Author: srowen):
See also https://issues.apache.org/jira/browse/SPARK-2477, which contemplates
an upgrade to HBase 0.98.x along the way.
Yes, it sounds like the Hadoop 1 vs 2 difference. It's not just versions, but
modules. One usually solves that with a profile.
But what is people's appetite for just upgrading HBase? and to 0.98 even? I am
not 100% clear on the implications. It would impact only examples at this
point, which seems fairly safe.
> spark-examples should depend on HBase modules for HBase 0.96+
> -------------------------------------------------------------
>
> Key: SPARK-2720
> URL: https://issues.apache.org/jira/browse/SPARK-2720
> Project: Spark
> Issue Type: Task
> Reporter: Ted Yu
> Priority: Minor
>
> With this change:
> {code}
> diff --git a/pom.xml b/pom.xml
> index 93ef3b9..092430a 100644
> --- a/pom.xml
> +++ b/pom.xml
> @@ -122,7 +122,7 @@
> <hadoop.version>1.0.4</hadoop.version>
> <protobuf.version>2.4.1</protobuf.version>
> <yarn.version>${hadoop.version}</yarn.version>
> - <hbase.version>0.94.6</hbase.version>
> + <hbase.version>0.98.4</hbase.version>
> <zookeeper.version>3.4.5</zookeeper.version>
> <hive.version>0.12.0</hive.version>
> <parquet.version>1.4.3</parquet.version>
> {code}
> I got:
> {code}
> [ERROR] Failed to execute goal on project spark-examples_2.10: Could not
> resolve dependencies for project
> org.apache.spark:spark-examples_2.10:jar:1.1.0-SNAPSHOT: Could not find
> artifact org.apache.hbase:hbase:jar:0.98.4 in maven-repo
> (http://repo.maven.apache.org/maven2) -> [Help 1]
> {code}
> To build against HBase 0.96+, spark-examples needs to specify HBase modules
> (hbase-client, etc) in dependencies - possibly using a new profile.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
