[
https://issues.apache.org/jira/browse/HBASE-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077755#comment-16077755
]
Mike Drob commented on HBASE-18175:
-----------------------------------
hbase-spark-it/pom.xml uses {{maven.assembly.version}} but it's not defined
anywhere. It's enough to remove that line.
I haven't had a chance to test this against a running cluster with spark
installed, but i think that knowing it works in IT mode is sufficient and we
can do follow on work if there are new problems. (We might need to generate
something like the mrapp-generated-classpath, maybe?)
> Add hbase-spark integration test into hbase-spark-it
> ----------------------------------------------------
>
> Key: HBASE-18175
> URL: https://issues.apache.org/jira/browse/HBASE-18175
> Project: HBase
> Issue Type: Test
> Components: spark
> Reporter: Yi Liang
> Assignee: Yi Liang
> Priority: Critical
> Fix For: 2.0.0
>
> Attachments: hbase-18175-master-v2.patch,
> hbase-18175-master-v3.patch, hbase-18175-master-v4.patch,
> hbase-18175-master-v5.patch, hbase-18175-master-v6.patch,
> hbase-18175-master-v7.patch, hbase-18175-master-v8.patch, hbase-18175-v1.patch
>
>
> After HBASE-17574, all test under hbase-spark are regarded as unit test, and
> this jira will add integration test of hbase-spark into hbase-it. This patch
> run same tests as mapreduce.IntegrationTestBulkLoad, just change mapreduce to
> spark.
> test in Maven:
> mvn verify -Dit.test=IntegrationTestSparkBulkLoad
> test on cluster:
> spark-submit --class
> org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad
> HBASE_HOME/lib/hbase-it-2.0.0-SNAPSHOT-tests.jar
> -Dhbase.spark.bulkload.chainlength=500000 -m slowDeterministic
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)