[ 
https://issues.apache.org/jira/browse/HBASE-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16077755#comment-16077755
 ] 

Mike Drob commented on HBASE-18175:
-----------------------------------

hbase-spark-it/pom.xml uses {{maven.assembly.version}} but it's not defined 
anywhere. It's enough to remove that line.

I haven't had a chance to test this against a running cluster with spark 
installed, but i think that knowing it works in IT mode is sufficient and we 
can do follow on work if there are new problems. (We might need to generate 
something like the mrapp-generated-classpath, maybe?)

> Add hbase-spark integration test into hbase-spark-it
> ----------------------------------------------------
>
>                 Key: HBASE-18175
>                 URL: https://issues.apache.org/jira/browse/HBASE-18175
>             Project: HBase
>          Issue Type: Test
>          Components: spark
>            Reporter: Yi Liang
>            Assignee: Yi Liang
>            Priority: Critical
>             Fix For: 2.0.0
>
>         Attachments: hbase-18175-master-v2.patch, 
> hbase-18175-master-v3.patch, hbase-18175-master-v4.patch, 
> hbase-18175-master-v5.patch, hbase-18175-master-v6.patch, 
> hbase-18175-master-v7.patch, hbase-18175-master-v8.patch, hbase-18175-v1.patch
>
>
> After HBASE-17574, all test under hbase-spark are regarded as unit test, and 
> this jira will add integration test of hbase-spark into hbase-it.  This patch 
> run same tests as mapreduce.IntegrationTestBulkLoad, just change mapreduce to 
> spark.  
> test in Maven:
> mvn verify -Dit.test=IntegrationTestSparkBulkLoad
> test on cluster:
> spark-submit --class 
> org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad 
> HBASE_HOME/lib/hbase-it-2.0.0-SNAPSHOT-tests.jar 
> -Dhbase.spark.bulkload.chainlength=500000 -m slowDeterministic



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to