[
https://issues.apache.org/jira/browse/HBASE-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16068831#comment-16068831
]
Sean Busbey commented on HBASE-18175:
-------------------------------------
Trying to build the source archive failed:
{code}
$ mvn clean install -DskipTests assembly:single
-Dassembly.file=hbase-assembly/src/main/assembly/src.xml -Prelease
...SNIP...
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache HBase ....................................... SUCCESS [ 15.774 s]
[INFO] Apache HBase - Checkstyle .......................... SUCCESS [ 3.356 s]
[INFO] Apache HBase - Resource Bundle ..................... SUCCESS [ 0.621 s]
[INFO] Apache HBase - Annotations ......................... SUCCESS [ 2.931 s]
[INFO] Apache HBase - Common .............................. SUCCESS [ 24.071 s]
[INFO] Apache HBase - Shaded Protocol ..................... SUCCESS [ 29.110 s]
[INFO] Apache HBase - Metrics API ......................... SUCCESS [ 5.284 s]
[INFO] Apache HBase - Procedure ........................... SUCCESS [ 6.954 s]
[INFO] Apache HBase - Hadoop Compatibility ................ SUCCESS [ 3.854 s]
[INFO] Apache HBase - Metrics Implementation .............. SUCCESS [ 4.200 s]
[INFO] Apache HBase - Hadoop Two Compatibility ............ SUCCESS [ 8.512 s]
[INFO] Apache HBase - Protocol ............................ SUCCESS [ 10.321 s]
[INFO] Apache HBase - Client .............................. SUCCESS [ 17.595 s]
[INFO] Apache HBase - Prefix Tree ......................... SUCCESS [ 9.521 s]
[INFO] Apache HBase - Server .............................. SUCCESS [01:28 min]
[INFO] Apache HBase - Testing Util ........................ SUCCESS [ 18.739 s]
[INFO] Apache HBase - Thrift .............................. SUCCESS [ 16.647 s]
[INFO] Apache HBase - RSGroup ............................. SUCCESS [ 12.345 s]
[INFO] Apache HBase - Shell ............................... SUCCESS [ 16.004 s]
[INFO] Apache HBase - Coprocessor Endpoint ................ SUCCESS [ 11.497 s]
[INFO] Apache HBase - Integration Tests ................... SUCCESS [ 12.693 s]
[INFO] Apache HBase - Examples ............................ SUCCESS [ 11.252 s]
[INFO] Apache HBase - Rest ................................ SUCCESS [ 11.270 s]
[INFO] Apache HBase - External Block Cache ................ SUCCESS [ 7.534 s]
[INFO] Apache HBase - Spark ............................... FAILURE [01:31 min]
[INFO] Apache HBase - Assembly ............................ SKIPPED
[INFO] Apache HBase - Shaded .............................. SKIPPED
[INFO] Apache HBase - Shaded - Client ..................... SKIPPED
[INFO] Apache HBase - Shaded - Server ..................... SKIPPED
[INFO] Apache HBase - Archetypes .......................... SKIPPED
[INFO] Apache HBase - Exemplar for hbase-client archetype . SKIPPED
[INFO] Apache HBase - Exemplar for hbase-shaded-client archetype SKIPPED
[INFO] Apache HBase - Archetype builder ................... SKIPPED
[INFO] Apache HBase - Spark Integration Tests ............. SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:25 min
[INFO] Finished at: 2017-06-29T14:28:16-05:00
[INFO] Final Memory: 272M/1029M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.11:check
(default) on project hbase-spark: Too many files with unapproved license: 5 See
RAT report in: /Users/busbey/tmp_projects/hbase/hbase-spark/target/rat.txt ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn <goals> -rf :hbase-spark
$ head -n 28 hbase-spark/target/rat.txt
*****************************************************
Summary
-------
Generated at: 2017-06-29T14:27:58-05:00
Notes: 7
Binaries: 11
Archives: 2
Standards: 76
Apache Licensed: 71
Generated Documents: 0
JavaDocs are generated and so license header is optional
Generated files do not required license headers
5 Unknown Licenses
*******************************
Unapproved licenses:
/Users/busbey/tmp_projects/hbase/hbase-spark/hbase-spark-it/target/failsafe-reports/failsafe-summary.xml
/Users/busbey/tmp_projects/hbase/hbase-spark/hbase-spark-it/target/failsafe-reports/org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad-output.txt
/Users/busbey/tmp_projects/hbase/hbase-spark/hbase-spark-it/target/failsafe-reports/org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad.txt
/Users/busbey/tmp_projects/hbase/hbase-spark/hbase-spark-it/target/failsafe-reports/TEST-org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad.xml
/Users/busbey/tmp_projects/hbase/hbase-spark/hbase-spark-it/target/maven-archiver/pom.properties
{code}
This is caused, I believe, by having the combination of the hbase-spark-it
module directory under hbase-spark but its reactor definition in the top level.
Can we just move the hbase-spark-it module directory to the top level?
> Add hbase-spark integration test into hbase-spark-it
> ----------------------------------------------------
>
> Key: HBASE-18175
> URL: https://issues.apache.org/jira/browse/HBASE-18175
> Project: HBase
> Issue Type: Test
> Components: spark
> Reporter: Yi Liang
> Assignee: Yi Liang
> Priority: Critical
> Fix For: 2.0.0
>
> Attachments: hbase-18175-master-v2.patch,
> hbase-18175-master-v3.patch, hbase-18175-master-v4.patch,
> hbase-18175-master-v5.patch, hbase-18175-master-v6.patch, hbase-18175-v1.patch
>
>
> After HBASE-17574, all test under hbase-spark are regarded as unit test, and
> this jira will add integration test of hbase-spark into hbase-it. This patch
> run same tests as mapreduce.IntegrationTestBulkLoad, just change mapreduce to
> spark.
> test in Maven:
> mvn verify -Dit.test=IntegrationTestSparkBulkLoad
> test on cluster:
> spark-submit --class
> org.apache.hadoop.hbase.spark.IntegrationTestSparkBulkLoad
> HBASE_HOME/lib/hbase-it-2.0.0-SNAPSHOT-tests.jar
> -Dhbase.spark.bulkload.chainlength=500000 -m slowDeterministic
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
