Sigma-Ma opened a new pull request, #163: URL: https://github.com/apache/hbase-connectors/pull/163
JIRA: https://issues.apache.org/jira/browse/HBASE-30187 **What changes were proposed in this pull request?** Port the Spark bulk-load APIs from the Spark 3 connector to the Spark 4 module. This adds `bulkLoad`, `bulkLoadThinRows`, the related RDD extension methods, and the helper classes used to partition rows and write HFiles. It also ports the existing bulk-load tests to Scala 2.13 and Spark 4. The Spark 4 sources are formatted with the project Spotless configuration. **Why are the changes needed?** The Spark 4 connector does not currently provide the HFile bulk-load functionality available in the Spark 3 connector. This change provides the same wide-row and thin-row bulk-load support for Spark 4 users. **How was this patch tested?** ```bash mvn -Pspark4 -pl :hbase-spark4 -am spotless:check mvn -Pspark4 -pl :hbase-spark4 -am \ -Dsuites=org.apache.hadoop.hbase.spark.BulkLoadSuite package mvn -Pspark4 -pl :hbase-spark4 -am clean package ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
