Sigma-Ma opened a new pull request, #171:
URL: https://github.com/apache/hbase-connectors/pull/171
### What changes were proposed in this pull request?
Add a delimiter after non-final variable-length string row-key fields in the
Spark 3 and Spark 4 writers. Fix Spark 3 parsing to skip that delimiter and use
the remaining length for the final field. Add round-trip tests that check the
stored row-key bytes.
### Why are the changes needed?
Without a delimiter, composite keys such as ("ab", "c") and ("a", "bc")
produce the same row key. The readers expect a delimiter and cannot reliably
recover the fields. Existing undelimited keys are not migrated by this patch
because their field boundaries may be ambiguous.
### How was this patch tested?
```bash
mvn -B -ntp -pl :hbase-spark -am
-Dsuites=org.apache.hadoop.hbase.spark.DefaultSourceSuite package
mvn -B -ntp -Pspark4 -pl :hbase-spark4 -am
-Dsuites=org.apache.hadoop.hbase.spark.datasources.HBaseTableProviderSuite
package
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
