lvhu-goodluck opened a new pull request, #7984:
URL: https://github.com/apache/hudi/pull/7984
### Change Logs
Add hash partition in spark datasoure.
It is often difficult to find an appropriate partition key in the existing
data. Hash partitioning can easily solve this problem.
How to use hash partition in spark data source can refer to
hudi/hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala#testHashPartition
### Impact
No public API or user-facing feature change or any performance impact if the
hash partition parameters are not specified.
When hash.partition.fields is specified and partition.fields contains
_hoodie_hash_partition, a column named _hoodie_hash_partition will be added in
this table as one of the partition key.
If predicates of hash.partition.fields appear in the query statement, the
_hoodie_hash_partition = X predicate will be automatically added to the query
statement for partition pruning.
### Risk level (write none, low medium or high below)
Low .
### Documentation Update
To be continued.
### Contributor's checklist
- [ ] Read through [contributor's
guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Change Logs and Impact were stated clearly
- [ ] Adequate tests were added if applicable
- [ ] CI passed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
