fhan688 opened a new pull request, #3549:
URL: https://github.com/apache/fluss/pull/3549
### Purpose
Linked issue: https://github.com/apache/fluss/issues/3514
This PR adds user-facing documentation for using Fluss Tiering Service
with Apache Hudi.
The Hudi lake integration has already been implemented in the
`fluss-lake-hudi` module, but the website did
not yet provide a dedicated guide that explains how to configure Hudi as
lakehouse storage, start the tiering
service, create Hudi-backed Fluss tables, and read tiered data.
### Brief change log
- Add a new Hudi integration guide under
`streaming-lakehouse/integrate-data-lakes/formats`.
- Document Hudi dependencies, version compatibility, DFS/HMS catalog
configuration, server-side plugin JARs,
and Flink tiering service startup.
- Describe the Fluss-to-Hudi table mapping based on the implementation:
- primary-key Fluss tables are mapped to Hudi Merge-On-Read tables;
- log tables are mapped to Hudi Copy-On-Write tables;
- Hudi record key, bucket index, partition path fields, and Fluss system
columns are managed consistently
with the code.
- Document Hudi table properties, union read behavior, direct Hudi reads
through native Hudi catalog, type
mapping, auto compaction, commit metadata, and current limitations.
- Update existing documentation/config descriptions to list Hudi as a
supported lakehouse format.
### Tests
- `git diff --check`
- `mvn -q -pl fluss-common -am -DskipTests -DskipITs
-Dcheckstyle.skip=true compile`
Website build was not run locally because `website/node_modules` is not
installed in the current workspace.
### API and Format
No API or storage format changes.
This PR only adds documentation and updates option descriptions to reflect
that Hudi is now a supported
lakehouse format.
### Documentation
This PR introduces the Hudi Tiering Service integration guide and updates
existing lakehouse storage
documentation to include Hudi.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
