rahil-c opened a new pull request, #1862:
URL: https://github.com/apache/polaris/pull/1862
<!--
Possible security vulnerabilities: STOP here and contact
[email protected] instead!
Please update the title of the PR with a meaningful message - do not
leave it "empty" or "generated"
Please update this summary field:
The summary should cover these topics, if applicable:
* the motivation for the change
* a description of the status quo, for example the current behavior
* the desired behavior
* etc
PR checklist:
- Do a self-review of your code before opening a pull request
- Make sure that there's good test coverage for the changes included in
this PR
- Run tests locally before pushing a PR (./gradlew check)
- Code should have comments where applicable. Particularly
hard-to-understand
areas deserve good in-line documentation.
- Include changes and enhancements to the documentation (in
site/content/in-dev/unreleased)
- For Work In Progress Pull Requests, please use the Draft PR feature.
Make sure to add the information BELOW this comment.
Everything in this comment will NOT be added to the PR description.
-->
## Motivation
Issue: https://github.com/apache/polaris/issues/1896
The Polaris Spark client currently supports Iceberg and Delta table. This PR
aims to add support for Apache Hudi tables as Generic Tables.
## Current behavior
Currently, the Polaris Spark client routes Iceberg table requests to Iceberg
REST endpoints and Delta table requests to
Generic Table REST endpoints. This PR aims to allow Hudi to follow a similar
support as for what was done for Delta in Polaris.
## Desired Behavior
Enable basic Hudi table operations through the Polaris Spark catalog by:
- Adding Hudi table detection and routing logic
## Changes Included
- Core Implementation: Added HudiHelper utility class and enhanced
PolarisCatalogUtils with Hudi-specific table loading
logic
- Catalog Integration: Modified SparkCatalog to detect and route Hudi table
operations appropriately
- Testing: Added unit tests for testingHudi integration
- Documentation: Updated README with Hudi development support
### Special note
Will follow up in another pr for integration and regression testing as they
will need to consume the latest hudi point release artifact, once some changes
in hudi land.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
