nsivabalan opened a new pull request, #17478:
URL: https://github.com/apache/hudi/pull/17478
### Describe the issue this Pull Request addresses
We added streaming writes to metadata table in 1.1.0. Not all partitions in
mdt supports streaming writes as of now. So, fixing writes to leverage
streaming writes to metadata table only when eligible metadata partitions are
enabled.
### Summary and Changelog
- Leverage streaming writes to metadata table in spark only when either of
RLI (global or non global) or secondary index is enabled.
### Impact
- Avoids the new dag if not really required. Down the line, when we move col
stats and other partitions to streaming flow, probably we will get rid of this
optimization.
### Risk Level
low
### Documentation Update
<!-- Describe any necessary documentation update if there is any new
feature, config, or user-facing change. If not, put "none".
- The config description must be updated if new configs are added or the
default value of the configs are changed.
- Any new feature or user-facing change requires updating the Hudi website.
Please follow the
[instruction](https://hudi.apache.org/contribute/developer-setup#website)
to make changes to the website. -->
### Contributor's checklist
- [ ] Read through [contributor's
guide](https://hudi.apache.org/contribute/how-to-contribute)
- [ ] Enough context is provided in the sections above
- [ ] Adequate tests were added if applicable
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
