voonhous opened a new issue, #18070: URL: https://github.com/apache/hudi/issues/18070
### Task Description **What needs to be done:** The current state of parquet-shredding scope is defined here: https://github.com/apache/parquet-format/blob/4b1c72c837bec5b792b2514f0057533030fcedf8/VariantShredding.md?plain=1#L81-L108 While we are currently iterating on our support for shredded, it is best we keep our PRs small and iterate on changes while implementing this feature. As such, we have limited the scope of our shredded type support to limited types. As such, after blockers are removed we should expand the scope to match up with parquet's shredded spec. **Why this task is needed:** Reduce delta between Parquet support and Hudi support, reducing user confusion. ### Task Type Code improvement/refactoring ### Related Issues **Parent feature issue:** (if applicable ) **Related issues:** NOTE: Use `Relationships` button to add parent/blocking issues after issue is created. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
