voonhous opened a new issue, #18038: URL: https://github.com/apache/hudi/issues/18038
### Task Description **What needs to be done:** Up to this point, shredding columns must be explicitly defined provided that #18037 is implemented. We will need to add auto inference logic for shredding such that shredding fields can be determined implicitly. **Why this task is needed:** Implementation of this will allow us to explore performance penalties fro shredding jitters for reconciling differing physical schemas of the Variant columns on the file level during reading and writing. As such, performance considerations is not within the scope of this task. Instead this task is a prerequisite for the performance consideration. The scope of this PR is to enable inference logic for shredding and to ensure read and writes for CoW + MoR tables can succeed without any issues. ### Task Type Code improvement/refactoring ### Related Issues **Parent feature issue:** (if applicable ) **Related issues:** NOTE: Use `Relationships` button to add parent/blocking issues after issue is created. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
