hudi-bot opened a new issue, #14540: URL: https://github.com/apache/hudi/issues/14540
The usage of utility function [https://github.com/apache/hudi/blob/6a0aa9a645d11ed7b50e18aa0563dafcd9d145f7/hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java#L258] does not handle schema evolution such as optional fields removal (from new schema). There are example usage cases: 1. A typical schema evolution like changing a field type would require one to add a new field with new type, then once old data is no longer used, or new field is backfilled to old records, old field can be dropped. 2. A field which is no longer needed. The schema evolution check, which was implemented in HUDI-741, would hinder this kind of usage. ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-631 - Type: Bug -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
