prathit06 commented on issue #9391: URL: https://github.com/apache/hudi/issues/9391#issuecomment-1669955523
Hi @vinothchandar My idea is to `extend the Hudi metadata columns` itself similar to what is done [here](https://github.com/apache/hudi/blob/master/hudi-utilities/src/main/java/org/apache/hudi/utilities/schema/KafkaOffsetPostProcessor.java#L56). Doing so will make sure a. No issues with schema evolution as metadata columns are added during postprocess of kafka messages. b. End user will have flexibility to use the new kafka key column added as `HoodieRecord:key` using `hoodie.datasource.write.recordkey.field` property. Please let me know if i am missing something. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
