prathit06 opened a new issue, #9391: URL: https://github.com/apache/hudi/issues/9391
Describe the problem you faced: - Hudi only ingests value part of Json Kafka messages containing key & value. Requirement : - Ingest key as well as part of hudi metadata column Reference : - Upon checking [JsonKafkaSource](https://github.com/apache/hudi/blob/master/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/JsonKafkaSource.java#L81) , i noticed only kafka value is being fetched & deserialised. - Slack thread of the discussion : https://apache-hudi.slack.com/archives/C4D716NPQ/p1686328367164209?thread_ts=1686030961.394259&cid=C4D716NPQ I have added the capability to add kafka key as part of hudi metadata columns for our use case & I would like to contribute the same. Please confirm if i can move ahead for the same & create a PR of the changes. Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
