[ https://issues.apache.org/jira/browse/KAFKA-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17077833#comment-17077833 ]
Jordan Moore edited comment on KAFKA-9782 at 4/8/20, 4:55 AM: -------------------------------------------------------------- This already exists as an external SMT (ignore the fact it mentions S3) [https://github.com/jcustenborder/kafka-connect-transform-archive] was (Author: cricket007): This already exists as an external SMT https://github.com/jcustenborder/kafka-connect-transform-archive > Kafka Connect InsertField transform - Add the ability to insert event's Key > into Value > -------------------------------------------------------------------------------------- > > Key: KAFKA-9782 > URL: https://issues.apache.org/jira/browse/KAFKA-9782 > Project: Kafka > Issue Type: Improvement > Components: KafkaConnect > Reporter: Ryan Tomczik > Priority: Major > > I'm using Debezium to pull change data capture events from a Mongo DB and > write them to S3 with the Confluent S3 Sink. The problem is Debezium stores > the document's key in each event's key and the S3 connector discards this > key. I need the ability to insert the key as a new field in the event value. > It seems that this would fit in perfectly into the InsertField transform or > create a new transform KeyToValue. > Here is an example of someone else running into this same limitation and > creating a custom transform. > [https://gist.github.com/shashidesai/aaf72489165c6a0fd73a3b51e5a8892a] > -- This message was sent by Atlassian Jira (v8.3.4#803005)