This is an automated email from the ASF dual-hosted git repository. acosentino pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/camel-kafka-connector.git
commit e6792ce49bd10487bbe561a04b16533f8234ff75 Author: Andrea Cosentino <[email protected]> AuthorDate: Thu Feb 18 14:24:30 2021 +0100 Added remove headers documentation --- docs/modules/ROOT/pages/remove-headers.adoc | 30 +++++++++++++++++++++++++++++ 1 file changed, 30 insertions(+) diff --git a/docs/modules/ROOT/pages/remove-headers.adoc b/docs/modules/ROOT/pages/remove-headers.adoc new file mode 100644 index 0000000..207477c --- /dev/null +++ b/docs/modules/ROOT/pages/remove-headers.adoc @@ -0,0 +1,30 @@ +[[RemovedHeaders-RemovedHeaders]] += Remove Headers + +As you know in Camel Kafka Connector there is a mixing between Camel and Kafka headers. There are scenario where a typical user would like to remove some of the Camel Headers, because otherwise he would +trigger a particular behavior while moving record between a source connector and sink connector. + +Starting from Camel Kafka connector 0.7.0, we introduced the removeHeaders option "camel.remove.headers.pattern=CamelAwsS3BucketName" + +This option is valid for both source and sink connector and support any regex. + +For example in Camel AWS2 S3 connector there is a particular header, set while consuming file from a bucket ("CamelAwsS3BucketName"), if this header will be passed to a sink connector the bucket name set in +the sink connector configuration will be override. For this particular case a user can specify: + +[source,bash] +---- +name=CamelAWS2S3SinkConnector +connector.class=org.apache.camel.kafkaconnector.aws2s3.CamelAws2s3SinkConnector +key.converter=org.apache.kafka.connect.storage.StringConverter +value.converter=org.apache.kafka.connect.storage.StringConverter + +topics=mytopic + +camel.sink.path.bucketNameOrArn=camel-kafka-connector-1 +camel.remove.headers.pattern=CamelAwsS3BucketName +camel.component.aws2-s3.accessKey=<access_key> +camel.component.aws2-s3.secretKey=<secret_key> +camel.component.aws2-s3.region=<region> +---- + +In this way the header will be removed and the normal flow will go ahead.
