[
https://issues.apache.org/jira/browse/KAFKA-8660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924264#comment-16924264
]
ASF GitHub Bot commented on KAFKA-8660:
---------------------------------------
bfncs commented on pull request #7308: KAFKA-8660: Add connect SMT topic
whitelist config
URL: https://github.com/apache/kafka/pull/7308
For source connectors that publish on multiple topics it is essential to be
able to configure transforms to be active only for certain topics.
This adds the possibility to define a whitelist of topics each single
message transform (SMT) is applied to by adding a comma-separated list of these
topics as key `topics` to the transforms configuration.
It solves KAFKA-8660 not only for a single but for all SMTs and is an
alternative to #7084.
Since this introduces a change breaking backwards compatibility (because
anyone could have used `topics` as a configuration key already), this PR is
merely a request for comments: would this be something the maintainers of this
project would be interested in adding? If yes, a strategy for smooth migration
would be needed, and I would add the needed integration tests and documentation.
## Example configuration:
```
transforms: "ValueToKey"
transforms.ValueToKey.type: "org.apache.kafka.connect.transforms.ValueToKey"
transforms.ValueToKey.fields: "userId,city,state"
transforms.ValueToKey.topics: "my-addresses"
```
This makes sure the transform `ValueToKey` is only applied for records
published on the `my-addresses` topic.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Make ValueToKey SMT work only on a whitelist of topics
> ------------------------------------------------------
>
> Key: KAFKA-8660
> URL: https://issues.apache.org/jira/browse/KAFKA-8660
> Project: Kafka
> Issue Type: Improvement
> Components: KafkaConnect
> Reporter: Marc Löhe
> Priority: Minor
> Labels: needs-kip
>
> For source connectors that publish on multiple topics it is essential to be
> able to configure transforms to be active only for certain topics. I'll add a
> PR to implement this on the example of the ValueToKey SMT.
> I'm also interested in opionions if this would make sense to add as a
> configurable option to all packaged SMTs or even as a capability for SMTs in
> general.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
