Randall Hauch created KAFKA-6525:

             Summary: Connect should allow pluggable encryption for records
                 Key: KAFKA-6525
                 URL: https://issues.apache.org/jira/browse/KAFKA-6525
             Project: Kafka
          Issue Type: New Feature
          Components: KafkaConnect
            Reporter: Randall Hauch

The Connect framework does not easily support pluggable encryption and 
decryption mechanisms. It is possible to use custom Converters to 
encrypt/decrypt individual keys and values when the encryption metadata (keys, 
algorithm, etc.) can be specified in the Converter. or when the key and/or 
value are _wrapped_ to include the metadata. 

However, if the encryption metadata is to be stored as headers, then as of AK 
1.1 Connect does have support for using headers in connectors and SMTs, but not 

We should make it easier to plug encryption and decryption mechanisms into 
Connect. Since we're moving to Java 8, one approach might be to change the 
Converter interface to add a default methods that also supply the headers (and 
maybe the whole record). 

An alternative is to define a new plugin interface that can be used to 
filter/transform/map the entire source and sink records. Here's we'd actually 
call this for source connectors before the Converter, and for sink connectors 
after the Converter is called.

This message was sent by Atlassian JIRA

Reply via email to