Re: Jdbc Source Connector Config

2020-05-13 Thread Robin Moffatt
You don't have to use Single Message Transform (which is what these are) at
all if you don't want to.
However, they do serve a useful purpose where you want to modify data as it
passes through Kafka Connect.

Ref:
-
https://www.confluent.io/blog/simplest-useful-kafka-connect-data-pipeline-world-thereabouts-part-3/
-
https://www.confluent.io/blog/kafka-connect-deep-dive-jdbc-source-connector/
- http://rmoff.dev/ksldn19-kafka-connect


-- 

Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff


On Wed, 13 May 2020 at 10:34, vishnu murali 
wrote:

> Hi Guys,
>
> i am having a question.
>
>
> "transforms":"createKey,extractInt",
>
>
> "transforms.createKey.type":"org.apache.kafka.connect.transforms.ValueToKey",
>  "transforms.createKey.fields":"id",
>
>
> "transforms.extractInt.type":"org.apache.kafka.connect.transforms.ExtractField$Key",
>  "transforms.extractInt.field":"id"
>
> what is the need of these configuration in JdbcSourceConnector?
> And without these can we use SourceConnector?
>


Jdbc Source Connector Config

2020-05-13 Thread vishnu murali
Hi Guys,

i am having a question.


"transforms":"createKey,extractInt",

"transforms.createKey.type":"org.apache.kafka.connect.transforms.ValueToKey",
 "transforms.createKey.fields":"id",

"transforms.extractInt.type":"org.apache.kafka.connect.transforms.ExtractField$Key",
 "transforms.extractInt.field":"id"

what is the need of these configuration in JdbcSourceConnector?
And without these can we use SourceConnector?