[
https://issues.apache.org/jira/browse/KAFKA-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gokhan Sari updated KAFKA-8554:
-------------------------------
Description:
In a configurable pattern, topic and key generation is needed. This pattern
could include static values and dynamic parameters which are exist in json tree.
Eg:
* property.format = "*signals_\{appId}_\{date}" >> "signals_app01_18-06-2019"*
** static '*signals*'
** parameter '*appId*' from json tree
** parameter or record '*date*'
* property.date.field = "*details.signalCreationDate"*
** parameter '*details.signalCreationDate*' path from json tree
* property.date.format = "*dd-MM-yyyy"*
** date format for date parameters or record dates
Extracting topic or key (properties) with these way will led developers to use
them according to their business logic.
Especially this will be useful for Elasticsearch Kafka Connector in case of
dynamic index name and dynamic document id generation needs.
was:
In a configurable pattern, topic and key generation is needed. This pattern
could include static values and dynamic parameters which are exist in json tree.
Eg:
* property.format = "*signals_\{appId}_\{date}" >> "signals_app01_18-06-2019"*
** static '*signals*' *sdf*
** parameter '*appId*' from json tree
** parameter or record '*date*'
* property.date.field = "*details.signalCreationDate"*
** parameter '*details.signalCreationDate*' path from json tree
* property.date.format = "*dd-MM-yyyy"*
** date format for date parameters or record dates
Extracting topic or key (properties) with these way will led developers to use
them according to their business logic.
Especially this will be useful for Elasticsearch Kafka Connector in case of
dynamic index name and dynamic document id generation needs.
> Generate Topic/Key from Json Transform
> --------------------------------------
>
> Key: KAFKA-8554
> URL: https://issues.apache.org/jira/browse/KAFKA-8554
> Project: Kafka
> Issue Type: New Feature
> Components: KafkaConnect
> Reporter: Gokhan Sari
> Priority: Major
>
> In a configurable pattern, topic and key generation is needed. This pattern
> could include static values and dynamic parameters which are exist in json
> tree.
> Eg:
> * property.format = "*signals_\{appId}_\{date}" >>
> "signals_app01_18-06-2019"*
> ** static '*signals*'
> ** parameter '*appId*' from json tree
> ** parameter or record '*date*'
> * property.date.field = "*details.signalCreationDate"*
> ** parameter '*details.signalCreationDate*' path from json tree
> * property.date.format = "*dd-MM-yyyy"*
> ** date format for date parameters or record dates
>
> Extracting topic or key (properties) with these way will led developers to
> use them according to their business logic.
>
> Especially this will be useful for Elasticsearch Kafka Connector in case of
> dynamic index name and dynamic document id generation needs.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
