Vu Le created KAFKA-8664:
----------------------------
Summary: non-JSON format messages when streaming data from Kafka
to Mongo
Key: KAFKA-8664
URL: https://issues.apache.org/jira/browse/KAFKA-8664
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Affects Versions: 2.1.1
Reporter: Vu Le
Attachments: MongoSinkConnector.properties,
log_error_when_stream_data_not_a_json_format.txt
Hi team,
I can stream data from Kafka to MongoDB with JSON messages. I use [MongoDB
Kafka
Connector|[https://github.com/mongodb/mongo-kafka/blob/master/docs/install.md]]
However, if I send a non-JSON format message the Connector died. Please see the
log file for details.
My config file:
{code:java}
name=mongo-sink
topics=testconnector.class=com.mongodb.kafka.connect.MongoSinkConnector
tasks.max=1
key.ignore=true
# Specific global MongoDB Sink Connector configuration
connection.uri=mongodb://localhost:27017
database=test_kafka
collection=transaction
max.num.retries=3
retries.defer.timeout=5000
type.name=kafka-connect
key.converter=org.apache.kafka.connect.json.JsonConverter
key.converter.schemas.enable=false
value.converter=org.apache.kafka.connect.json.JsonConverter
value.converter.schemas.enable=false
{code}
I have 2 separated questions:
# how to ignore the message which is non-json format?
# how to defined a default-key for this kind of message (for example: abc ->
\{{ { "non-json": "abc" } }}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
