Hi Team,
Good Day!
We are currently in the process of migrating data from our existing Kafka
cluster to a new one, As part of this transition we are using MirrorMaker 2 to
replicate data between the old and new Kafka servers.
However, we are encountering a critical issue with MirrorMaker 2 is shutting
down unexpectedly during data processing, and the following error is being
logged,
We tried with all required parameters under connect MirrorMaker connector but
followed issue persisting.
Error logs:
ERROR [MirrorSourceConnector|task-0]
WorkerSourceTask{id=MirrorSourceConnector-0} failed to send record to
eps.leaf.logs: (org.apache.kafka.connect.runtime.AbstractWorkerSourceTask:422)
org.apache.kafka.common.errors.RecordTooLargeException: The message is 1850356
bytes when serialized which is larger than 1048576, which is the value of the
max.request.size configuration.
We would appreciate your assistance in reviewing this error and helping us
resolve the issue as a priority, as it is impacting our data pipeline between
Kafka and the ELK stack.
Please let us know if you need any additional logs or configuration details to
assist with troubleshooting.
Looking forward to your prompt support.
Thanks & Regards,
___________________________________________________________________
[Description: Email_CBE.gif]Sreenivas Narala
DevOps consultant
Europe CSD ADC
Capgemini Technology Services India Limited | Bangalore
cell: +91 9986643045
www.capgemini.com<http://www.capgemini.com/>
People matter, results count.
This message contains information that may be privileged or confidential and is
the property of the Capgemini Group. It is intended only for the person to whom
it is addressed. If you are not the intended recipient, you are not authorized
to read, print, retain, copy, disseminate, distribute, or use this message or
any part thereof. If you receive this message in error, please notify the
sender immediately and delete all copies of this message.
