Re: Kafka producer throw "TimeoutException: Batch Expired" when consumer begin to read data

2018-12-05 Thread Ismael Juma
This is likely the issue fixed by KIP-91. You'll get the right behaviour if you upgrade to 2.1 or you can increase the request timeout. Ismael On Tue, Dec 4, 2018, 10:12 PM JF Chen I have a system keep sending data to kafka continuously, and a spark > streaming application reading these data

Kafka producer throw "TimeoutException: Batch Expired" when consumer begin to read data

2018-12-04 Thread JF Chen
I have a system keep sending data to kafka continuously, and a spark streaming application reading these data from kafka every 5 minutes However, I found the kafka producer throws "TimeoutException: Batch Expired" error when sparking streaming begin to read the kafka every 5 minutes. What's the