At this point of investigation, I have no idea
De : Vishnu Manivannan
Envoyé : vendredi 20 juillet 2018 21:28:24
À : users@kafka.apache.org
Objet : Re: Kafka Connect: Increase Consumer Consumption
No, I'm just running one consumer now and trying to increase
than 1150 records,
and your topic gets out more than 5000 records.
Adrien
De : Vishnu Manivannan
Envoyé : jeudi 19 juillet 2018 00:05:14
À : users@kafka.apache.org
Objet : Re: Kafka Connect: Increase Consumer C
gets out more than 5000 records.
Adrien
De : Vishnu Manivannan
Envoyé : jeudi 19 juillet 2018 00:05:14
À : users@kafka.apache.org
Objet : Re: Kafka Connect: Increase Consumer Consumption
Hi Adrien,
I set fetch.max.wait.ms to 1500 ms and ran it again. It still
Hi Adrien,
I set fetch.max.wait.ms to 1500 ms and ran it again. It still isn't crossing
1150 records per fetch. On the producer side (using kakfa-producer-perf-test),
its producing about 30,000 records/sec and a million records in total.
I tried different configurations amongst these three
Hi Vishnu,
do you have check your fetch.max.wait.ms value ?
it may not be long enough time to wait until you recover your 5000 records ...
maybe just enough time to recover only 1150 records.
fetch.max.wait.ms
By setting fetch.min.bytes, you tell Kafka to wait until it has enough data to
