Re: [pmacct-discussion] pmbgpd -> Kafka Local Queue Full

2020-09-02 Thread Andy Davidson
Hi, Thanks for replying so quickly. The Kafka server has plenty of headroom left, and there is no barrier to producing and consuming to the topic (though I used kafkacat as I find it a lot easier than kafka-console-*.sh) However, as usual you nailed it with a suggestion - upgrading librdkafk

Re: [pmacct-discussion] pmbgpd -> Kafka Local Queue Full

2020-09-02 Thread Paolo Lucente
Hi Andy, I may suggest to check Kafka logs and perhaps see if anything useful comes out of librdkafka stats (ie. set "global, statistics.interval.ms, 6" in your librdkafka.conf). Check also that, if you are adding load to existing load, the Kafka broker is not pegging 100% CPU or maxing o

[pmacct-discussion] pmbgpd -> Kafka Local Queue Full

2020-09-02 Thread Andy Davidson
Hello! I am feeding some BMP feeds via pmbmpd into Kafka and it’s working well. I now want to feed some BGP feeds into a Kafka topic using pmbgpd but similar configuration is causing a different behaviour. Sep  1 22:48:00 bump pmbgpd[10992]: INFO ( default/core ): Reading configuration file