Hi all, I'm using the Telegraf Kafka input plugin to read JSON data from a kafka topic. I have the offset = "newest" setting in my [[inputs.kafka_consumer]] configuration.
When I started it up, it began reading tons and tons and tons of things from kafka, for about a minute, it was doing 10,000/second. After that, it caught up and was doing about 50/second, which matches the production rate of the topic. The Kafka broker is version 0.10 but it was running in 0.8 compatibility mode to support older consumers. I want it to start at the most recent offset and go from there rather than trying to process the entire backlog before catching up. What approach should I take to fix this? Re-compile telegraf and use a different version of sarama? Forest -- Remember to include the version number! --- You received this message because you are subscribed to the Google Groups "InfluxData" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/influxdb. To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/4046b720-6cf9-46fd-8128-8b0f4ef5f8b1%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
