Hi Everyone, I am a little puzzled by what I am seeing in some testing with a topology I have where the topo is reading from a KafkaSpout, doing some CPU intensive processing, and then writing out to Kafka via the standard KafkaBolt.
I am doing testing in a multi-tenant environment and so test results can vary by 10-20% on average. However, results are much more variable the last couple of days. The big thing I am noticing: whereas the throughput--as measured in tuples acked/minute--is half today of what it was yesterday for the same configuraton, the Complete Latency (total time a tuple is in the topology from the time it hits the KafkaSpout to the time it is acked in the KafkaBolt) today is a third of what it was yesterday. Any ideas as to how the throughput could go down dramatically at the same time the Complete Latency is improving? Thanks --John
