Re: Topology with loops (intermediate topics) and potential bug in TopologyTestDriver

2019-09-12 Thread Adam Domanski
Hi John, Thanks for explanation. Yes, indeed, this is happening in my app. I also checked my state store behind the output topic and there is always the latest value. Is it possible that TestTopologyDriver can fully mimic Kafka Streams? Maybe somehow records in the output topic can be ordered

Re: Topology with loops (intermediate topics) and potential bug in TopologyTestDriver

2019-09-11 Thread John Roesler
Hi Adam, I haven't looked into your project yet, but just wanted to mention this to see if it explains your observations. TopologyTestDriver processes every input record fully and synchronously. So, when you pipe an input record in, it traverses all internal processing, including intermediate

Topology with loops (intermediate topics) and potential bug in TopologyTestDriver

2019-09-11 Thread Adam Domanski
Hi, I probably found a bug in TopologyTestDriver for quite non-trivial Kafka Streams topology. The streaming logic is the following: There is a concept of children and parents. Children are aggregated under parent. Some children of master parent can send poison pills to other parents. Such