With the Produce_Kafka_0_10 processor 1507 flowfiles are pushed onto a topic.
A separate process mangles a bit with these records and pushes them back on a separate topic. With the Consume_Kafka_0_10 processor I'm ingesting this second topic again. According to Kafka, this Nifi consumer is at offset 1507 (so there's no lag). The total amount of processing time was around 3 minutes (less than 5 for sure). Weird thing is, I cannot correlate these number in the Nifi consumer. The status history of the processor returns an aggregated sum of 700 flowfiles out (all flowfiles are transferred to a logging processor). Data provenance has 700 messages as well. `Flowfiles in` is 0 (I suppose because there's no ingoing arrow on the consumer) so that's not of any use. `Message Demarcator` is not set, `Max Poll Records` 1000, `Max Uncommitted Time` 1 s have default values, so every incoming message should result in 1 flowFile to my understanding. Not really sure what to think of this. Are there any other places i can look for the total amount of flowfiles (in/out) during a certain amount of time? -- Mvg, Raf Huys
