Hi all, I have just created KIP-129 to leverage KIP-98 in Kafka Streams and provide exactly-once processing semantics:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-129%3A+Streams+Exactly-Once+Semantics This KIP enables Streams users to optionally turn on exactly-once processing semantics without changing their app code at all by leveraging the transactional messaging features provided in KIP-98. The above wiki page provides a high-level view of the proposed changes, while detailed implementation design can be found in this Google doc: https://docs.google.com/document/d/1pGZ8xtOOyGwDYgH5vA6h19zOMMaduFK1DAB8_gBYA2c We would love to hear your comments and suggestions. Thanks, -- Guozhang