[ 
https://issues.apache.org/jira/browse/KAFKA-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17097040#comment-17097040
 ] 

Matthias J. Sax commented on KAFKA-7224:
----------------------------------------

Thanks for clarification. I missed the point that you can allow `suppress()` to 
also emit if the buffer is full. For this case, having a larger buffer could 
help to reduce intermediate results. My bad.

About KIP-428: I am not sure atm what was proposed, but I agree that only a 
pure wall-clock-time emit strategy does make sense to have a good rate control.

Btw: I think [~vvcephei] actually work on RocksDB support for suppress() but 
the performance was pretty bad and he never finished it.

In any case: If you really need a feature and nobody is working on it, feel 
free to pick it up. Kafka is an open source project after all.

> KIP-328: Add spill-to-disk for Suppression
> ------------------------------------------
>
>                 Key: KAFKA-7224
>                 URL: https://issues.apache.org/jira/browse/KAFKA-7224
>             Project: Kafka
>          Issue Type: Improvement
>          Components: streams
>            Reporter: John Roesler
>            Priority: Major
>
> As described in 
> [https://cwiki.apache.org/confluence/display/KAFKA/KIP-328%3A+Ability+to+suppress+updates+for+KTables]
> Following on KAFKA-7223, implement the spill-to-disk buffering strategy.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to