Regarding:
> We should also know, when we need to evict earliest -- thus, it should be 
> sufficient to schedule accordingly? I think, we can also exploit cancellation 
> to scheduled punctuation to be more flexible.

This is true, but it's slightly tricky (or at least it took me a while to 
realize it's not sufficient to trigger every `suppressDuration` ms). I guess 
that each time we have a new min buffered timestamp `m`, we'd schedule a 
punctuation, we could cancel the previous punctuation and schedule a 
punctuation for `m + suppressDuration` time from now.

The punctuation schedule doesn't let you schedule in the form of "`x` ms from 
now", (I'm guessing it's epoch aligned like the windows), so we'd do a little 
math to compute a punctuation interval that would next fire at the correct time.

I said "each time we have a new min timestamp". This can happen when we buffer 
new records or when we evict records.

Is this what you had in mind?

[ Full content available at: https://github.com/apache/kafka/pull/5693 ]
This message was relayed via gitbox.apache.org for [email protected]

Reply via email to