Thanks for the pointer, it seems that 2.x has some wonderful improvements.
Just now looked into detail on Timely and they seem to also have
encountered this problem and went ahead with a
custom MetricCompactionStrategy. We will go the same route.
On Tue, Nov 24, 2020 at 10:00 PM Christopher
A custom CompactionStrategy is probably your best bet, I would think, since
you have very specific requirements.
You may also be interested in the work done by Keith Turner for 2.1.0 (not
yet released, as it is still under development) to add more control over
compactions. A preview of the javadoc
We have a scenario where we use the SummingCombiner aggregating stats on
high cardinality properties of a streaming dataset. Use-case is generating
histograms over a certain period, so we age off these stats after a certain
time.
We run into some unexpected behaviour where the ageoff does not
