Nobody has any idea... ?
Is filtering after aggregation in structured streaming supported but maybe
buggy? See following line in the example from earlier mail...
...
.where(F.expr("distinct_username >= 2"))
...
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
We implemented a streaming query with aggregation on event-time with
watermark. I'm wondering why aggregation state is not cleanup up. According
to documentation old aggregation state should be cleared when using
watermarks. We also don't see any condition [1] for why state should not be
cleanup
