Github user justinrmiller commented on the issue:
https://github.com/apache/spark/pull/20572
Not to pile on, but I was encountering non-consecutive offsets on
non-compacted topics once or twice a day at our volume. This patch fixes this
(haven't had a problem with it since) and I'm sure there will be others
encountering this if they stream continuously tens of billions of messages a
day on kafka.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
