Github user koeninger commented on the issue:
https://github.com/apache/spark/pull/21651
- We need agreement on whether it is worth making a change to the public
Sink api (probably not any time soon, judging from the spark 3.0 vs 2.4
discussion), or whether there is a different way to accomplish the goal.
- I wouldn't worry about what any particular sink implementation does with
the offsets, most of the existing ones shouldn't do anything by default. You
just need a proof of concept that a given sink (e.g. a database sink) can do
something useful with them.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
