Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20710
Epoch ID is not a valid part of the logical place in a query for batch. I
think we should separate batch and streaming, as they are already coming from
different interfaces. There's no need to pass useless information to a batch
writer or committer.
Implementations can choose to use the same logic if they want, but we
should keep the API focused on what is needed, to keep it reasonable for
implementers.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
