Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20710
My question is: why can't we use a batch interface for batch and
micro-batch (which behaves like batch) and add a separate streaming interface
for continuous streaming? I see no reason to have epoch ID for batch, and it
seems janky to add options that implementers should know to ignore.
> Spark may need to distinguish between different segments of the data when
talking to the remote sink.
For which case, continuous or micro-batch?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
