Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20752
> Right now, we're still at the point where we aren't quite sure what a
streaming API needs to look like. We're starting from basically ground zero;
the V1 streaming API just throws a DataFrame at the sink and tells it to catch.
So we need to iterate towards something that works at all before a meaningful
design discussion is possible.
Thanks for the context. This aligns with the impression I've gotten and it
makes sense. My push for separation between the batch and streaming sides comes
from wanting to keep that evolution from making too many changes to the batch
side that's better understood. I also think that streaming is different enough
that we might be heading in the wrong direction by trying to combine the
interfaces too early on.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
