Github user rdblue commented on the issue:
https://github.com/apache/spark/pull/20752
Thanks for the clear summary, @cloud-fan. I think we want to make it easy
to support batch, and then easy to reuse those internals to support streaming
by adding new mix-in interfaces. Streaming is more complicated for
implementers, and I'd like to help people conceptually ramp up instead of
requiring a lot of understanding to get the simple cases working.
I think we may also want to put a design for the streaming side on the dev
list. If the batch side warranted a design discussion, then I think the
streaming side does as well. Changing the batch side for streaming changes as
they become necessary doesn't seem like a good way to arrive at a solid design
to me.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
