Github user arunmahadevan commented on the issue:
https://github.com/apache/spark/pull/21490
@jerryshao , was not aware of your PR before raising this, so looks like we
both encountered similar issues. I think the intention is similar here and
attempts to start from last saved offset (offsets are contiguous which may be
slightly different from your PR). And maybe we don't need a separate flag,
since the socket source is not expected to be fault tolerant.
The intention is with the fix socket source can work across restarts and
allows users to play with the state in sample programs. Overall I think this
will make the socket source more usable.
@tdas can you comment?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
