Github user jose-torres commented on the issue:
https://github.com/apache/spark/pull/21199
I think that's unavoidable if we want to have a socket source. The
microbatch socket source has the same thing going on. I'd expect most people
looking into implementation details of data sources will understand that they
ought to read from executors in general.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]