Hi all, I am reading the code of PySpark and its Streaming module.
In PySpark Streaming, when the `compute` method of the instance of PythonTransformedDStream is invoked, a connection to the CallbackServer is created internally. I wonder where is the CallbackServer for each PythonTransformedDStream instance on the slave nodes in distributed environment. Is there a CallbackServer running on every slave node? thanks Todd
