Github user vanzin commented on the pull request:
https://github.com/apache/spark/pull/4155#issuecomment-71506461
> Do we have an example somewhere of Spark executors calling back to the
driver where the Driver handles those kinds of messages in a multithreaded way?
I don't remember any off the top of my head; in general, all the actors
I've seen just handle things inline, for better or worse. Haven't looked at
your latest update, but the usual way would be to have an executor service and
submit tasks to it as akka messages are received. Not sure about the akka
semantics (e.g. how to reply to the sender) from the worker thread, though.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
