Github user mccheah commented on the pull request:
https://github.com/apache/spark/pull/4155#issuecomment-71399368
@vanzin I can attempt to make OutputCommitCoordinator more multithreaded as
you suggest. Do we have an example somewhere of Spark executors calling back to
the driver where the Driver handles those kinds of messages in a multithreaded
way?
That might be a confusing question, so another way to put it: can we
achieve this communication without remote actors? From what I understand Spark
does all of its remote communication through remote actors.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
