Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/186#issuecomment-39044180
Re:testing this, I think we should definitely have a unit test for this,
although I don't know enough about the Akka mechanisms at work here to know
what the best way to test this is. The simplest test I can think of is to
write an accumulator that throws an exception (or have another way of forcing
an exception in the DAGScheduler event loop; maybe it's easier to just override
the handleTaskCompletion method to throw an exception) and make sure everything
gets cleaned up properly.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
