Github user CodingCat commented on the pull request:
https://github.com/apache/spark/pull/186#issuecomment-41240857
Hey, @markhamstra @mateiz , thanks for that the Jenkins is so busy tonight,
the test of this PR keeps failing....when running with the other 4 test jobs,
https://github.com/CodingCat/spark/blob/SPARK-1235/core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala#L428
always throws NPE....
it seems that eventProcessActor is not well initialized....
I spent hours on this and find out that context.actorOf is changed to be a
non-blocking method in akka 2.2.3
(http://doc.akka.io/api/akka/2.2.3/#akka.actor.ActorContext), whereas in the
older version, like akka 2.0.x,
http://doc.akka.io/api/akka/2.0.1/#akka.actor.ActorContext, it's a blocking
method....Spark relies on 2.2.3, so when the server is busy, the non-blocking
ActorContext.actorOf takes a long time to return while the successive code is
executed, so NPE is thrown....
fixed this issue in my latest commit
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
