Github user squito commented on the pull request:
https://github.com/apache/spark/pull/8760#issuecomment-151689989
Hi @mwws -- I took a closer look and figured out what is going on with the
tests. By looking at the full logs from the unit tests (available under "Build
Artifacts" here:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44460/) I
could see that all the time is getting sunk into [`AccumulatorSuite:internal
accumulators in fully resubmitted
stages`](https://github.com/apache/spark/blob/master/core/src/test/scala/org/apache/spark/AccumulatorSuite.scala#L250).
From trying it out locally, "internal accumulators in partially resubmitted
stages" also seems to take really long. Can you take a closer look at those
tests and figure out why they are taking so long? You should be able to debug
locally. My guess is that somehow the blacklisting is getting turned on in
these tests that fail executors though it shouldn't be. (Perhaps there should
even be some check that blacklisting isn't turned on when in local mode ...)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
