Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/2844#issuecomment-59653126
This most recent test-failure is another side-effect of removing
TorrentBroadcast's optimizations for local mode:
```
[info] - Unpersisting TorrentBroadcast on executors only in local mode ***
FAILED ***
[info] 1 did not equal 0 (BroadcastSuite.scala:219)
[info] - Unpersisting TorrentBroadcast on executors and driver in local
mode *** FAILED ***
[info] 1 did not equal 0 (BroadcastSuite.scala:219)
```
This time, the error is because there's a check that asserts that broadcast
pieces are not stored into the driver's block manager when running in local
mode. I don't think that this optimization necessarily makes sense, since
we'll have to store those blocks anyways when running in distributed mode.
Therefore, I'm going to change these tests to remove this local-mode
special-casing.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
