Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/2376#issuecomment-55509430
It seems like the issue here is that unnecessary objects are being included
in the closure, since presumably this bug would also manifest itself through
serialization errors if the extra objects aren't serializable
Maybe we can test this directly with a mock object and a check that its
`writeObject` method isn't called.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
