GitHub user bouk opened a pull request:
https://github.com/apache/spark/pull/656
Add Python includes to path before depickling broadcast values
This fixes https://issues.apache.org/jira/browse/SPARK-1731 by adding the
Python includes to the PYTHONPATH before depickling the broadcast values
@airhorns
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Shopify/spark python-includes-before-broadcast
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/656.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #656
----
commit a9f29a0820206aa2d831bbca9149e2f547ca7e8e
Author: Bouke van der Bijl <[email protected]>
Date: 2014-05-06T00:07:21Z
Add Python includes to path before depickling broadcast values
This fixes https://issues.apache.org/jira/browse/SPARK-1731 by adding
the Python includes to the PYTHONPATH before depickling the broadcast
values
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---