[
https://issues.apache.org/jira/browse/SPARK-4524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-4524:
--------------------------------
Labels: bulk-closed (was: )
> Add documentation on packaging Python dependencies / installing them on
> clusters
> --------------------------------------------------------------------------------
>
> Key: SPARK-4524
> URL: https://issues.apache.org/jira/browse/SPARK-4524
> Project: Spark
> Issue Type: New Feature
> Components: Documentation
> Reporter: Josh Rosen
> Priority: Major
> Labels: bulk-closed
>
> The documentation should have a section on ways to package Python
> dependencies, add them to jobs, install them on clusters, etc. with an
> overview of the different mechanisms and discussion of best practices.
> This could incorporate some information from
> https://stackoverflow.com/questions/24686474/shipping-python-modules-in-pyspark-to-other-nodes/24686708#24686708
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]