Davies Liu created SPARK-5160:
---------------------------------
Summary: Python module in jars
Key: SPARK-5160
URL: https://issues.apache.org/jira/browse/SPARK-5160
Project: Spark
Issue Type: New Feature
Components: PySpark, Spark Core
Reporter: Davies Liu
In order to simplify publish of spark packages with Python modules, we could
put the python module into jars (jar is a zip but with different extension).
Python can import the module in a jar when:
1) the module is in the top level of jar
2) the path to jar is sys.path
So, we should put the path of jar into PYTHONPATH in driver and executor.
cc [~pwendell]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
