GitHub user Stibbons opened a pull request:
https://github.com/apache/spark/pull/14180
Wheelhouse and VirtualEnv support
## What changes were proposed in this pull request?
Support virtualenv and wheel in PySpark, based on SPARK-13587.
Full description in
[SPARK-16367](https://issues.apache.org/jira/browse/SPARK-16367)
## How was this patch tested?
Manually tested on Ubuntu, Spark Standalone
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/Stibbons/spark wheelhouse_support
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14180.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14180
----
commit b3b4aabb369959f9f668c4f163aeb940e6d979da
Author: Jeff Zhang <[email protected]>
Date: 2016-01-29T03:43:24Z
temp save
commit 61a5ae2f55bf103c3e7385f726d801cf90f5fc97
Author: Jeff Zhang <[email protected]>
Date: 2016-02-01T07:54:54Z
change it to java 7 stule
commit e1a204bfef44d8513cb7129e2ce150ce9c777d4a
Author: Jeff Zhang <[email protected]>
Date: 2016-02-01T08:14:03Z
minor fix
commit 2ba31d42c93d820d0120c0e6d8b7890763ba88cc
Author: Jeff Zhang <[email protected]>
Date: 2016-02-02T01:42:53Z
fix shebang line limitation
commit 50a0047cdc574560b3728a6b49780d819a75205d
Author: Jeff Zhang <[email protected]>
Date: 2016-02-02T03:55:38Z
minor refactoring
commit a2382121932891f57db08c6666368fb6101a506c
Author: Jeff Zhang <[email protected]>
Date: 2016-02-03T07:22:26Z
fix cache_dir issue
commit 915f442d1b0de793df8dd6099c295b5e811f808c
Author: Jeff Zhang <[email protected]>
Date: 2016-06-10T11:39:18Z
Revert "[SPARK-15803][PYSPARK] Support with statement syntax for
SparkSession"
This reverts commit 2ab64b41137374b935f939d919fec7cb2f56cd63.
commit 92816bb0ee2947bb6972f10e93767ad2259d198b
Author: Gaetan Semet <[email protected]>
Date: 2016-07-01T14:31:53Z
reorg python imports statements
commit 791d2bc284008b1cd25115a03990fa4d1bb9251e
Author: Gaetan Semet <[email protected]>
Date: 2016-07-11T15:39:58Z
[SPARK-16367][PYSPARK] Add wheelhouse support
- Merge of #13599 ("virtualenv in pyspark", Bug SPARK-13587)
- and #5408 (wheel package support for Pyspark", bug SPARK-6764)
- Documentation updated
Signed-off-by: Gaetan Semet <[email protected]>
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
