GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/21013
[WIP][SPARK-23874][SQL][PYTHON] Upgrade Arrow and pyarrow to 0.9.0
## What changes were proposed in this pull request?
Upgrade Arrow to 0.9.0. This includes the Java jar and will require the
Jenkins test environment to upgrade pyarrow on the Python 2 environments.
## How was this patch tested?
Existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/BryanCutler/spark arrow-upgrade-090
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21013.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21013
----
commit 255647589c8980465bbeb64788988468748814a8
Author: Bryan Cutler <cutlerb@...>
Date: 2018-04-09T19:26:06Z
made required code changes for upgrade
commit c1791bf9f0cdd8074a19130e05be52d60f1e618c
Author: Bryan Cutler <cutlerb@...>
Date: 2018-04-09T19:26:54Z
remove unused import
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]