GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/20725
[WIP][SPARK-23555][PYTHON] Add BinaryType support for Arrow
## What changes were proposed in this pull request?
Adding `BinaryType` support for Arrow in pyspark.
## How was this patch tested?
Additional unit tests in pyspark for code paths that use Arrow
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/BryanCutler/spark
arrow-binary-type-support-SPARK-23555
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20725.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20725
----
commit afcb0d5608c17d2fc004a0b6d4af4573abca4e4b
Author: Bryan Cutler <cutlerb@...>
Date: 2018-03-03T00:32:45Z
added support for binary type, not currently working due to arrow error
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
