GitHub user BryanCutler opened a pull request:
https://github.com/apache/spark/pull/20210
[SPARK-23009][PYTHON] Fix for non-str col names to createDataFrame from
Pandas
## What changes were proposed in this pull request?
This the case when calling `SparkSession.createDataFrame` using a Pandas
DataFrame that has non-str column labels.
## How was this patch tested?
Added a new test with a Pandas DataFrame that has int column labels
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/BryanCutler/spark
python-createDataFrame-int-col-error-SPARK-23009
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20210.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20210
----
commit e2b1a4160be46e4cdf248e4d219c1a0e2dbec00e
Author: Bryan Cutler <cutlerb@...>
Date: 2018-01-09T19:57:29Z
fixed col name encoding to allow for unicode and non-str, added test
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]