Github user BryanCutler commented on the issue:
https://github.com/apache/spark/pull/19459
Merged in PR from @ueshin and added case for when schema is a string single
datatype. In addition using a `StructType`, now this handles specifying the
schema with the following:
```
spark.createDataFrame(pdf, ['name', 'age'])
spark.createDataFrame(pdf, "a: string, b: int")
spark.createDataFrame(pdf, "int")
spark.createDataFrame(pdf, "struct<a: int>")
```
@viirya brought up a good point here
https://github.com/apache/spark/pull/19459#discussion_r145862488 (linking
because it's outdated and hidden) - which shows another good reason to upgrade
Arrow, I think
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
