Andi created SPARK-23968:
----------------------------
Summary: allow reading JSON that is composed of pure maps
Key: SPARK-23968
URL: https://issues.apache.org/jira/browse/SPARK-23968
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.3.0
Reporter: Andi
org.apache.spark.sql.DataFrameReader#schema requires a StructType and hence
cannot be provided with a MapType.
The usecase is to allow processing JSON encoded with id's as keys, rather than
well formed property names as the outer wrapper
[ \{ "id-1": {"name": "bar"} , \{"id-2": {"name:"foo"} ]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
