Andi created SPARK-23968:

             Summary: allow reading JSON that is composed of pure maps
                 Key: SPARK-23968
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.3.0
            Reporter: Andi

org.apache.spark.sql.DataFrameReader#schema requires a StructType and hence 
cannot be provided with a MapType.

The usecase is to allow processing JSON encoded with id's as keys, rather than 
well formed property names as the outer wrapper

[ \{ "id-1": {"name": "bar"} , \{"id-2": {"name:"foo"} ]

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to