Under the covers we use Jackson's Streaming API as of Spark 1.4.
On Tue, Aug 18, 2015 at 1:12 PM, Udit Mehta wrote:
> Hi,
>
> I was wondering what json serde does spark sql use. I created a JsonRDD
> out of a json file and then registered it as a temp table to query. I can
> then query the table
Hi,
I was wondering what json serde does spark sql use. I created a JsonRDD out
of a json file and then registered it as a temp table to query. I can then
query the table using dot notation for nested structs/arrays. I was
wondering how does spark sql deserialize the json data based on the query.