Re: Spark SQL JSON dataset query nested datastructures

Sounds like you need to use lateral view with explode , which is supported in Spark SQL's HiveContext. On Sat, Aug 9, 2014 at 6:43 PM, Sathish Kumaran Vairavelu < vsathishkuma...@gmail.com> wrote: > I have a simple JSO

Spark SQL JSON dataset query nested datastructures

I have a simple JSON dataset as below. How do I query all parts.lock for the id=1. JSON: { "id": 1, "name": "A green door", "price": 12.50, "tags": ["home", "green"], "parts" : [ { "lock" : "One lock", "key" : "single key" }, { "lock" : "2 lock", "key" : "2 key" } ] } Query: select id,name,price,