I think this will increasingly be its role, though it doesn't make sense to use it to core because it is clearly just a client of the core APIs. What usage do you have in mind in particular? It would be nice to know how the non-SQL APIs for this could be better.
Matei On August 27, 2014 at 2:31:45 PM, Koert Kuipers (ko...@tresata.com) wrote: i feel like SchemaRDD has usage beyond just sql. perhaps it belongs in core?