subject:"\"If I pass raw SQL string to dataframe do I still get the Spark SQL optimizations\\\?\""

Re: If I pass raw SQL string to dataframe do I still get the Spark SQL optimizations?

2017-07-06 Thread ayan guha

I kind of think "Thats the whole point" :) Sorry it is Friday here :) :) On Fri, Jul 7, 2017 at 1:09 PM, Michael Armbrust wrote: > It goes through the same optimization pipeline. More in this video > . > > On Thu, Jul 6, 2017 at 5:28 PM, kant kodali wrote: >

Re: If I pass raw SQL string to dataframe do I still get the Spark SQL optimizations?

2017-07-06 Thread Michael Armbrust

It goes through the same optimization pipeline. More in this video . On Thu, Jul 6, 2017 at 5:28 PM, kant kodali wrote: > HI All, > > I am wondering If I pass a raw SQL string to dataframe do I still get the > Spark SQL optimizations? why or why not? > > Than

If I pass raw SQL string to dataframe do I still get the Spark SQL optimizations?

2017-07-06 Thread kant kodali

HI All, I am wondering If I pass a raw SQL string to dataframe do I still get the Spark SQL optimizations? why or why not? Thanks!