Re: Dataframe v/s SparkSQL

2015-03-02 Thread Michael Armbrust
They are the same.  These are just different ways to construct catalyst
logical plans.

On Mon, Mar 2, 2015 at 12:50 PM, Manoj Samel manojsamelt...@gmail.com
wrote:

 Is it correct to say that Spark Dataframe APIs are implemented using same
 execution as SparkSQL ? In other words, while the dataframe API is
 different than SparkSQL, the runtime performance of equivalent constructs
 in Dataframe and SparkSQL should be same. So one should be able to choose
 whichever of the two (DF v/s SQL) suite the use cases and not worry about
 runtime performance.

 Pl comment ...

 Thanks,



Dataframe v/s SparkSQL

2015-03-02 Thread Manoj Samel
Is it correct to say that Spark Dataframe APIs are implemented using same
execution as SparkSQL ? In other words, while the dataframe API is
different than SparkSQL, the runtime performance of equivalent constructs
in Dataframe and SparkSQL should be same. So one should be able to choose
whichever of the two (DF v/s SQL) suite the use cases and not worry about
runtime performance.

Pl comment ...

Thanks,