Hi Russell, I went through this https://jaceklaskowski.gitbooks.io/mastering-apache-spark/spark-sql-thrift-server.html and I am still a bit confused on what hive is doing in here ? Is there any example I can look at on how to talk to Spark using Spark SQL JDBC driver alone and not hive ?
Thanks, kant On Sat, Aug 12, 2017 at 6:07 AM, Russell Spitzer <russell.spit...@gmail.com> wrote: > You don't have to go through hive. It's just spark sql. The application is > just a forked hive thrift server. > > On Fri, Aug 11, 2017 at 8:53 PM kant kodali <kanth...@gmail.com> wrote: > >> @Ryan it looks like if I enable thrift server I need to go through hive. >> I was talking more about having JDBC connector for Spark SQL itself other >> words not going through hive. >> >> On Fri, Aug 11, 2017 at 6:50 PM, kant kodali <kanth...@gmail.com> wrote: >> >>> @Ryan Does it work with Spark SQL 2.1.1? >>> >>> On Fri, Aug 11, 2017 at 12:53 AM, Ryan <ryan.hd....@gmail.com> wrote: >>> >>>> the thrift server is a jdbc server, Kanth >>>> >>>> On Fri, Aug 11, 2017 at 2:51 PM, <kanth...@gmail.com> wrote: >>>> >>>>> I also wonder why there isn't a jdbc connector for spark sql? >>>>> >>>>> Sent from my iPhone >>>>> >>>>> On Aug 10, 2017, at 2:45 PM, Jules Damji <dmat...@comcast.net> wrote: >>>>> >>>>> Yes, it's more used in Hive than Spark >>>>> >>>>> Sent from my iPhone >>>>> Pardon the dumb thumb typos :) >>>>> >>>>> On Aug 10, 2017, at 2:24 PM, Sathish Kumaran Vairavelu < >>>>> vsathishkuma...@gmail.com> wrote: >>>>> >>>>> I think it is for hive dependency. >>>>> On Thu, Aug 10, 2017 at 4:14 PM kant kodali <kanth...@gmail.com> >>>>> wrote: >>>>> >>>>>> Since I see a calcite dependency in Spark I wonder where Calcite is >>>>>> being used? >>>>>> >>>>>> On Thu, Aug 10, 2017 at 1:30 PM, Sathish Kumaran Vairavelu < >>>>>> vsathishkuma...@gmail.com> wrote: >>>>>> >>>>>>> Spark SQL doesn't use Calcite >>>>>>> >>>>>>> On Thu, Aug 10, 2017 at 3:14 PM kant kodali <kanth...@gmail.com> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi All, >>>>>>>> >>>>>>>> Does Spark SQL uses Calcite? If so, what for? I thought the Spark >>>>>>>> SQL has catalyst which would generate its own logical plans, physical >>>>>>>> plans >>>>>>>> and other optimizations. >>>>>>>> >>>>>>>> Thanks, >>>>>>>> Kant >>>>>>>> >>>>>>> >>>>>> >>>> >>> >>
