Re: [shark-users] SQL on Spark - Shark or SparkSQL

2014-03-30 Thread Nick Pentreath
It shouldn't be too tricky to use the Spark job server to create a job where the SQL statement is an input argument, which is executed and the result returned. This gives remote server execution but no metastore layer— Sent from Mailbox for iPhone On Mon, Mar 31, 2014 at 6:56 AM, Manoj Samel wr

Re: [shark-users] SQL on Spark - Shark or SparkSQL

2014-03-30 Thread Manoj Samel
Thanks Matei, Any thoughts of providing Standalone SharkServer equivalent on SparkSQL? Manoj On Sun, Mar 30, 2014 at 7:35 PM, Matei Zaharia wrote: > Hi Manoj, > > At the current time, for drop-in replacement of Hive, it will be best to > stick with Shark. Over time, Shark will use the Spark SQ

Re: [shark-users] SQL on Spark - Shark or SparkSQL

2014-03-30 Thread Matei Zaharia
Hi Manoj, At the current time, for drop-in replacement of Hive, it will be best to stick with Shark. Over time, Shark will use the Spark SQL backend, but should remain deployable the way it is today (including launching the SharkServer, using the Hive CLI, etc). Spark SQL is better for accessin