Depending on the version of Hive on Spark engine. As far as I am aware the latest version of Hive that I am using (Hive 2) has improvements compared to the previous versions of Hive (0.14,1.2.1) on Spark engine.
As of today I have managed to use Hive 2.0 on Spark version 1.3.1. So it is not the latest Spark but it is pretty good. What specific concerns do you have in mind? HTH Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* http://talebzadehmich.wordpress.com On 13 March 2016 at 23:27, sjayatheertha <sjayatheer...@gmail.com> wrote: > Just curious if you could share your experience on the performance of > spark in your company? How much data do you process? And what's the latency > you are getting with spark engine? > > Vidya