Ok this is not much detail, but you are probably best off if you migrate them
Depends also on the Hive version and Spark version. If you have a recent one
with TEZ+llap I would not expect so much difference. It can be also less
performant -Spark SQL got only recently some features suchst cost based
> On 5. Apr 2018, at 08:02, Pralabh Kumar <pralabhku...@gmail.com> wrote:
> I have lot of ETL jobs (complex ones) , since they are SLA critical , I am
> planning them to migrate to spark.
>> On Thu, Apr 5, 2018 at 10:46 AM, Jörn Franke <jornfra...@gmail.com> wrote:
>> You need to provide more context on what you do currently in Hive and what
>> do you expect from the migration.
>>> On 5. Apr 2018, at 05:43, Pralabh Kumar <pralabhku...@gmail.com> wrote:
>>> Hi Spark group
>>> What's the best way to Migrate Hive to Spark
>>> 1) Use HiveContext of Spark
>>> 2) Use Hive on Spark
>>> 3) Migrate Hive to Calcite to Spark SQL