Re: SparkSQL and Hive/Hive metastore testing - LocalHiveContext

2014-11-19 Thread Michael Armbrust
On Tue, Nov 18, 2014 at 10:34 PM, Night Wolf wrote: > > Is there a better way to mock this out and test Hive/metastore with > SparkSQL? > I would use TestHive which creates a fresh metastore each time it is invoked.

SparkSQL and Hive/Hive metastore testing - LocalHiveContext

2014-11-18 Thread Night Wolf
Hi, Just to give some context. We are using Hive metastore with csv & Parquet files as a part of our ETL pipeline. We query these with SparkSQL to do some down stream work. I'm curious whats the best way to go about testing Hive & SparkSQL? I'm using 1.1.0 I see that the LocalHiveContext has bee