Re: Weird experience Hive with Spark Transformations

2017-01-17 Thread Chetan Khatri
But Hive 1.2.1 do not have hive-site.xml, I tried to add my own which causes me other several issues. On the other side it works well for me with Hive 2.0.1 where hive-site.xml content were as below and copied to spark/conf too. it worked. *5. hive-site.xml configuration setup* Add below at

Re: Weird experience Hive with Spark Transformations

2017-01-17 Thread Dongjoon Hyun
Hi, Chetan. Did you copy your `hive-site.xml` into Spark conf directory? For example, cp /usr/local/hive/conf/hive-site.xml /usr/local/spark/conf If you want to use the existing Hive metastore, you need to provide that information to Spark. Bests, Dongjoon. On 2017-01-16 21:36 (-0800),

Weird experience Hive with Spark Transformations

2017-01-16 Thread Chetan Khatri
Hello, I have following services are configured and installed successfully: Hadoop 2.7.x Spark 2.0.x HBase 1.2.4 Hive 1.2.1 *Installation Directories:* /usr/local/hadoop /usr/local/spark /usr/local/hbase *Hive Environment variables:* #HIVE VARIABLES START export HIVE_HOME=/usr/local/hive