Artem Aliev created SPARK-11208:
-----------------------------------

             Summary: Filter out 'hive.metastore.rawstore.impl' from 
executionHive temporary config
                 Key: SPARK-11208
                 URL: https://issues.apache.org/jira/browse/SPARK-11208
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.5.1, 1.6.0
            Reporter: Artem Aliev


Spark use two hive meta stores: external one for storing tables and internal 
one (executionHive):
{code}
/**
The copy of the hive client that is used for execution. Currently this must 
always be
Hive 13 as this is the version of Hive that is packaged with Spark SQL. This 
copy of the
client is used for execution related tasks like registering temporary functions 
or ensuring
that the ThreadLocal SessionState is correctly populated. This copy of Hive is 
not used
for storing persistent metadata, and only point to a dummy metastore in a 
temporary directory. */
{code}
The executionHive assumed to be a standard meta store located in temporary 
directory as a derby db. But hive.metastore.rawstore.impl was not filtered out 
so any custom implementation of the metastore with other storage properties 
(not JDO) will persist that temporary functions. CassandraMetaStore from 
DataStax Enterprise is one of examples.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to