Wenchen Fan created SPARK-15887: ----------------------------------- Summary: Bring back the hive-site.xml support for Spark 2.0 Key: SPARK-15887 URL: https://issues.apache.org/jira/browse/SPARK-15887 Project: Spark Issue Type: Improvement Components: SQL Affects Versions: 2.0.0 Reporter: Wenchen Fan Assignee: Wenchen Fan
Right now, Spark 2.0 does not load hive-site.xml. Based on users' feedback, it seems make sense to still load this conf file. Originally, this file was loaded when we load HiveConf class and all settings can be retrieved after we create a HiveConf instances. Let's avoid of using this way to load hive-site.xml. Instead, since hive-site.xml is a normal hadoop conf file, we can first find its url using the classloader and then use Hadoop Configuration's addResource (or add hive-site.xml as a default resource through Configuration.addDefaultResource) to load confs. Please note that hive-site.xml needs to be loaded into the hadoop conf used to create metadataHive. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org