[ https://issues.apache.org/jira/browse/SPARK-24096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuming Wang resolved SPARK-24096. --------------------------------- Resolution: Duplicate > create table as select not using hive.default.fileformat > -------------------------------------------------------- > > Key: SPARK-24096 > URL: https://issues.apache.org/jira/browse/SPARK-24096 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.3.0 > Reporter: StephenZou > Priority: Major > > In my spark conf directory, hive-site.xml have an item indicating orc is the > default file format. > <property> > <name>hive.default.fileformat</name> > <value>orc</value> > </property> > > But when I use "create table as select ..." to create a table, the output > format is plain text. > It works only I use "set hive.default.fileformat=orc" > > Then I walked through the spark code and found in > sparkSqlParser:visitCreateHiveTable(), > val defaultStorage = HiveSerDe.getDefaultStorage(conf) the conf is SQLConf, > that explains the above observation, > "set hive.default.fileformat=orc" is put into conf map, hive-site.xml is not. > > It's quite misleading, How to unify the settings? > > -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org