GitHub user yhuai opened a pull request:
https://github.com/apache/spark/pull/14267
[SPARK-15705] [SQL] Change the default value of
spark.sql.hive.convertMetastoreOrc to false.
## What changes were proposed in this pull request?
In 2.0, we add a new logic to convert HiveTableScan on ORC tables to
Spark's native code path. However, during this conversion, we drop the original
metastore schema (https://issues.apache.org/jira/browse/SPARK-15705). Because
of this regression, I am changing the default value of
{{spark.sql.hive.convertMetastoreOrc}} to false.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yhuai/spark SPARK-15705-changeDefaultValue
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14267.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14267
----
commit 057f79a812cbca7fd51fd4fb82684aeb486d8395
Author: Yin Huai <[email protected]>
Date: 2016-07-19T17:57:29Z
[SPARK-15705] [SQL] Change the default value of
spark.sql.hive.convertMetastoreOrc to false. Because the conversion introduces
a regression when reading ORC tables generated by Hive before Hive 2.0.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
