GitHub user rajeshbalamohan opened a pull request:
https://github.com/apache/spark/pull/10938
SPARK-12998 [SQL]. Enable OrcRelation when connecting via spark thrifâ¦
When a user connects via spark-thrift server to execute SQL, it does not
enable PPD with ORC. It ends up creating MetastoreRelation which does not have
ORC PPD. Purpose of this JIRA is to convert MetastoreRelation to OrcRelation in
HiveMetastoreCatalog, so that users can benefit from PPD even when connecting
to spark-thrift server.
For e.g, Query "select count(1) from tpch_flat_orc_1000.lineitem where
l_shipdate = '1990-04-18'" which is fired against spark-thrift-server or
sqlContext would end up using "OrcRelation" to make use of PPD instead of
MetastoreRelation.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rajeshbalamohan/spark spark-12998
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10938.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10938
----
commit 1a5b164153df946d713b34727a001d5005479d1a
Author: Rajesh Balamohan <[email protected]>
Date: 2016-01-27T02:19:53Z
SPARK-12998 [SQL]. Enable OrcRelation when connecting via spark thrift
server.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
