GitHub user kmanamcheri opened a pull request:
https://github.com/apache/spark/pull/22614
HiveClient.getPartitionsByFilter should not throw an exception if HMS
retries directSql
## What changes were proposed in this pull request?
When using partition filter pushdown to HMS, Spark should expect a
MetaException from HMS if
partition filtering is not supported and should call getAllPartitions
instead. HMS is expected to
throw a MetaException even if directSql is enabled.
## How was this patch tested?
Unit tests on the Spark SQL component were run successfully.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kmanamcheri/spark SPARK-25561
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22614.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22614
----
commit dddffcae8824e72d614fd6202e7fc562c490098b
Author: Karthik Manamcheri <karthik@...>
Date: 2018-10-02T16:11:20Z
HiveShim should expect MetaException from HMS in all cases
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
