[
https://issues.apache.org/jira/browse/SPARK-31648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Tadi updated SPARK-31648:
--------------------------------
Description:
When I submit a SQL with partition filter I see the below error. I tried
setting Spark ConfigurationĀ spark.sql.hive.manageFilesourcePartitions to false
but I still see the same issue.
java.lang.RuntimeException: Caught Hive MetaException attempting to get
partition metadata by filter from Hive.
java.lang.reflect.InvocationTargetException:
org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported only
on partition keys of type string
org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported only
on partition keys of type string
was:
When I submit a SQL with partition filter I see the below error. I tried
setting Spark ConfigurationĀ spark.sql.hive.manageFilesourcePartitions to false
but no luck.
java.lang.RuntimeException: Caught Hive MetaException attempting to get
partition metadata by filter from Hive.
java.lang.reflect.InvocationTargetException:
org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported only
on partition keys of type string
org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported only
on partition keys of type string
> Filtering is supported only on partition keys of type string
> ------------------------------------------------------------
>
> Key: SPARK-31648
> URL: https://issues.apache.org/jira/browse/SPARK-31648
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.4.4
> Reporter: Rajesh Tadi
> Priority: Major
> Attachments: Spark Bug.txt
>
>
> When I submit a SQL with partition filter I see the below error. I tried
> setting Spark ConfigurationĀ spark.sql.hive.manageFilesourcePartitions to
> false but I still see the same issue.
> java.lang.RuntimeException: Caught Hive MetaException attempting to get
> partition metadata by filter from Hive.
> java.lang.reflect.InvocationTargetException:
> org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported
> only on partition keys of type string
> org.apache.hadoop.hive.metastore.api.MetaException: Filtering is supported
> only on partition keys of type string
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]