[
https://issues.apache.org/jira/browse/SPARK-39422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen resolved SPARK-39422.
--------------------------------
Fix Version/s: 3.3.1
3.2.2
Resolution: Fixed
Issue resolved by pull request 36814
[https://github.com/apache/spark/pull/36814]
> SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported
> serde configurations
> -------------------------------------------------------------------------------------------------
>
> Key: SPARK-39422
> URL: https://issues.apache.org/jira/browse/SPARK-39422
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Josh Rosen
> Assignee: Josh Rosen
> Priority: Minor
> Fix For: 3.3.1, 3.2.2
>
>
> If you run `SHOW CREATE TABLE` against a Hive table which uses an unsupported
> Serde configuration, Spark will return an error message like
> {code:java}
> org.apache.spark.sql.AnalysisException: Failed to execute SHOW CREATE TABLE
> against table rcFileTable, which is created by Hive and uses the following
> unsupported serde configuration
> SERDE: org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe
> INPUTFORMAT: org.apache.hadoop.hive.ql.io.RCFileInputFormat OUTPUTFORMAT:
> org.apache.hadoop.hive.ql.io.RCFileOutputFormat {code}
> which is confusing to end users.
> In this situation, I think the error should suggest `SHOW CREATE TABLE ... AS
> SERDE` to users (similar to other error messages in this code path).
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
