Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/14210#discussion_r71657222
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala ---
@@ -344,6 +344,11 @@ class SparkSqlAstBuilder(conf: SQLConf) extends
AstBuilder {
table, provider, partitionColumnNames, bucketSpec, mode, options,
query)
} else {
val struct = Option(ctx.colTypeList()).map(createStructType)
+ if (struct.isEmpty && bucketSpec.nonEmpty) {
--- End diff --
In that case, partition columns are inferred at runtime. Thus, although we
ignore user specified partition columns, but we still treat the table as a
partition table.
Here, we will really ignore the bucket spec, because the bucket columns are
not inferred at runtime. That means, we will not treat it as a bucket table.
That is the major reason why this PR issues the exception.
Let me know if Log message is still better here. Thanks!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
