Yeachan Park created SPARK-42291:
------------------------------------
Summary: Allow drop column operation on non V2 tables
Key: SPARK-42291
URL: https://issues.apache.org/jira/browse/SPARK-42291
Project: Spark
Issue Type: New Feature
Components: SQL
Affects Versions: 3.2.0
Environment: We're running Spark 3.2.0 with an external hive
metastore; the underlying data is in parquet format in cloud storage.
Reporter: Yeachan Park
Drop column operations do not seem to be supported outside of non-V2 tables:
https://github.com/apache/spark/blob/5d45a415f3a29898d92380380cfd82bfc7f579ea/sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala#L93
We have not been able to find a clear rationale as to why. It would be nice if
this feature can be supported for none V2 tables.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
