[
https://issues.apache.org/jira/browse/SPARK-42291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yeachan Park updated SPARK-42291:
---------------------------------
Description:
Drop column operations do not seem to be supported in non-V2 tables:
https://github.com/apache/spark/blob/5d45a415f3a29898d92380380cfd82bfc7f579ea/sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala#L93
We have not been able to find a clear rationale as to why. It would be nice if
this feature can be supported for none V2 tables.
was:
Drop column operations do not seem to be supported outside of non-V2 tables:
https://github.com/apache/spark/blob/5d45a415f3a29898d92380380cfd82bfc7f579ea/sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala#L93
We have not been able to find a clear rationale as to why. It would be nice if
this feature can be supported for none V2 tables.
> Allow drop column operation on non V2 tables
> --------------------------------------------
>
> Key: SPARK-42291
> URL: https://issues.apache.org/jira/browse/SPARK-42291
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 3.2.0
> Environment: We're running Spark 3.2.0 with an external hive
> metastore; the underlying data is in parquet format in cloud storage.
> Reporter: Yeachan Park
> Priority: Minor
>
> Drop column operations do not seem to be supported in non-V2 tables:
> https://github.com/apache/spark/blob/5d45a415f3a29898d92380380cfd82bfc7f579ea/sql/core/src/main/scala/org/apache/spark/sql/catalyst/analysis/ResolveSessionCatalog.scala#L93
> We have not been able to find a clear rationale as to why. It would be nice
> if this feature can be supported for none V2 tables.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
