ottomata commented on PR #21012: URL: https://github.com/apache/spark/pull/21012#issuecomment-1861134587
@cloud-fan in my tests, this works for tables created with e.g. `USING ICEBERG`, but not with tables `USING PARQUET` or `USING HIVE`. Altering a nested column with HIVE and PARQUET both throw e.g. ``` Error in query: AlterTableAddColumnsCommand does not support nested column: s1.added_field0 ``` We have a lot of existent Hive parquet tables we'd like evolve. We would be fine with losing support for querying them with Hive MR (relying only on spark and presto), but the Hive metastore is pretty crucial. Will Spark support altering nested columns on Hive parquet tables? I'm sure there is something I'm missing here with Spark catalogs, etc. FWIW, we are on Spark 3.1.2 right now. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
