alesk opened a new issue, #6340:
URL: https://github.com/apache/iceberg/issues/6340

   ### Apache Iceberg version
   
   1.1.0 (latest release)
   
   ### Query engine
   
   Spark
   
   ### Please describe the bug 🐞
   
   When deleting a column with Spark SQL using `ALTER TABLE table_name DROP 
COLUMN column_name`, the following happens:
   
   1) The column gets removed from the current schema in the Table's metadata 
on s3. 
   2) A new version of the schema is created in AWS Glue but the column is 
moved to the last position in the table instead of being removed.
   
   The two schemas have diverged. Querying with Spark works as expected but 
using Athena the wrong schema is reported thus breaking tools such as Metabase.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to