MonkeyCanCode commented on issue #11820: URL: https://github.com/apache/iceberg/issues/11820#issuecomment-2568808355
> > Drop table only remove metadata refs and not the actual data files since 0.14. For actual data file removal, you will need to add `purge` at the end. This is documented in https://iceberg.apache.org/docs/latest/spark-ddl/#drop-table. > > Thank you for your reply. I know about this change, but in fact, spark3.3.3 + iceberg 1.3.1, when using SparkSessionCatalog to execute the drop non-Iceberg table, purge keyword is not required. If this is expected by design , it is acceptable for me. I haven't try this on older version of iceberg runtime. The one I currently using is 1.6.x and drop table without purge won't cleanup datafiles there. I would think that is by designed based on the doc. Wondering if some other bugs is causing data files to get drop in spark3.3.3 + iceberg 1.3.1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
