diqiu50 opened a new pull request, #11559:
URL: https://github.com/apache/gravitino/pull/11559

   ## What changes were proposed in this pull request?
   
   `GravitinoGlueCatalog` routes Iceberg tables through a separate 
`icebergGlueCatalog` (`SparkCatalog`) whose internal `CachingCatalog` was never 
invalidated after `alterTable/dropTable/purgeTable/renameTable`. This caused 
stale schema reads and `IllegalStateException: Couldn't find <col> in [...]` 
after `ALTER TABLE ADD COLUMNS`.
   
   Fix: change `BaseCatalog` to call `invalidateTable(ident)` via virtual 
dispatch (instead of `sparkCatalog.invalidateTable` directly), then override 
`invalidateTable` in `GravitinoGlueCatalog` to also clear 
`icebergGlueCatalog`'s cache.
   
   ## How was this patch tested?
   
   - Unit tests verifying both catalog backends are invalidated
   - Integration test `testIcebergAlterTableAddColumnCacheInvalidation` 
verified end-to-end against real AWS Glue + S3 (Spark 3.5)
   
   Fixes #11534


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to