VABVAT opened a new pull request, #2788: URL: https://github.com/apache/iceberg-rust/pull/2788
## Which issue does this PR close? - Closes #2749 ## What changes are included in this PR? This PR updates Glue schema conversion so AWS Glue `StorageDescriptor.columns` is populated only from the current Iceberg schema. Previously, `GlueSchemaBuilder::from_iceberg` converted the current schema and then also converted historical schemas from table metadata. Those historical fields were written to Glue with `iceberg.field.current=false`, but Glue does not use that parameter to filter visible columns, which could cause duplicate columns to appear in the Glue Console after schema evolution. Historical schemas are still preserved in Iceberg table metadata. This change only prevents them from being projected into Glue's visible column list. ## Are these changes tested? Yes. Added a regression test covering schema evolution with historical schemas, and verified the Glue schema output contains only current schema fields. Ran locally: ```shell cargo test -p iceberg-catalog-glue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
