yadavay-amzn commented on issue #16217:
URL: https://github.com/apache/iceberg/issues/16217#issuecomment-4753509833
Following up on my note above: I reproduced the exact reported sequence
against current main (identity partition field -> ADD PARTITION FIELD -> insert
-> DROP PARTITION FIELD -> DROP COLUMN of the partition source column -> query
the .partitions metadata table -> re-add the column with the same name), and
all three reported failures no longer occur.
They appear to have been fixed after the 1.10.1 release this was filed
against:
- #14089 ("Core: Allow reading metadata table when scanning table with
dropped partition source field", merged 2025-09-17) addresses the .partitions
ValidationException and the rewrite_manifests failure:
BaseMetadataTable.transformSpec now builds the transformed spec with
allowMissingFields, so PartitionSpec compatibility no longer fails when the
source column is gone.
- #15967 ("API: Relax partition name check when source column is dropped",
merged 2026-04-14) addresses the re-add failure: PartitionSpec.Builder skips
the identity-name check when the source field no longer exists, so re-adding a
column with the same name succeeds.
A regression test that drives the full sequence passes on main for format
versions 1-4. 1.10.1 predates both fixes, which is why it reproduces there.
This looks resolved on main and can likely be closed; happy to be corrected if
there is a remaining scenario I am missing.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
