manuzhang commented on code in PR #19037: URL: https://github.com/apache/iceberg/pull/19037#discussion_r4644465735
########## format/spec.md: ########## @@ -453,10 +453,12 @@ Struct evolution requires the following rules for default values: Columns in Iceberg data files are selected by field id. The table schema's column names and order may change after a data file is written, and projection must be done using field ids. -Values for field ids which are not present in a data file must be resolved according the following rules: +Before projection, readers must check the full file schema for field IDs at any depth. If any are present, readers must use stored IDs and treat fields without IDs, lists missing an element ID, and maps missing a key or value ID as absent. Review Comment: IIUC, that will be a new use case and this PR is to clarify the original design. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
