jordepic opened a new issue, #2618: URL: https://github.com/apache/iceberg-rust/issues/2618
### Apache Iceberg Rust version None ### Describe the bug If we write a data file and then evolve our table's schema to add a complex type field like list, map, struct, proceeding to read the data file back will error out. ### To Reproduce 1. Create a table and write a data file (without column xs). 2. Evolve the schema to add xs list<int> (or a map/struct column). 3. Read the table. 4. Reading the older file errors with unexpected target column type List(...). ### Expected behavior A column present in the table schema but absent from a data file is filled with a typed NULL array of the correct (possibly nested) Arrow type via new_null_array, for nested types just as for primitives. The read should succeed with the added column all-NULL for older files. ### Willingness to contribute None -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
