slachiewicz opened a new pull request, #27: URL: https://github.com/apache/iceberg-verification/pull/27
Adds `v2/partial-field-ids-parquet-data`: a table with `schema.name-mapping.default` set and one Parquet data file that carries field IDs on its top-level columns and struct fields but not on its list element, map key or map value. It is the companion to #14 for the case the [dev@ thread](https://lists.apache.org/thread/vgxtsjvcfhjq06lcg3mnstp2fyglgzbd) is discussing. Following CONTRIBUTING's "Cases the spec has not settled", the PR holds the input only: no `expected/scan.json` and no `index.json` entry. The table README names the open question and states, as prose, what the [Column Projection](https://iceberg.apache.org/spec/#column-projection) section already fixes. It stays a draft until the thread settles. The first commit lets `GenerateTables.java` set table properties and write a data file with its own schema through parquet-mr, since Iceberg's writer always writes every field ID. Iceberg Java 1.11.0 (`IcebergGenerics`) reads fields 1, 2, 3, 7, 8 and 6 as the README states and fails with "is not in the store" on any projection that includes `tags` or `props`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
