slachiewicz opened a new pull request, #27:
URL: https://github.com/apache/iceberg-verification/pull/27

   Adds `v2/partial-field-ids-parquet-data`: a table with 
`schema.name-mapping.default` set and one Parquet data file that carries field 
IDs on its top-level columns and struct fields but not on its list element, map 
key or map value. It is the companion to #14 for the case the [dev@ 
thread](https://lists.apache.org/thread/vgxtsjvcfhjq06lcg3mnstp2fyglgzbd) is 
discussing.
   
   Following CONTRIBUTING's "Cases the spec has not settled", the PR holds the 
input only: no `expected/scan.json` and no `index.json` entry. The table README 
names the open question and states, as prose, what the [Column 
Projection](https://iceberg.apache.org/spec/#column-projection) section already 
fixes. It stays a draft until the thread settles.
   
   The first commit lets `GenerateTables.java` set table properties and write a 
data file with its own schema through parquet-mr, since Iceberg's writer always 
writes every field ID.
   
   Iceberg Java 1.11.0 (`IcebergGenerics`) reads fields 1, 2, 3, 7, 8 and 6 as 
the README states and fails with "is not in the store" on any projection that 
includes `tags` or `props`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to