laskoviymishka opened a new pull request, #29:
URL: https://github.com/apache/iceberg-verification/pull/29

   This adds `v2/primitive-types-parquet-data`, a v2 table with one append of 
one Parquet file holding three rows (typical values, boundaries, all null) 
across every v1 and v2 primitive type. No existing table checks that a reader 
decodes boolean, float, decimal, date, time, timestamp, uuid, fixed or binary 
from Parquet. The trap is in the physical encodings: the three decimal columns 
are stored as INT32, INT64 and FIXED_LEN_BYTE_ARRAY, and `timestamp` and 
`timestamptz` differ only in `isAdjustedToUTC`, so a reader that handles one 
decimal encoding or ignores the zone flag returns different rows. 
`expected/scan.json` is derived from the README Input. `GenerateTables.java` 
gains input conversions for the missing types; the existing tables still 
generate with the same rows, schemas and summaries.
   
   The Parquet footer was checked for the expected physical types, and the 
table was read raw with fastavro and pyarrow and scanned with PyIceberg 0.12.0 
and HEAD (33b4ce5), Iceberg Java 1.11.0 and 1.12.0, iceberg-go HEAD (a9e2cc3), 
and iceberg-rust 0.11.0 and HEAD (eeb1e41), all with the local zone set to 
Asia/Kolkata. All match `expected/scan.json`. `make check` passes, and the 
table is 20.4 KB.
   
   NaN, the infinities and -0.0 are left out, since the single-value 
serialization gives the first three no JSON form and a multiset comparison of 
decoded doubles cannot tell -0.0 from 0.0. They are open questions for the dev 
list, as is how to write a float whose decimal text does not round-trip through 
binary32.
   
   Part of #10.
   
   AI-assisted, reviewed by a human.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to