laskoviymishka opened a new pull request, #29: URL: https://github.com/apache/iceberg-verification/pull/29
This adds `v2/primitive-types-parquet-data`, a v2 table with one append of one Parquet file holding three rows (typical values, boundaries, all null) across every v1 and v2 primitive type. No existing table checks that a reader decodes boolean, float, decimal, date, time, timestamp, uuid, fixed or binary from Parquet. The trap is in the physical encodings: the three decimal columns are stored as INT32, INT64 and FIXED_LEN_BYTE_ARRAY, and `timestamp` and `timestamptz` differ only in `isAdjustedToUTC`, so a reader that handles one decimal encoding or ignores the zone flag returns different rows. `expected/scan.json` is derived from the README Input. `GenerateTables.java` gains input conversions for the missing types; the existing tables still generate with the same rows, schemas and summaries. The Parquet footer was checked for the expected physical types, and the table was read raw with fastavro and pyarrow and scanned with PyIceberg 0.12.0 and HEAD (33b4ce5), Iceberg Java 1.11.0 and 1.12.0, iceberg-go HEAD (a9e2cc3), and iceberg-rust 0.11.0 and HEAD (eeb1e41), all with the local zone set to Asia/Kolkata. All match `expected/scan.json`. `make check` passes, and the table is 20.4 KB. NaN, the infinities and -0.0 are left out, since the single-value serialization gives the first three no JSON form and a multiset comparison of decoded doubles cannot tell -0.0 from 0.0. They are open questions for the dev list, as is how to write a float whose decimal text does not round-trip through binary32. Part of #10. AI-assisted, reviewed by a human. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
