Hey all, I took a stab at implementing support for the new FILE logical type in Hardwood [1]. Using Hardwood's writer, I've created two FILE fixtures for parquet-testing [2], as none seem to exist yet:
- One holds every form of reference the spec defines, one per row, including a checksum per algorithm. - The other covers the group shapes the spec allows: subsets of the children, reordered children, a REQUIRED group, and FILE groups in lists and maps. The FILE implementations in parquet-java (pending, [3]) and arrow-rs (merged, [4]) read both back with the expected values. It's the first time I'm sending a PR against that repo, so I'm not quite sure what the process is. Any feedback would be very welcome. Thanks and all the best, --Gunnar [1] https://github.com/hardwood-hq/hardwood/pull/1494 [2] https://github.com/apache/parquet-testing/pull/128 [3] https://github.com/apache/parquet-java/pull/3608 [4] https://github.com/apache/arrow-rs/pull/10109
