wgtmac commented on PR #36955: URL: https://github.com/apache/arrow/pull/36955#issuecomment-1699475241
Yes. The current implementation is supposed to do this. IMO, a parquet v2 file can be any of the following: - applied data page v2 - applied any v2 feature: delta encoding, LZ4_RAW codec, etc. > It seems that if user has enabled ParquetDataPageVersion::V2, then the ParquetVersion should not be set to PARQUET_1_0. With all the above assumptions, this patch simply checks the parquet version and ignore the data page version. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
