Jefffrey commented on PR #10569: URL: https://github.com/apache/arrow-rs/pull/10569#issuecomment-5216324961
is this something we should raise as a question to parquet and/or parquet-java (formerly parquet-mr)? it does seem that this decision stemmed from parquet-mr (as linked in the issue thread, https://github.com/apache/parquet-java/pull/30) and the implementation here followed that (https://github.com/sunchao/parquet-rs/pull/196) i was trying to check the parquet format at version 1.0.0 and was quite confused as my read was nothing prevents fixed len byte arrays from being dictionary encoded either 🤔 - https://github.com/apache/parquet-format/blob/parquet-format-1.0.0/src/thrift/parquet.thrift#L133-L136 - https://github.com/apache/parquet-format/blob/parquet-format-1.0.0/README.md#dictionary-encoding-plain_dictionary--2 - https://parquet.apache.org/docs/file-format/versions/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
