zeevm opened a new issue #1270: URL: https://github.com/apache/arrow-rs/issues/1270
Many Parquet query engines have optimizations that rely on Dictionary encoded columns, e.g. for selections with filter. The Rust implementation of the Parquet reader makes it difficult for a reader to read dictionary encoded values because it doesn't expose the RLE decoder to the reader code, so a reader that wishes to work with dictionary values has to re-implement an RLE decoder to read values from dictionary encoded data pages. This can be easily addressed by making the RLE code public outside the crate. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
