GitHub user duarten closed a discussion: Avoid re-encoding dictionaries when writing to Parquet
It seems we always [re-encode dictionaries](https://github.com/apache/arrow-rs/blob/main/parquet/src/arrow/arrow_writer/byte_array.rs#L342) when writing row groups to Parquet. Would it make sense to avoid this for cases where all/most dictionary values appear in all row groups? GitHub link: https://github.com/apache/arrow-rs/discussions/8300 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
