There are at least two active threads now that I know of: * Prateek is working on PFOR (Patched Frame of Reference) * Aarnav is working on FSST/OnPair / symbol table based string encodings
On Tue, Oct 13, 2026 at 11:16 AM Raz Luvaton <[email protected]> wrote: > > > On 2025-10-01 18:11 UTC Andrew Lamb wrote: > > I would like to start a discussion to help organize and rally anyone > > interested in adding new encodings to Parquet. > > > > I am pretty sure there are many people interested in adding new > encodings, > > but there are only a few mentions on the mailing list, such as pcode [1] > > and FSST/ALP/FastLanes [2]. Prateek mentioned on the sync call today > > that he is working on evaluating some potential encodings and hopes to > have > > some information to share soon, and Julien mentioned he had spoken to > > someone else who might be doing something similar. > > > > Now that Julien has defined a process to extend the spec[3] I think the > > steps are much clearer. > > > > So, I would like to invite anyone interested in adding new encodings to > > respond and let us know if you are willing to help evaluate new encodings > > and prototype integrations into Parquet implementations? > > > > Andrew > > > > > > [1]: https://lists.apache.org/thread/bdmfcj4g6y1ccd3mfgrp7d43d73s6zf6 > > [2]: https://lists.apache.org/thread/s3o9jk0hr942pv6ono4ymnvvj6pfdsdw > > [3]: > > https://github.com/apache/parquet-format/blob/master/proposals/README.md > > > > Should we look at it again? >
