This thread is really interesting, thank you for reviving it. I am interested in learning more about additional encodings, especially how they are chosen (I assume academia/industry generate a few new ones ever so often) validated and brought to the community. Please let me know if I can help in any way.
Best Regards, Kurtis C. Wright On Wed, Oct 14, 2026 at 3:00 AM Andrew Lamb <[email protected]> wrote: > There are at least two active threads now that I know of: > * Prateek is working on PFOR (Patched Frame of Reference) > * Aarnav is working on FSST/OnPair / symbol table based string encodings > > > > On Tue, Oct 13, 2026 at 11:16 AM Raz Luvaton <[email protected]> wrote: > > > > > > > On 2025-10-01 18:11 UTC Andrew Lamb wrote: > > > I would like to start a discussion to help organize and rally anyone > > > interested in adding new encodings to Parquet. > > > > > > I am pretty sure there are many people interested in adding new > > encodings, > > > but there are only a few mentions on the mailing list, such as pcode > [1] > > > and FSST/ALP/FastLanes [2]. Prateek mentioned on the sync call today > > > that he is working on evaluating some potential encodings and hopes to > > have > > > some information to share soon, and Julien mentioned he had spoken to > > > someone else who might be doing something similar. > > > > > > Now that Julien has defined a process to extend the spec[3] I think the > > > steps are much clearer. > > > > > > So, I would like to invite anyone interested in adding new encodings to > > > respond and let us know if you are willing to help evaluate new > encodings > > > and prototype integrations into Parquet implementations? > > > > > > Andrew > > > > > > > > > [1]: https://lists.apache.org/thread/bdmfcj4g6y1ccd3mfgrp7d43d73s6zf6 > > > [2]: https://lists.apache.org/thread/s3o9jk0hr942pv6ono4ymnvvj6pfdsdw > > > [3]: > > > > https://github.com/apache/parquet-format/blob/master/proposals/README.md > > > > > > > Should we look at it again? > > >
