Hi Andrew, I am planning to evaluate the impact of FSST and ALP for a sample of Datadog event data.
I was thinking of hacking something with arrow-rs/parquet and Vortex crates. Will make sure to post my findings here Thanks On 2025/10/01 18:11:51 Andrew Lamb wrote: > I would like to start a discussion to help organize and rally anyone > interested in adding new encodings to Parquet. > > I am pretty sure there are many people interested in adding new encodings, > but there are only a few mentions on the mailing list, such as pcode [1] > and FSST/ALP/FastLanes [2]. Prateek mentioned on the sync call today > that he is working on evaluating some potential encodings and hopes to have > some information to share soon, and Julien mentioned he had spoken to > someone else who might be doing something similar. > > Now that Julien has defined a process to extend the spec[3] I think the > steps are much clearer. > > So, I would like to invite anyone interested in adding new encodings to > respond and let us know if you are willing to help evaluate new encodings > and prototype integrations into Parquet implementations? > > Andrew > > > [1]: https://lists.apache.org/thread/bdmfcj4g6y1ccd3mfgrp7d43d73s6zf6 > [2]: https://lists.apache.org/thread/s3o9jk0hr942pv6ono4ymnvvj6pfdsdw > [3]: > https://github.com/apache/parquet-format/blob/master/proposals/README.md >
