Great work everyone! This looks awesome. Thanks, Vinoo Ganesh | [email protected]
<[email protected]> On Tue, Sep 22, 2026 at 12:30 PM PRATEEK GAUR <[email protected]> wrote: > Thanks Andrew, > > > This is looking great! > > > On Tue, Sep 22, 2026, 4:06 AM Andrew Lamb <[email protected]> wrote: > > > I am happy to report the blog is now published to the Parquet website: > > > > https://parquet.apache.org/blog/2026/09/22/alp-adaptive-loss > less-floating-point-encoding-in-apache-parquet/ > > > > On Fri, Sep 18, 2026 at 2:22 PM Andrew Lamb <[email protected]> > > wrote: > > > > > Now that we have completed the 2.14 release of Parquet, we are ready to > > > publish the ALP blog. > > > > > > I spent a little more time today ~obsessing~ editing, and I think it is > > > ready. If anyone else would like to review, please let us know > otherwise > > > I hope to publish it early next week > > > > > > You can find a rendered preview here: > > > > > https://alamb.github.io/parquet-site/blog/2026/09/18/alp- > adaptive-lossless-floating-point-encoding-in-apache-parquet/ > > > > > > The PR is here: https://github.com/apache/parquet-site/pull/195 > > > > > > > > > Andrew > > > > > > p.s. For anyone who reviewed previous versions, the major changes are > > > acknowledgements section and I updated the ecosystem adoption text (I > > > copy/pasted the current wording below for your convenience) > > > > > > ----- > > > > > > Acknowledgements > > > ALP was first published in a SIGMOD 2024 paper by Azim Afroozeh, > Leonardo > > > Kuffó, and Peter Boncz from the Database Architectures Group at CWI. > The > > > Vortex and Lance formats adopted ALP early, demonstrating its benefits > in > > > industrial applications. In late 2025, the community began the > > > standardization process. Along with the authors of this blog, many > > > community members contributed, including Divjot Arora, Arnav Balyan, > > Devan > > > Benz, Ryan Blue, Alkis Evlogimenos, Vinoo Ganesh, Adrian Garcia > > Badaracco, > > > Curt Hagenlocher, Amogh Jahagirdar, Micah Kornfield, Robert Kruszewski, > > > Julien Le Dem, Kevin Liu, Steve Loughran, Ismaël Mejía, mwish, Antoine > > > Pitrou, Adam Reeve, Ed Seidl, Russell Spitzer, Matt Topol, Jeffrey Vo, > > > Daniel Weeks, Gang Wu, and Zehua Zou. > > > > > > Ecosystem Adoption > > > The encoding was released as part of parquet-format 2.14.0 in September > > > 2026. ALP is already supported in at least one major open source > > > implementation (the parquet 60.0.0 Rust crate), and we expect other > > Parquet > > > implementations to add support in the coming months. Please check the > > > Implementation Status page for the current state of support. You can > also > > > try it today on your own datasets using the tool in the ALP benchmark > > > repository. > > > > > > > > > On Sat, Aug 29, 2026 at 8:22 AM Andrew Lamb <[email protected]> > > > wrote: > > > > > >> An update here: we have added the BYTE_STREAM_SPLIT + ZSTD > > >> > > >> Also, thank you to Arnav, Russell and Jigao for their comments > > >> > > >> Again, if anyone would like to review the current draft it is at [1] > and > > >> a rendered preview is at [2]. > > >> > > >> Andrew > > >> > > >> > > >> [1]: https://github.com/apache/parquet-site/pull/195 > > >> [2]: > > >> > > https://alamb.github.io/parquet-site/blog/2026/08/14/alp- > adaptive-lossless-floating-point-encoding-in-apache-parquet/ > > >> > > >> > > >> On Tue, Aug 25, 2026 at 1:34 PM Andrew Lamb <[email protected]> > > >> wrote: > > >> > > >>> Thanks Antoine, > > >>> > > >>> I will work with Kosta to update the numbers for the post. In the > > >>> interim, in case anyone is interested, you can see early results > > here[1]. > > >>> Spoiler is that BYTE_STREAM_SPLIT + ZSTD > > >>> * Gets the best average compression ratio > > >>> * Same average compression speed as PLAIN+ZSTD (both about 2x faster > > >>> than ALP) > > >>> * An order of magnitude slower for decompression and random lookup > than > > >>> ALP > > >>> > > >>> Andrew > > >>> > > >>> [1]: https://github.com/alamb/alp_benchmark/issues/3 > > >>> > > >>> On Tue, Aug 25, 2026 at 4:44 AM Antoine Pitrou <[email protected]> > > >>> wrote: > > >>> > > >>>> > > >>>> It would be nice if the post included BYTE_STREAM_SPLIT + ZSTD in > the > > >>>> benchmark comparisons. > > >>>> > > >>>> Regards > > >>>> > > >>>> Antoine. > > >>>> > > >>>> > > >>>> Le 23/08/2026 à 17:17, PRATEEK GAUR a écrit : > > >>>> > Enjoyed working with Kosta and Andrew on this. > > >>>> > > > >>>> > I was waiting for the email to show up in my inbox after Kosta > sent > > >>>> it. > > >>>> > > > >>>> > But then realized this might have gone to spam. > > >>>> > Hoping replying to the email thread will pull it out of spam for > > >>>> others. > > >>>> > > > >>>> > Best > > >>>> > Prateek > > >>>> > > > >>>> > On Sat, Aug 22, 2026 at 9:22 AM Kosta Tarasov < > > >>>> [email protected]> > > >>>> > wrote: > > >>>> > > > >>>> >> Hi everyone, > > >>>> >> > > >>>> >> Andrew, Prateek, and I have been working on the ALP blog[1] and > we > > >>>> think > > >>>> >> it's ready for review/comment. > > >>>> >> > > >>>> >> The blog covers the motivation for ALP, performance results, a > > >>>> technical > > >>>> >> overview, and ecosystem adoption. > > >>>> >> > > >>>> >> A rendered preview is available[2]. > > >>>> >> > > >>>> >> Thanks, > > >>>> >> Kosta > > >>>> >> > > >>>> >> [1]: https://github.com/apache/parquet-site/pull/195 > > >>>> >> > > >>>> >> [2]: > > >>>> >> > > >>>> > > https://alamb.github.io/parquet-site/blog/2026/08/14/alp- > adaptive-lossless-floating-point-encoding-in-apache-parquet/ > > >>>> >> > > >>>> > > > >>>> > > >>>> > > >>>> > > >
