The Java implementation was just merged[1]!

Thank you Gang, Vinoo, Prateek and everyone who helped push that one along

Andrew

[1]: https://github.com/apache/parquet-java/pull/3397#event-35545451335

On Tue, Oct 13, 2026 at 12:52 PM PRATEEK GAUR <[email protected]> wrote:

> Hi team,
>
> Quick update re: the C++ implementation.
> Thanks to all the reviewers, we merged the C++ implementation today.
> There are a few follow-up items that I'll address in a subsequent PR.
>
> Thanks
> Prateek
>
> On Sun, Sep 13, 2026 at 6:54 PM Vinoo Ganesh <[email protected]>
> wrote:
>
> > Quick update re: the Java impl. Thanks for the feedback, on
> > https://github.com/apache/parquet-java/pull/3397, Russel! I pulled
> > https://github.com/apache/parquet-java/pull/3791 into its own PR (thanks
> > for the quick approval too, Gang). Assuming no objections, I think we can
> > merge #3791, and then go ahead of #3397.
> >
> > Thanks,
> > Vinoo Ganesh | [email protected]
> >
> > <[email protected]>
> >
> >
> > On Tue, Sep 8, 2026 at 10:54 AM PRATEEK GAUR <[email protected]> wrote:
> >
> > > [Rust] Awesome thanks Andrew, Kostas and Devin.
> > > [Java] Thanks Gang for the feedback on Java PR.
> > > [C++] Thanks Gang for another round of feedback on the C++ one.
> > > [Go] Arnav and I will be working on the golang impl this week.
> > >
> > > This is great progress all around.
> > >
> > > On Sat, Sep 5, 2026 at 1:26 PM Vinoo Ganesh <[email protected]>
> > > wrote:
> > >
> > > > Thanks all - I'm addressing Gang's comments on
> > > > https://github.com/apache/parquet-java/pull/3397 now, so hopefully
> > well
> > > > also be in a good state for merging the java implementation soon.
> > > >
> > > > Thanks,
> > > > Vinoo Ganesh | [email protected]
> > > >
> > > > <[email protected]>
> > > >
> > > >
> > > > On Sat, Sep 5, 2026 at 8:56 AM Andrew Lamb <[email protected]>
> > > wrote:
> > > >
> > > > > We just merged the Rust implementation[1] from Kosta and Devan.
> With
> > > the
> > > > > imminent release of Parquet Format 2.14.0 I think we'll be well on
> > our
> > > > way.
> > > > >
> > > > > Thanks again for pushing this along,
> > > > > Andrew
> > > > >
> > > > > [1]: https://github.com/apache/arrow-rs/pull/9372
> > > > >
> > > > > On Fri, Sep 4, 2026 at 5:42 PM PRATEEK GAUR <[email protected]>
> > > wrote:
> > > > >
> > > > > > Hi team,
> > > > > >
> > > > > > Thanks Micah for multiple rounds of review and thanks Gang for
> > > taking a
> > > > > > look at the PR and giving feedback. I've addressed all comments
> in
> > > the
> > > > > PR.
> > > > > > Looking forward to the next round of feedback (or approval).
> Would
> > > like
> > > > > to
> > > > > > get it in soon.
> > > > > >
> > > > > > https://github.com/apache/arrow/pull/48345/changes
> > > > > >
> > > > > > With this done and after talking to Arnav, I plan to spend some
> > time
> > > on
> > > > > the
> > > > > > ALP implementation in the arrow-go repository helping spread the
> > > > support
> > > > > to
> > > > > > more languages.
> > > > > >
> > > > > > Best
> > > > > > Prateek
> > > > > >
> > > > > > On Sun, Aug 2, 2026 at 10:42 PM PRATEEK GAUR <[email protected]
> >
> > > > wrote:
> > > > > >
> > > > > > > Thanks Divjot for bringing it up.
> > > > > > >
> > > > > > > I was under the same impression as Russell and Andrew that we'd
> > > have
> > > > it
> > > > > > > flag gated.
> > > > > > > With the new versioning proposal 'preview' might be a good tag
> > for
> > > > it.
> > > > > > >
> > > > > > > Best
> > > > > > > Prateek
> > > > > > >
> > > > > > > On Sat, Aug 1, 2026 at 12:39 AM Andrew Lamb <
> > > [email protected]>
> > > > > > > wrote:
> > > > > > >
> > > > > > >> Div: Here is a proposal to mark ALP in Preview: [1] (using a
> > > comment
> > > > > in
> > > > > > >> the
> > > > > > >> spec section).
> > > > > > >>
> > > > > > >> Russel: That is my understanding as well.
> > > > > > >>
> > > > > > >> Hopefully we are able to formalize the versioning process
> > shortly
> > > so
> > > > > we
> > > > > > >> can
> > > > > > >> formalize the notion of "preview"
> > > > > > >>
> > > > > > >> Andrew
> > > > > > >>
> > > > > > >>
> > > > > > >> [1]: https://github.com/apache/parquet-format/pull/604
> > > > > > >>
> > > > > > >> On Fri, Jul 31, 2026 at 11:15 AM Russell Spitzer <
> > > > > > >> [email protected]>
> > > > > > >> wrote:
> > > > > > >>
> > > > > > >> > I thought we had agreed it would be merged, and features
> like
> > > this
> > > > > > would
> > > > > > >> > be feature flag gated. So a V-Old writer could always opt in
> > to
> > > > > using
> > > > > > >> this
> > > > > > >> > encoding but that must be a conscious effort if you are not
> > > using
> > > > > > VNext
> > > > > > >> of
> > > > > > >> > Parquet. If you are on V-Next the writer can choose to use
> ALP
> > > > > > whenever
> > > > > > >> it
> > > > > > >> > likes without user intervention.
> > > > > > >> >
> > > > > > >> > On Fri, Jul 31, 2026 at 2:20 AM Divjot Arora via dev <
> > > > > > >> > [email protected]> wrote:
> > > > > > >> >
> > > > > > >> >> Yes, that’s my understanding as well. However, as you
> noted,
> > > the
> > > > > > >> >> versioning
> > > > > > >> >> discussion is still in early stages and hasn’t prescribed
> > > > concrete
> > > > > > >> >> mechanisms yet. If ALP goes into parquet-format 2.14.0,
> > there’s
> > > > no
> > > > > > >> >> indication that it’s in preview or that writers shouldn’t
> use
> > > it
> > > > by
> > > > > > >> >> default
> > > > > > >> >> yet. Given that we’ve held off on merging other
> incompatible
> > > > > changes
> > > > > > >> (e.g
> > > > > > >> >> removal of path_in_schema) until the versioning discussion
> > > > closes,
> > > > > my
> > > > > > >> >> preference would be to leave ALP un-merged for the time
> being
> > > as
> > > > > > well.
> > > > > > >> >>
> > > > > > >> >> — Div
> > > > > > >> >>
> > > > > > >> >> On Fri, Jul 31, 2026 at 08:59 Andrew Lamb <
> > > > [email protected]>
> > > > > > >> wrote:
> > > > > > >> >>
> > > > > > >> >> > After re-reading Julien's Versioning Proposal, my
> > > understanding
> > > > > is
> > > > > > >> that
> > > > > > >> >> if
> > > > > > >> >> > we adopt that system, we will somehow mark ALP in
> "Preview"
> > > in
> > > > > > >> >> > parquet-format for release Version 3.
> > > > > > >> >> >
> > > > > > >> >> > The versioning document doesn't seem to proscribe the
> > > > particular
> > > > > > >> method
> > > > > > >> >> > for annotating "preview" features -- I think clearly
> > marking
> > > > them
> > > > > > as
> > > > > > >> >> such
> > > > > > >> >> > in parquet.thrift as well as reflecting that on the
> > > > > > >> >> > https://parquet.apache.org/docs/file-format/versions/
> page
> > > > > somehow
> > > > > > >> >> would
> > > > > > >> >> > be adequate.
> > > > > > >> >> >
> > > > > > >> >> > Andrew
> > > > > > >> >> >
> > > > > > >> >> > On Thu, Jul 30, 2026 at 11:50 AM Andrew Lamb <
> > > > > > [email protected]
> > > > > > >> >
> > > > > > >> >> > wrote:
> > > > > > >> >> >
> > > > > > >> >> >> In my mind ALP is in the same position as other
> encodings
> > > that
> > > > > > were
> > > > > > >> >> added
> > > > > > >> >> >> recently[1] (such as BYTE_STREAM_SPLIT for non floating
> > > point
> > > > > > types)
> > > > > > >> >> >>
> > > > > > >> >> >> That is to say it will be available in the latest open
> > > source
> > > > > > >> writers
> > > > > > >> >> and
> > > > > > >> >> >> readers, but realistically not widely used in the
> > ecosystem
> > > > > where
> > > > > > >> >> >> compatibility is a concern (a large part)
> > > > > > >> >> >>
> > > > > > >> >> >> I view Julian's work[2][3] to gather consensus on how to
> > > name
> > > > > > >> >> >> combinations of features (e.g. "versions") as the
> > mechanism
> > > by
> > > > > > >> which we
> > > > > > >> >> >> will accelerate the adoption of this change (along with
> > > other
> > > > > > >> forward
> > > > > > >> >> >> incompatible changes) across the ecosystem.
> > > > > > >> >> >>
> > > > > > >> >> >> > Will we exclude this change when cutting
> parquet-format
> > > > > v2.14.0?
> > > > > > >> >> >>
> > > > > > >> >> >> No I don't think so -- I would expect it to go out in
> the
> > > next
> > > > > > >> >> >> parquet-format version as do other changes in the spec.
> > > > > > >> >> >>
> > > > > > >> >> >> Andrew
> > > > > > >> >> >>
> > > > > > >> >> >> [1]:
> > https://parquet.apache.org/docs/file-format/versions/
> > > > > > >> >> >> [2]:
> > > > > > >>
> > https://lists.apache.org/thread/xmnj8h0h8ozmrgox5tydhhs7yz7q2hss
> > > > > > >> >> >> [3]:
> > > > > > >>
> > https://lists.apache.org/thread/qlf8lg90gqq41lllyy9mk2f0skqvftqj
> > > > > > >> >> >>
> > > > > > >> >> >>
> > > > > > >> >> >> On Thu, Jul 30, 2026 at 3:51 AM Divjot Arora via dev <
> > > > > > >> >> >> [email protected]> wrote:
> > > > > > >> >> >>
> > > > > > >> >> >>> Hi Andrew,
> > > > > > >> >> >>>
> > > > > > >> >> >>> How does this interact with the ongoing versioning
> > > > discussion?
> > > > > > >> Given
> > > > > > >> >> that
> > > > > > >> >> >>> new encodings are not forward compatible, I would
> assume
> > > ALP
> > > > is
> > > > > > >> >> included
> > > > > > >> >> >>> in
> > > > > > >> >> >>> Parquet V<next> (V3?), but it's not clear to me how
> that
> > > > works
> > > > > if
> > > > > > >> it's
> > > > > > >> >> >>> merged to the parquet-format master branch now. Will we
> > > > exclude
> > > > > > >> this
> > > > > > >> >> >>> change
> > > > > > >> >> >>> when cutting parquet-format v2.14.0?
> > > > > > >> >> >>>
> > > > > > >> >> >>> -- Div
> > > > > > >> >> >>>
> > > > > > >> >> >>> On Thu, Jul 30, 2026 at 8:51 AM Andrew Lamb <
> > > > > > >> [email protected]>
> > > > > > >> >> >>> wrote:
> > > > > > >> >> >>>
> > > > > > >> >> >>> > Hello,
> > > > > > >> >> >>> >
> > > > > > >> >> >>> > As an update, thanks to the epic work from many
> > > > contributors,
> > > > > > >> >> >>> especially
> > > > > > >> >> >>> > Prateek, I just merged the parquet-format change for
> > > > ALP[1].
> > > > > We
> > > > > > >> >> plan to
> > > > > > >> >> >>> > make additional editorial The remaining items I know
> of
> > > are
> > > > > > >> merging
> > > > > > >> >> the
> > > > > > >> >> >>> > examples from parquet-testing[2], and then of course
> > the
> > > > > > various
> > > > > > >> >> >>> > implementations
> > > > > > >> >> >>> >
> > > > > > >> >> >>> > Thanks again everyone. This is a great step forward
> > > > > > >> >> >>> > Andrew
> > > > > > >> >> >>> >
> > > > > > >> >> >>> > [1]:
> https://github.com/apache/parquet-format/pull/557
> > > > > > >> >> >>> > [2]:
> > https://github.com/apache/parquet-testing/pull/100
> > > > > > >> >> >>> >
> > > > > > >> >> >>> > On Tue, Jul 21, 2026 at 4:39 PM Julien Le Dem <
> > > > > > [email protected]
> > > > > > >> >
> > > > > > >> >> >>> wrote:
> > > > > > >> >> >>> >
> > > > > > >> >> >>> > > It was also in my spam folder... :(
> > > > > > >> >> >>> > > I've seen a bunch of apache list emails go to my
> spam
> > > > > > recently.
> > > > > > >> >> >>> > >
> > > > > > >> >> >>> > > On Tue, Jul 21, 2026 at 10:58 AM Russell Spitzer <
> > > > > > >> >> >>> > > [email protected]>
> > > > > > >> >> >>> > > wrote:
> > > > > > >> >> >>> > >
> > > > > > >> >> >>> > > > Yes, my hope was that my vote would kick it out
> of
> > > spam
> > > > > but
> > > > > > >> we
> > > > > > >> >> >>> > definitely
> > > > > > >> >> >>> > > > had two other votes that also went to spam for
> me.
> > > > > > >> >> >>> > > >
> > > > > > >> >> >>> > > > For anyone looking the thread is here
> > > > > > >> >> >>> > > >
> > > > > > >> >>
> > > https://lists.apache.org/thread/hgmd58wrv9yoopcrf61m1bg211l65tbt
> > > > > > >> >> >>> > > >
> > > > > > >> >> >>> > > > On Tue, Jul 21, 2026 at 10:57 AM Micah Kornfield
> <
> > > > > > >> >> >>> > [email protected]>
> > > > > > >> >> >>> > > > wrote:
> > > > > > >> >> >>> > > >
> > > > > > >> >> >>> > > > > I've seen other's votes not go to spam, so
> > > hopefully
> > > > > > people
> > > > > > >> >> will
> > > > > > >> >> >>> see
> > > > > > >> >> >>> > it
> > > > > > >> >> >>> > > > in
> > > > > > >> >> >>> > > > > there inboxes (or see this thread and look in
> > there
> > > > > > spam).
> > > > > > >> >> >>> > > > >
> > > > > > >> >> >>> > > > > On Tue, Jul 21, 2026 at 10:52 AM PRATEEK GAUR <
> > > > > > >> >> >>> [email protected]>
> > > > > > >> >> >>> > > > wrote:
> > > > > > >> >> >>> > > > >
> > > > > > >> >> >>> > > > > > Okay,
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > > > I sent out the voting email yesterday and so
> > far
> > > > I've
> > > > > > >> heard
> > > > > > >> >> >>> from 3
> > > > > > >> >> >>> > > > people
> > > > > > >> >> >>> > > > > > that it ended up in their "spam folder". Dev
> > VPN
> > > to
> > > > > be
> > > > > > >> >> blamed
> > > > > > >> >> >>> for
> > > > > > >> >> >>> > > it?.
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > > > What's the protocol here?
> > > > > > >> >> >>> > > > > > I let people hunt for the email in their spam
> > > > folder
> > > > > or
> > > > > > >> send
> > > > > > >> >> >>> out
> > > > > > >> >> >>> > > > another
> > > > > > >> >> >>> > > > > > one?
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > > > Best
> > > > > > >> >> >>> > > > > > Prateek
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > > > On Sun, Jul 19, 2026 at 10:47 PM PRATEEK
> GAUR <
> > > > > > >> >> >>> [email protected]>
> > > > > > >> >> >>> > > > > wrote:
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > > > > Hi team,
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > Vinoo has added the tests which were
> > requested
> > > in
> > > > > the
> > > > > > >> last
> > > > > > >> >> >>> round
> > > > > > >> >> >>> > of
> > > > > > >> >> >>> > > > > > review.
> > > > > > >> >> >>> > > > > > > In his own words.
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > "
> > > > > > >> >> >>> > > > > > > The extreme value tests Micah wanted are
> done
> > > and
> > > > > > >> pushed.
> > > > > > >> >> I
> > > > > > >> >> >>> added
> > > > > > >> >> >>> > > > > > coverage
> > > > > > >> >> >>> > > > > > > for values that need the full FOR bit width
> > > after
> > > > > the
> > > > > > >> >> frame
> > > > > > >> >> >>> of
> > > > > > >> >> >>> > > > > reference
> > > > > > >> >> >>> > > > > > is
> > > > > > >> >> >>> > > > > > > applied: 64-bit (the case where the signed
> > max
> > > > > minus
> > > > > > >> min
> > > > > > >> >> >>> > > subtraction
> > > > > > >> >> >>> > > > > > > overflows), 63-bit (the non-overflow case),
> > and
> > > > > > 32-bit
> > > > > > >> for
> > > > > > >> >> >>> > floats.
> > > > > > >> >> >>> > > > All
> > > > > > >> >> >>> > > > > > > lossless with zero exceptions. I also
> > verified
> > > > them
> > > > > > >> >> through
> > > > > > >> >> >>> Arrow
> > > > > > >> >> >>> > > C++
> > > > > > >> >> >>> > > > > ALP
> > > > > > >> >> >>> > > > > > > reader (the local build), so the
> Java-written
> > > > > extreme
> > > > > > >> >> columns
> > > > > > >> >> >>> > > decode
> > > > > > >> >> >>> > > > > > > correctly in C++, bit-exact against the
> > > expected
> > > > > > >> values."
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > State of the PR (#3397):
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > >    - Merges cleanly with master (I pulled
> > > master
> > > > in
> > > > > > and
> > > > > > >> >> >>> resolved
> > > > > > >> >> >>> > > the
> > > > > > >> >> >>> > > > > > >    conflicts).
> > > > > > >> >> >>> > > > > > >    - 41 of 44 review threads resolved. The
> 3
> > > > > > remaining
> > > > > > >> are
> > > > > > >> >> >>> > > > intentional:
> > > > > > >> >> >>> > > > > > >    one deferred perf nit, one that stays
> open
> > > > until
> > > > > > >> >> >>> > parquet-format
> > > > > > >> >> >>> > > > > ships
> > > > > > >> >> >>> > > > > > ALP,
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > "
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > With this both the
> > > > > > >> >> >>> > > > > > > 1) C++ PR :
> > > > > > >> >> >>> https://github.com/apache/arrow/pull/48345/changes
> > > > > > >> >> >>> > > > > > > 2) Java PR :
> > > > > > >> >> >>> https://github.com/apache/parquet-java/pull/3397
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > Are cross language tested and range of test
> > > > > > scenarios.
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > Best
> > > > > > >> >> >>> > > > > > > Prateek
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > > On Mon, Jul 13, 2026 at 8:38 AM PRATEEK
> GAUR
> > <
> > > > > > >> >> >>> [email protected]
> > > > > > >> >> >>> > >
> > > > > > >> >> >>> > > > > wrote:
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > >> Thanks Matt,
> > > > > > >> >> >>> > > > > > >>
> > > > > > >> >> >>> > > > > > >> I'll be on it this week.
> > > > > > >> >> >>> > > > > > >>
> > > > > > >> >> >>> > > > > > >> Best
> > > > > > >> >> >>> > > > > > >> Prateek
> > > > > > >> >> >>> > > > > > >>
> > > > > > >> >> >>> > > > > > >> On Mon, Jul 13, 2026 at 8:36 AM Matt
> Topol <
> > > > > > >> >> >>> > > [email protected]>
> > > > > > >> >> >>> > > > > > >> wrote:
> > > > > > >> >> >>> > > > > > >>
> > > > > > >> >> >>> > > > > > >>> There is also the Go implementation
> > submitted
> > > > by
> > > > > > >> Arnav (
> > > > > > >> >> >>> > > > > > >>>
> > https://github.com/apache/arrow-go/pull/704)
> > > > > which
> > > > > > >> is
> > > > > > >> >> >>> waiting
> > > > > > >> >> >>> > > for
> > > > > > >> >> >>> > > > > > >>> updates.
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>> > > > > > >>> Just wanted to make sure it didn't get
> lost
> > > > here.
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>> > > > > > >>> --Matt
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>> > > > > > >>> On Mon, Jul 13, 2026 at 11:30 AM PRATEEK
> > > GAUR <
> > > > > > >> >> >>> > > [email protected]>
> > > > > > >> >> >>> > > > > > >>> wrote:
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>> > > > > > >>> > Hi all,
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > I'd like to share a status update on
> the
> > > ALP
> > > > > > >> encoding
> > > > > > >> >> >>> effort
> > > > > > >> >> >>> > > and
> > > > > > >> >> >>> > > > > get
> > > > > > >> >> >>> > > > > > a
> > > > > > >> >> >>> > > > > > >>> feel
> > > > > > >> >> >>> > > > > > >>> > from the community before starting a
> > formal
> > > > > vote.
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > We now have the specification plus
> > > > > > implementations
> > > > > > >> in
> > > > > > >> >> >>> both
> > > > > > >> >> >>> > > > > languages:
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> >     - Spec:
> > > >  apache/parquet-format#557 —
> > > > > > >> GH-533
> > > > > > >> >> >>> Add
> > > > > > >> >> >>> > ALP
> > > > > > >> >> >>> > > > > > encoding
> > > > > > >> >> >>> > > > > > >>> > specification
> > > > > > >> >> >>> > > > > > >>> >     - C++ (Arrow):  apache/arrow#48345
> —
> > > > > GH-48701
> > > > > > >> >> >>> > > [C++][Parquet]
> > > > > > >> >> >>> > > > > Add
> > > > > > >> >> >>> > > > > > >>> ALPpd
> > > > > > >> >> >>> > > > > > >>> > encoding
> > > > > > >> >> >>> > > > > > >>> >     - Java:
> > >  apache/parquet-java#3397
> > > > —
> > > > > > >> Parquet
> > > > > > >> >> >>> Java
> > > > > > >> >> >>> > ALP
> > > > > > >> >> >>> > > > > > >>> > Implementation (by Vinoo)
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > Current state:
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> >     - The C++ implementation has been
> > > through
> > > > > 3-4
> > > > > > >> >> rounds
> > > > > > >> >> >>> of
> > > > > > >> >> >>> > > > review.
> > > > > > >> >> >>> > > > > > >>> >     - The Java implementation has been
> > > > tracking
> > > > > > >> well
> > > > > > >> >> and
> > > > > > >> >> >>> has
> > > > > > >> >> >>> > > had
> > > > > > >> >> >>> > > > > > >>> initial
> > > > > > >> >> >>> > > > > > >>> >       reviews from contributors, with
> no
> > > > major
> > > > > > >> >> remaining
> > > > > > >> >> >>> > > issues.
> > > > > > >> >> >>> > > > > > >>> >     - Cross-language compatibility
> tests
> > > are
> > > > > > >> passing:
> > > > > > >> >> the
> > > > > > >> >> >>> > Arrow
> > > > > > >> >> >>> > > > C++
> > > > > > >> >> >>> > > > > > >>> decoder
> > > > > > >> >> >>> > > > > > >>> >       reads Java-written data
> bit-exactly
> > > > > across
> > > > > > >> >> ~1.56M
> > > > > > >> >> >>> > values
> > > > > > >> >> >>> > > > and
> > > > > > >> >> >>> > > > > 18
> > > > > > >> >> >>> > > > > > >>> >       fixtures, covering V1 and V2
> pages,
> > > > > > multiple
> > > > > > >> >> vector
> > > > > > >> >> >>> > > sizes,
> > > > > > >> >> >>> > > > > and
> > > > > > >> >> >>> > > > > > >>> > several
> > > > > > >> >> >>> > > > > > >>> >       real datasets — zero mismatches.
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> >  As raised in the java-pr we will be
> > adding
> > > > > > >> coverage
> > > > > > >> >> for
> > > > > > >> >> >>> > > extreme
> > > > > > >> >> >>> > > > > > values
> > > > > > >> >> >>> > > > > > >>> > (those requiring
> > > > > > >> >> >>> > > > > > >>> >  63-64 bits after FOR is applied)
> before
> > we
> > > > > > close a
> > > > > > >> >> vote.
> > > > > > >> >> >>> > We'll
> > > > > > >> >> >>> > > > aim
> > > > > > >> >> >>> > > > > > to
> > > > > > >> >> >>> > > > > > >>> get
> > > > > > >> >> >>> > > > > > >>> > that
> > > > > > >> >> >>> > > > > > >>> >  done in parallel.
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > Plan: unless there are objections, I
> > intend
> > > > to
> > > > > > >> start a
> > > > > > >> >> >>> vote
> > > > > > >> >> >>> > at
> > > > > > >> >> >>> > > > the
> > > > > > >> >> >>> > > > > > end
> > > > > > >> >> >>> > > > > > >>> of
> > > > > > >> >> >>> > > > > > >>> > this week/early
> > > > > > >> >> >>> > > > > > >>> > next week.
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > Thanks
> > > > > > >> >> >>> > > > > > >>> > Prateek
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > On Wed, Jul 1, 2026 at 8:50 AM PRATEEK
> > > GAUR <
> > > > > > >> >> >>> > > [email protected]>
> > > > > > >> >> >>> > > > > > >>> wrote:
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>> > > Hi Team,
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> > > Just wanted to provide some updates
> on
> > > ALP.
> > > > > > >> >> >>> > > > > > >>> > > Micah and I have done 3-4 rounds of
> > > review
> > > > > for
> > > > > > >> the
> > > > > > >> >> c++
> > > > > > >> >> >>> PR :
> > > > > > >> >> >>> > > > > > >>> > >
> > > https://github.com/apache/arrow/pull/48345
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> > > For the Java implementation Vinoo has
> > > been
> > > > > > >> working
> > > > > > >> >> on
> > > > > > >> >> >>> > > following
> > > > > > >> >> >>> > > > > PR
> > > > > > >> >> >>> > > > > > :
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > https://github.com/apache/parquet-java/pull/3397
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> > > Best
> > > > > > >> >> >>> > > > > > >>> > > Prateek
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> > > On Tue, May 5, 2026 at 1:50 PM Micah
> > > > > Kornfield
> > > > > > <
> > > > > > >> >> >>> > > > > > >>> [email protected]>
> > > > > > >> >> >>> > > > > > >>> > > wrote:
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> > >> Hi Antoine,
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >> > Apologies if the question was
> > already
> > > > > asked,
> > > > > > >> but
> > > > > > >> >> >>> should
> > > > > > >> >> >>> > we
> > > > > > >> >> >>> > > > > care
> > > > > > >> >> >>> > > > > > >>> about
> > > > > > >> >> >>> > > > > > >>> > >> > FLOAT16 for ALP? Can FLOAT + ALP
> be
> > > more
> > > > > > >> >> efficient
> > > > > > >> >> >>> than
> > > > > > >> >> >>> > > > > FLOAT16
> > > > > > >> >> >>> > > > > > +
> > > > > > >> >> >>> > > > > > >>> > >> > BYTE_STREAM_SPLIT + LZ4 for
> example?
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >> It was.  We thought we could defer
> it
> > > for
> > > > > the
> > > > > > >> >> >>> following
> > > > > > >> >> >>> > > > reasons:
> > > > > > >> >> >>> > > > > > >>> > >> 1.  It's not clear there are a lot
> of
> > > easy
> > > > > > >> >> reference
> > > > > > >> >> >>> > > datasets
> > > > > > >> >> >>> > > > to
> > > > > > >> >> >>> > > > > > >>> test
> > > > > > >> >> >>> > > > > > >>> > its
> > > > > > >> >> >>> > > > > > >>> > >> effectiveness.  It does look like
> > there
> > > > > might
> > > > > > be
> > > > > > >> >> one
> > > > > > >> >> >>> or
> > > > > > >> >> >>> > two
> > > > > > >> >> >>> > > on
> > > > > > >> >> >>> > > > > > >>> > huggingface
> > > > > > >> >> >>> > > > > > >>> > >> (e.g.
> > > > > > >> >> https://huggingface.co/datasets/kikitora/curdie
> > > > > > >> >> >>> ).
> > > > > > >> >> >>> > > > > > >>> > >> 2.  It seemed likely that float 16
> was
> > > > more
> > > > > > >> likely
> > > > > > >> >> >>> used
> > > > > > >> >> >>> > for
> > > > > > >> >> >>> > > > > values
> > > > > > >> >> >>> > > > > > >>> that
> > > > > > >> >> >>> > > > > > >>> > >> were less likely to reduce to
> decimal
> > > > > values.
> > > > > > >> >> >>> > > > > > >>> > >> 3.  It could be added as an
> extension
> > > > later
> > > > > if
> > > > > > >> >> needed.
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >> Cheers,
> > > > > > >> >> >>> > > > > > >>> > >> Micah
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >> On Tue, May 5, 2026 at 1:40 PM
> Antoine
> > > > > Pitrou
> > > > > > <
> > > > > > >> >> >>> > > > > [email protected]
> > > > > > >> >> >>> > > > > > >
> > > > > > >> >> >>> > > > > > >>> > wrote:
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > Hello,
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > Apologies if the question was
> > already
> > > > > asked,
> > > > > > >> but
> > > > > > >> >> >>> should
> > > > > > >> >> >>> > we
> > > > > > >> >> >>> > > > > care
> > > > > > >> >> >>> > > > > > >>> about
> > > > > > >> >> >>> > > > > > >>> > >> > FLOAT16 for ALP? Can FLOAT + ALP
> be
> > > more
> > > > > > >> >> efficient
> > > > > > >> >> >>> than
> > > > > > >> >> >>> > > > > FLOAT16
> > > > > > >> >> >>> > > > > > +
> > > > > > >> >> >>> > > > > > >>> > >> > BYTE_STREAM_SPLIT + LZ4 for
> example?
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > Regards
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > Antoine.
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > Le 30/04/2026 à 01:10, PRATEEK
> GAUR
> > a
> > > > > écrit
> > > > > > :
> > > > > > >> >> >>> > > > > > >>> > >> > > Thanks Andrew and Micah for
> review
> > > > > > feedback
> > > > > > >> on
> > > > > > >> >> >>> the two
> > > > > > >> >> >>> > > > PR's
> > > > > > >> >> >>> > > > > > >>> > >> > > 1) (c++ arrow repo)
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> https://github.com/apache/arrow/pull/48345/changes
> > > > > > >> >> >>> > > > > > >>> > >> > > 2) (parquet-format repo)
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> https://github.com/apache/parquet-format/pull/557
> > > > > > >> >> >>> > > > > > >>> > >> > >
> > > > > > >> >> >>> > > > > > >>> > >> > > I have addressed all (unless I
> > > missed
> > > > > > >> >> something)
> > > > > > >> >> >>> > > comments
> > > > > > >> >> >>> > > > on
> > > > > > >> >> >>> > > > > > >>> the two
> > > > > > >> >> >>> > > > > > >>> > >> > PR's.
> > > > > > >> >> >>> > > > > > >>> > >> > >
> > > > > > >> >> >>> > > > > > >>> > >> > > Best
> > > > > > >> >> >>> > > > > > >>> > >> > > Prateek
> > > > > > >> >> >>> > > > > > >>> > >> > >
> > > > > > >> >> >>> > > > > > >>> > >> > > On Sat, Apr 25, 2026 at 1:08 PM
> > > > PRATEEK
> > > > > > >> GAUR <
> > > > > > >> >> >>> > > > > > >>> [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >
> > > > > > >> >> >>> > > > > > >>> > >> > >> Thanks Andrew and Micah.
> > > > > > >> >> >>> > > > > > >>> > >> > >>
> > > > > > >> >> >>> > > > > > >>> > >> > >> `fair amount of feedback on at
> > > least
> > > > > the
> > > > > > >> >> >>> > > implementations`
> > > > > > >> >> >>> > > > > > >>> > >> > >> For the c++ I have already
> > started
> > > > > > >> addressing
> > > > > > >> >> the
> > > > > > >> >> >>> > > > > feedback, I
> > > > > > >> >> >>> > > > > > >>> > should
> > > > > > >> >> >>> > > > > > >>> > >> be
> > > > > > >> >> >>> > > > > > >>> > >> > >> done with that Monday/Tuesday.
> > > > > > >> >> >>> > > > > > >>> > >> > >> I think Vinoo too has been
> making
> > > > good
> > > > > > >> >> progress
> > > > > > >> >> >>> on
> > > > > > >> >> >>> > the
> > > > > > >> >> >>> > > > Java
> > > > > > >> >> >>> > > > > > >>> > >> > implementation.
> > > > > > >> >> >>> > > > > > >>> > >> > >>
> > > > > > >> >> >>> > > > > > >>> > >> > >> Best
> > > > > > >> >> >>> > > > > > >>> > >> > >> Prateek
> > > > > > >> >> >>> > > > > > >>> > >> > >>
> > > > > > >> >> >>> > > > > > >>> > >> > >> On Sat, Apr 25, 2026 at
> 12:55 PM
> > > > Andrew
> > > > > > >> Lamb <
> > > > > > >> >> >>> > > > > > >>> > [email protected]
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > >> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>
> > > > > > >> >> >>> > > > > > >>> > >> > >>> Got it. Thank you for the
> > > > > clarification
> > > > > > >> -- I
> > > > > > >> >> >>> will
> > > > > > >> >> >>> > try
> > > > > > >> >> >>> > > > and
> > > > > > >> >> >>> > > > > > look
> > > > > > >> >> >>> > > > > > >>> > into
> > > > > > >> >> >>> > > > > > >>> > >> the
> > > > > > >> >> >>> > > > > > >>> > >> > >>> spec and the Rust
> > > implementation[1]
> > > > in
> > > > > > >> this
> > > > > > >> >> next
> > > > > > >> >> >>> > week
> > > > > > >> >> >>> > > > > > >>> > >> > >>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>> [1]:
> > > > > > >> >> >>> https://github.com/apache/arrow-rs/pull/9372
> > > > > > >> >> >>> > > > > > >>> > >> > >>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>> On Sat, Apr 25, 2026 at
> 12:01 PM
> > > > Micah
> > > > > > >> >> >>> Kornfield <
> > > > > > >> >> >>> > > > > > >>> > >> > [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> > >>> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>> Hi Andrew,
> > > > > > >> >> >>> > > > > > >>> > >> > >>>> I think there is a fair
> amount
> > of
> > > > > > >> feedback
> > > > > > >> >> on
> > > > > > >> >> >>> at
> > > > > > >> >> >>> > > least
> > > > > > >> >> >>> > > > > the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>> implementations, typically I
> > > think
> > > > > > we've
> > > > > > >> >> waited
> > > > > > >> >> >>> > till
> > > > > > >> >> >>> > > > they
> > > > > > >> >> >>> > > > > > are
> > > > > > >> >> >>> > > > > > >>> > >> close to
> > > > > > >> >> >>> > > > > > >>> > >> > >>>> mergeable before a final
> vote.
> > > > > > >> Otherwise I
> > > > > > >> >> >>> agree
> > > > > > >> >> >>> > we
> > > > > > >> >> >>> > > > are
> > > > > > >> >> >>> > > > > > very
> > > > > > >> >> >>> > > > > > >>> > >> close.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>> -Micah
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>> On Saturday, April 25, 2026,
> > > Andrew
> > > > > > Lamb
> > > > > > >> <
> > > > > > >> >> >>> > > > > > >>> [email protected]
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> > >> > wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> Thanks Prateek,
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> I think from this content it
> > > looks
> > > > > to
> > > > > > me
> > > > > > >> >> like
> > > > > > >> >> >>> we
> > > > > > >> >> >>> > are
> > > > > > >> >> >>> > > > > ready
> > > > > > >> >> >>> > > > > > >>> to
> > > > > > >> >> >>> > > > > > >>> > >> start a
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> vote to explicitly accept
> ALP
> > > into
> > > > > > >> Parquet
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> Does anyone know of a reason
> > we
> > > > > should
> > > > > > >> >> >>> postpone it
> > > > > > >> >> >>> > > for
> > > > > > >> >> >>> > > > > > >>> longer?
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> Perhaps someone needs some
> > more
> > > > time
> > > > > > to
> > > > > > >> >> >>> review?
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> Andrew
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> On Wed, Apr 22, 2026 at
> > 1:00 PM
> > > > > > PRATEEK
> > > > > > >> >> GAUR <
> > > > > > >> >> >>> > > > > > >>> > [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> Hi team,
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> Hope everyone is doing
> well.
> > I
> > > > got
> > > > > a
> > > > > > >> >> chance
> > > > > > >> >> >>> to
> > > > > > >> >> >>> > work
> > > > > > >> >> >>> > > > > > >>> through all
> > > > > > >> >> >>> > > > > > >>> > >> the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> remaining feedback and
> update
> > > the
> > > > > > spec
> > > > > > >> >> doc.
> > > > > > >> >> >>> Here
> > > > > > >> >> >>> > > are
> > > > > > >> >> >>> > > > > the
> > > > > > >> >> >>> > > > > > >>> new
> > > > > > >> >> >>> > > > > > >>> > >> > artifacts
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> 1) Spec document :
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > >
> > > > > > >> >> >>> > > >
> > > > > > >> >> >>> > >
> > > > > > >> >> >>> >
> > > > > > >> >> >>>
> > > > > > >> >>
> > > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
> https://docs.google.com/document/d/1xz2cudDpN2Y1ImFcTXh15s-3fPtD_aWt/edit
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> 2) Spec document in parquet
> > > > format
> > > > > > >> repo :
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > https://github.com/apache/parquet-format/pull/557
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> 3) Alp implementation in
> > arrow
> > > > c++
> > > > > > >> repo :
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > https://github.com/apache/arrow/pull/48345/changes
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> 4) Alp implementation in
> > > > > parquet-java
> > > > > > >> >> repo :
> > > > > > >> >> >>> Work
> > > > > > >> >> >>> > > for
> > > > > > >> >> >>> > > > > > >>> Vinoo and
> > > > > > >> >> >>> > > > > > >>> > >> > Julien
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > https://github.com/apache/parquet-java/pull/3397
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> 5) PR with test and
> > > benchmarking
> > > > > > >> >> artifacts in
> > > > > > >> >> >>> > > > > > >>> parquet-testing
> > > > > > >> >> >>> > > > > > >>> > >> repo :
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > https://github.com/apache/parquet-testing/pull/100
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> And
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>     - Go : Arnav just
> > submitted
> > > > an
> > > > > in
> > > > > > >> >> >>> progress
> > > > > > >> >> >>> > > > > > >>> implementation
> > > > > > >> >> >>> > > > > > >>> > in
> > > > > > >> >> >>> > > > > > >>> > >> Go.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> https://github.com/apache/arrow-go/pull/704
> > > > > > >> >> >>> > (I
> > > > > > >> >> >>> > > > > > haven't
> > > > > > >> >> >>> > > > > > >>> > >> started
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>     looking at it yet)
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>     - Rust : I remember
> > Andrew
> > > > > > >> mentioned
> > > > > > >> >> that
> > > > > > >> >> >>> > this
> > > > > > >> >> >>> > > > work
> > > > > > >> >> >>> > > > > > is
> > > > > > >> >> >>> > > > > > >>> also
> > > > > > >> >> >>> > > > > > >>> > >> in
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>     progress (So 4
> > languages!)
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> *Arrow C++ implementation *
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> The PR is out and was also
> > used
> > > > by
> > > > > > >> >> Antoine to
> > > > > > >> >> >>> > > report
> > > > > > >> >> >>> > > > > the
> > > > > > >> >> >>> > > > > > >>> > numbers
> > > > > > >> >> >>> > > > > > >>> > >> as
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> reported here. Micah and
> > > > Konstantin
> > > > > > >> have
> > > > > > >> >> >>> given 1
> > > > > > >> >> >>> > > > round
> > > > > > >> >> >>> > > > > of
> > > > > > >> >> >>> > > > > > >>> > >> feedback
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> and I'm addressing them
> > today.
> > > > > Please
> > > > > > >> note
> > > > > > >> >> >>> that
> > > > > > >> >> >>> > the
> > > > > > >> >> >>> > > > > > default
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> optimization flag for
> > compiling
> > > > is
> > > > > O2
> > > > > > >> and
> > > > > > >> >> not
> > > > > > >> >> >>> > Q3. I
> > > > > > >> >> >>> > > > got
> > > > > > >> >> >>> > > > > > >>> around
> > > > > > >> >> >>> > > > > > >>> > >> 70%
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> performance improvement in
> > the
> > > > > > decoding
> > > > > > >> >> speed
> > > > > > >> >> >>> > when
> > > > > > >> >> >>> > > > > using
> > > > > > >> >> >>> > > > > > >>> the O3
> > > > > > >> >> >>> > > > > > >>> > >> > flag.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> *Parqet-MR Java
> > implementation
> > > > > > (working
> > > > > > >> >> with
> > > > > > >> >> >>> > Vinoo
> > > > > > >> >> >>> > > > and
> > > > > > >> >> >>> > > > > > >>> Julien)
> > > > > > >> >> >>> > > > > > >>> > >> and
> > > > > > >> >> >>> > > > > > >>> > >> > **Cross
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> Language testing*
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>     Let me know if you have
> > any
> > > > > > >> questions
> > > > > > >> >> or
> > > > > > >> >> >>> > > > feedback.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> Now pasting some
> performance
> > > > > numbers
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>    Table 1: C++ ALP Double
> > > > Decode —
> > > > > > >> >> Spotify
> > > > > > >> >> >>> > Columns
> > > > > > >> >> >>> > > > > > >>> (Graviton
> > > > > > >> >> >>> > > > > > >>> > 3,
> > > > > > >> >> >>> > > > > > >>> > >> ARM
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> Neoverse V1)
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>>
> > > ┌──────────────────┬──────────────┬──────────────┬─────────┐
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>    │ Column           │
> -O2
> > > > (MB/s)
> > > > > > │
> > > > > > >> >> -O3
> > > > > > >> >> >>> > > (MB/s)  │
> > > > > > >> >> >>> > > > > > >>> Speedup │
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>>
> > > ├──────────────────┼──────────────┼──────────────┼─────────┤
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>    │ valence          │
> > >  3,155
> > > > > > │
> > > > > > >> >> >>>  5,523
> > > > > > >> >> >>> > >   │
> > > > > > >> >> >>> > > > > > >>> 1.75x  │
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>    │ danceability     │
> > >  3,233
> > > > > > │
> > > > > > >> >> >>>  5,685
> > > > > > >> >> >>> > >   │
> > > > > > >> >> >>> > > > > > >>> 1.76x  │
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>    │ energy           │
> > >  3,197
> > > > > > │
> > > > > > >> >> >>>  5,652
> > > > > > >> >> >>> > >   │
> > > > > > >> >> >>> > > > > > >>> 1.77x  │
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>    │ loudness         │
> > >  3,186
> > > > > > │
> > > > > > >> >> >>>  5,473
> > > > > > >> >> >>> > >   │
> > > > > > >> >> >>> > > > > > >>> 1.72x  │
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>>
> > > └──────────────────┴──────────────┴──────────────┴─────────┘
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> On Wed, Feb 25, 2026 at
> > 9:49 AM
> > > > > > PRATEEK
> > > > > > >> >> GAUR
> > > > > > >> >> >>> <
> > > > > > >> >> >>> > > > > > >>> > [email protected]
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> @Micah Kornfield <
> > > > > > >> [email protected]>
> > > > > > >> >> :
> > > > > > >> >> >>> Got
> > > > > > >> >> >>> > > it.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> @Andrew Lamb <
> > > > > > [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> Do you think it would be
> > good
> > > > to
> > > > > > >> start
> > > > > > >> >> >>> moving
> > > > > > >> >> >>> > the
> > > > > > >> >> >>> > > > > spec
> > > > > > >> >> >>> > > > > > >>> > >> development
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> into
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> markdown format, in
> > > preparation
> > > > > for
> > > > > > >> >> >>> finalizing
> > > > > > >> >> >>> > > it?
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> Yes I'll update the
> numbers
> > > for
> > > > > some
> > > > > > >> of
> > > > > > >> >> the
> > > > > > >> >> >>> > > > examples I
> > > > > > >> >> >>> > > > > > >>> have in
> > > > > > >> >> >>> > > > > > >>> > >> the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> spec based
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> on the updated header
> size.
> > > Then
> > > > > we
> > > > > > >> >> should
> > > > > > >> >> >>> be
> > > > > > >> >> >>> > good
> > > > > > >> >> >>> > > > to
> > > > > > >> >> >>> > > > > go
> > > > > > >> >> >>> > > > > > >>> for
> > > > > > >> >> >>> > > > > > >>> > the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> markdown format.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>> Thanks everyone!
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> Andrew
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> On Tue, Feb 17, 2026 at
> > > 7:28 PM
> > > > > > >> PRATEEK
> > > > > > >> >> >>> GAUR <
> > > > > > >> >> >>> > > > > > >>> > >> [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> Hi team,
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> 1) Andrew
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - Thanks for working
> > on
> > > > test
> > > > > > >> files.
> > > > > > >> >> >>> My PR
> > > > > > >> >> >>> > > did
> > > > > > >> >> >>> > > > > add
> > > > > > >> >> >>> > > > > > >>> all
> > > > > > >> >> >>> > > > > > >>> > the
> > > > > > >> >> >>> > > > > > >>> > >> > test
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> files I
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     used to benchmark on
> > > > > datasets.
> > > > > > >> >> Maybe
> > > > > > >> >> >>> we
> > > > > > >> >> >>> > can
> > > > > > >> >> >>> > > > club
> > > > > > >> >> >>> > > > > > it
> > > > > > >> >> >>> > > > > > >>> > >> together.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> WIll also
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> aid
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     cross language
> testing
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     -  Kosta Tarasov
> > working
> > > > on
> > > > > > Rust
> > > > > > >> >> >>> > > > implementation.
> > > > > > >> >> >>> > > > > > >>> This is
> > > > > > >> >> >>> > > > > > >>> > >> > great.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> Thanks
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> 2) Antoine
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - Thanks a lot for
> > > > reporting
> > > > > > the
> > > > > > >> >> >>> numbers
> > > > > > >> >> >>> > on
> > > > > > >> >> >>> > > > AMD.
> > > > > > >> >> >>> > > > > > >>> Looks
> > > > > > >> >> >>> > > > > > >>> > >> like
> > > > > > >> >> >>> > > > > > >>> > >> > you
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> are
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     getting 8X the
> > decoding
> > > > > > >> >> performance of
> > > > > > >> >> >>> > BSS.
> > > > > > >> >> >>> > > > This
> > > > > > >> >> >>> > > > > > is
> > > > > > >> >> >>> > > > > > >>> > >> > amazing!!.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - Thanks for
> > > acknowledging
> > > > > the
> > > > > > >> >> >>> sampling
> > > > > > >> >> >>> > > > design.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - I agree with you
> on
> > > > > > >> Fastlanes. In
> > > > > > >> >> >>> some
> > > > > > >> >> >>> > > crude
> > > > > > >> >> >>> > > > > > >>> > >> experiments I
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> didn't get
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     a good perf benefit
> > from
> > > > it
> > > > > on
> > > > > > >> >> >>> Graviton3
> > > > > > >> >> >>> > > (but
> > > > > > >> >> >>> > > > > > maybe
> > > > > > >> >> >>> > > > > > >>> > there
> > > > > > >> >> >>> > > > > > >>> > >> was
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> something
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     wrong with my
> > > > > implementation).
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - Locking the 16bit
> > > > > exception
> > > > > > >> >> >>> encoding for
> > > > > > >> >> >>> > > the
> > > > > > >> >> >>> > > > > > spec
> > > > > > >> >> >>> > > > > > >>> in
> > > > > > >> >> >>> > > > > > >>> > >> this
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> case.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - Awesome I think we
> > > have
> > > > > > solved
> > > > > > >> >> for
> > > > > > >> >> >>> all
> > > > > > >> >> >>> > > open
> > > > > > >> >> >>> > > > > > >>> questions
> > > > > > >> >> >>> > > > > > >>> > >> minus
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     version byte :).
> (will
> > > get
> > > > > > back
> > > > > > >> on
> > > > > > >> >> >>> this
> > > > > > >> >> >>> > > soon)
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> 3) Micah
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     - FastLanes : The
> > > current
> > > > > spec
> > > > > > >> does
> > > > > > >> >> >>> allow
> > > > > > >> >> >>> > > for
> > > > > > >> >> >>> > > > > > using
> > > > > > >> >> >>> > > > > > >>> > >> FastLane
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> with the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     configurable enum
> > value
> > > > for
> > > > > > >> >> layout. We
> > > > > > >> >> >>> > > should
> > > > > > >> >> >>> > > > be
> > > > > > >> >> >>> > > > > > >>> able to
> > > > > > >> >> >>> > > > > > >>> > >> > inject
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> any
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> layout
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>     in the current
> design.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> Working on resolving all
> > > > > remaining
> > > > > > >> open
> > > > > > >> >> >>> > comments
> > > > > > >> >> >>> > > > on
> > > > > > >> >> >>> > > > > > the
> > > > > > >> >> >>> > > > > > >>> spec
> > > > > > >> >> >>> > > > > > >>> > >> this
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> week.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> Best
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> Prateek
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> On Tue, Feb 10, 2026 at
> > > > 3:37 AM
> > > > > > >> Steve
> > > > > > >> >> >>> > Loughran <
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>> On Sun, 8 Feb 2026 at
> > > 18:12,
> > > > > > Micah
> > > > > > >> >> >>> Kornfield
> > > > > > >> >> >>> > <
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> [email protected]>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>> wrote:
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>> It looks like the
> actual
> > > > issue
> > > > > > >> >> >>> described for
> > > > > > >> >> >>> > > ORC
> > > > > > >> >> >>> > > > > in
> > > > > > >> >> >>> > > > > > >>> the
> > > > > > >> >> >>> > > > > > >>> > >> paper
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> is that
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> it
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>> has multiple
> > sub-encodings
> > > > in
> > > > > a
> > > > > > >> >> batch.
> > > > > > >> >> >>> This
> > > > > > >> >> >>> > > is
> > > > > > >> >> >>> > > > > > >>> different
> > > > > > >> >> >>> > > > > > >>> > >> then
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> the
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>> design
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>> proposed here where
> > there
> > > is
> > > > > > still
> > > > > > >> >> fixed
> > > > > > >> >> >>> > > > encoding
> > > > > > >> >> >>> > > > > > per
> > > > > > >> >> >>> > > > > > >>> page
> > > > > > >> >> >>> > > > > > >>> > >> in
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> parquet.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>> Given reasonably sized
> > > > pages I
> > > > > > >> don't
> > > > > > >> >> >>> think
> > > > > > >> >> >>> > > > branch
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> misprediction should
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>> be a
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>> big issue for new
> > > encodings.
> > > > > I
> > > > > > >> agree
> > > > > > >> >> >>> that
> > > > > > >> >> >>> > we
> > > > > > >> >> >>> > > > > should
> > > > > > >> >> >>> > > > > > >>> be
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>> conservative in
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>> general for adding new
> > > > > > encodings.
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>> +1
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >>>>>>>
> > > > > > >> >> >>> > > > > > >>> > >> > >
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >> >
> > > > > > >> >> >>> > > > > > >>> > >>
> > > > > > >> >> >>> > > > > > >>> > >
> > > > > > >> >> >>> > > > > > >>> >
> > > > > > >> >> >>> > > > > > >>>
> > > > > > >> >> >>> > > > > > >>
> > > > > > >> >> >>> > > > > >
> > > > > > >> >> >>> > > > >
> > > > > > >> >> >>> > > >
> > > > > > >> >> >>> > >
> > > > > > >> >> >>> >
> > > > > > >> >> >>>
> > > > > > >> >> >>
> > > > > > >> >>
> > > > > > >> >
> > > > > > >>
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Reply via email to