Sorry parquet format, I'll repost there (auto-complete and muscle memory problems today ...).
On Tue, Jun 1, 2021 at 11:47 AM Antoine Pitrou <anto...@python.org> wrote: > > Le 01/06/2021 à 20:46, Micah Kornfield a écrit : > > I couldn't find anything in the specification on this, but is there any > > constraint on how disallowed ordering of encoded pages in a column for a > > row group. > > > > I think in practice most types try to dictionary encode first and then > > fallback to another encoding if the dictionary doesn't yield benefits or > > grows too big. But in theory is an ordering of pages described below > > possible: > > > > 1. Dictionary Encoded Page > > 2. Plain Encoded Page > > 3. Dictionary Encoded Page > > Hmm... is the question about Arrow or about the Parquet format? > > Regards > > Antoine. >
