On Mon, 7 Jul 2025 13:08:31 +0300
Alkis Evlogimenos
<alkis.evlogime...@databricks.com.INVALID>
wrote:
> One benefit of INT128 is that it will have natural ordering for INTERVAL
> while FLBA will not.

Ordering should be defined at the logical type level, not physical type.

> If we agree that FLBA(16) is better repr for an integer of 128 bits
> (through logical type annotation) would this mean we should consider
> deprecating INT32/INT64/FLOAT/DOUBLE in favor of FBLA(4)/FBLA(8) with
> logical types?

It depends what "deprecating" entails. We do not want to disrupt the
ecosystem needlessly.

But if we were designing a new Parquet format from scratch, I would
definitely advocate for a reduced set of 3 physical types: BIT, FLBA
and VLBA.

Regards

Antoine.


Reply via email to