DELTA_BINARY_PACKED to be used on FLBA(16) if
that's a concern.
I don't think you can as DELTA_BINARY_PACKED requires arithmetic
operations to be well-defined for the type. One could define it for
FLBA(16) in a way that assumes the contents to be Int128 but I think
that would be a little unusual.
Regardless of the physical type, a 128-bit implementation of
DELTA_BINARY_PACKED might be annoying to write if the target language
does not have a 128-bit integer type.
Given the parquet standard already supports 128-bit decimals, readers
must already have some mechanism for handling such primitives - albeit
potentially not as efficient as languages with a native primitive.
On 09/07/2025 16:12, Antoine Pitrou wrote:
On Wed, 9 Jul 2025 12:31:12 +0100
Raphael Taylor-Davies
<r.taylordav...@googlemail.com.INVALID>
wrote:
I guess one potential advantage of an INT128 type would be that it could
make use of the DELTA_BINARY_PACKED encoding, which could yield fairly
significant savings for such large integers.
Well, we could allow DELTA_BINARY_PACKED to be used on FLBA(16) if
that's a concern.
Regardless of the physical type, a 128-bit implementation of
DELTA_BINARY_PACKED might be annoying to write if the target language
does not have a 128-bit integer type.
Regards
Antoine.
