[
https://issues.apache.org/jira/browse/IMPALA-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy resolved IMPALA-14586.
----------------------------------------
Fix Version/s: Impala 5.0.0
Resolution: Fixed
> Implement Iceberg-conform Roaring bitmap
> ----------------------------------------
>
> Key: IMPALA-14586
> URL: https://issues.apache.org/jira/browse/IMPALA-14586
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
> Fix For: Impala 5.0.0
>
>
> Iceberg doesn't use 64-bit RoaringBitmaps for some reason...
> They use an array of 32-bit RoarngBitmaps to cover the range of 0..2^64-1.
> See
> [https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/deletes/RoaringPositionBitmap.java]
> -They have a custom serialization and deserializtion algorithm as well. For
> best performance, we should implement our Roaring bitmap similarly.-
> They use the portable serialization format of the roaring bitmaps:
> [https://github.com/RoaringBitmap/RoaringFormatSpec?tab=readme-ov-file#extension-for-64-bit-implementations]
> So we only need to implement serialization/deserializtion for our bitmaps.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
