[
https://issues.apache.org/jira/browse/IMPALA-14586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18050195#comment-18050195
]
ASF subversion and git services commented on IMPALA-14586:
----------------------------------------------------------
Commit 1def420e6bc2df7c1eca37d26470f6a3c53645df in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=1def420e6 ]
IMPALA-14586: Add Serialize/Deserialize functions to RoaringBitmap64
This patch adds Serialize/Deserialize functions to RoaringBitmap64
which uses CRoaring's portable serialization format which also
complies to Iceberg's deletion vectors' serialization format.
Testing
* added unit tests
Change-Id: If836b0b14afb364a0d5548d47753c601f013226c
Reviewed-on: http://gerrit.cloudera.org:8080/23795
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Implement Iceberg-conform Roaring bitmap
> ----------------------------------------
>
> Key: IMPALA-14586
> URL: https://issues.apache.org/jira/browse/IMPALA-14586
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> Iceberg doesn't use 64-bit RoaringBitmaps for some reason...
> They use an array of 32-bit RoarngBitmaps to cover the range of 0..2^64-1.
> See
> [https://github.com/apache/iceberg/blob/main/core/src/main/java/org/apache/iceberg/deletes/RoaringPositionBitmap.java]
> -They have a custom serialization and deserializtion algorithm as well. For
> best performance, we should implement our Roaring bitmap similarly.-
> They use the portable serialization format of the roaring bitmaps:
> [https://github.com/RoaringBitmap/RoaringFormatSpec?tab=readme-ov-file#extension-for-64-bit-implementations]
> So we only need to implement serialization/deserializtion for our bitmaps.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
