lucasfang opened a new pull request, #69:
URL: https://github.com/apache/paimon-cpp/pull/69
### Purpose
Linked issue: No linked issue
This change adds deletion vector support under
`src/paimon/core/deletionvectors`.
Included changes:
- Deletion vector base:
- Adds `DeletionVector` abstract base class with factory method, merge,
serialization/deserialization, and size tracking.
- Adds `BitmapDeletionVector` implementation using Roaring bitmaps for
efficient row-level deletion tracking.
- Adds `Bitmap64DeletionVector` header for 64-bit extended bitmap deletion
vector support.
- Deletion vector index file I/O:
- Adds `DeletionVectorsIndexFile` for reading deletion vectors from index
files by partition/bucket path.
- Adds `DeletionVectorIndexFileWriter` for writing deletion vectors into
paimon index file format.
- Deletion file writer:
- Adds `DeletionFileWriter` for coordinating deletion vector persistence
with file-level granularity.
- Bucketed DV maintainer:
- Adds `BucketedDvMaintainer` for managing deletion vectors grouped by
bucket, supporting notifyNewDeletion and prepareCommit workflows.
- Apply deletion vector batch reader:
- Adds `ApplyDeletionVectorBatchReader` for filtering Arrow record batches
using deletion vectors at read time.
- Test coverage:
- Adds unit tests for deletion vector, bitmap deletion vector, deletion
vectors index file, deletion vector index file writer, deletion file writer,
bucketed DV maintainer, and apply deletion vector batch reader.
### Tests
Not run.
Test coverage included in this change:
- `deletion_vector_test.cpp`
- `bitmap_deletion_vector_test.cpp`
- `deletion_vectors_index_file_test.cpp`
- `deletion_vector_index_file_writer_test.cpp`
- `deletion_file_writer_test.cpp`
- `bucketed_dv_maintainer_test.cpp`
- `apply_deletion_vector_batch_reader_test.cpp`
### API and Format
No public API, storage format, or protocol changes.
This change adds internal core deletion vector headers and implementations
under `src/paimon/core/deletionvectors`.
### Documentation
No documentation changes required.
### Generative AI tooling
Migrate-by: Aone Copilot (GPT5.5)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
