lilei1128 opened a new pull request, #9987:
URL: https://github.com/apache/paimon/pull/9987
### Purpose
Merged data evolution groups could use file indexes to skip an entire
group, but index evaluation did not account for deletion vectors. When
all indexed matches had been deleted, the union reader still opened
every file in the group even though no live row could match.
- Read the group deletion vector before evaluating merged-group file
indexes.
- Pass the deletion vector, selected row ranges, and file offset to
file index evaluation.
- Intersect each winning-column file index result with the group's live
rows before deciding whether to skip the whole group.
- Keep blob/vector files and overwritten field indexes excluded from
group-level pruning.
### Tests
- Add testMergedGroupFileIndexComposesWithDeletionVector to verify that:
- a merged group is skipped when its only bitmap match is deleted;
- deleting a neighboring row does not skip the live bitmap match.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
