lilei1128 commented on code in PR #9987:
URL: https://github.com/apache/paimon/pull/9987#discussion_r4070042356
##########
paimon-core/src/main/java/org/apache/paimon/operation/DataEvolutionSplitRead.java:
##########
@@ -250,11 +250,26 @@ private RecordReader<InternalRow> createReader(
} else {
suppliers.add(
() -> {
- if (skipByFileIndex(filters, needMergeFiles,
dataFilePathFactory)) {
+ if (skipByFileIndex(
+ filters,
+ needMergeFiles,
+ dataFilePathFactory,
+ rowRanges,
+ null)) {
return new EmptyFileRecordReader<>();
}
DeletionVectorWithRange deletionVector =
readDeletionVector(needMergeFiles,
deletionVectorFactory);
+ if (deletionVector != null
+ && !deletionVector.deletionVector.isEmpty()
+ && skipByFileIndex(
Review Comment:
Thanks for the review. Fixed by using the cached file-index results,
avoiding duplicate .index file reads while preserving DV-aware pruning.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
