steFaiz commented on code in PR #8380:
URL: https://github.com/apache/paimon/pull/8380#discussion_r3497786850
##########
paimon-core/src/main/java/org/apache/paimon/table/source/DataSplit.java:
##########
@@ -73,6 +77,7 @@ public class DataSplit implements Split {
private List<DataFileMeta> dataFiles;
@Nullable private List<DeletionFile> dataDeletionFiles;
+ @Nullable private Map<Range, DeletionFile> dataEvolutionDeletionFiles;
Review Comment:
Thanks for your adivse! I previously think we could strip anchor file before
generating DataSplits (to decrease data transferring from master to workers).
If we ensure anchor files are all present in DataSplit, we can reuse current
code, even not modifying SnapshotReader
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
