Saketa Chalamchala created HDDS-15394:
-----------------------------------------
Summary: Implement Full diff with multi stage sequential read
Key: HDDS-15394
URL: https://issues.apache.org/jira/browse/HDDS-15394
Project: Apache Ozone
Issue Type: Sub-task
Reporter: Saketa Chalamchala
Assignee: Saketa Chalamchala
Implement a multi-stage scan for an optimized full diff:
1. Full table scan of `toSnapshot.directoryTable`. Use `updateID >
fromSnapshotDbTxSequenceNumber` filter to build `newList` tracking diff
candidates. Also populate intermediate column families used for `toSnapshot`
key's path resolution.
2. Full table scan of `fromSnapshot.directoryTable` to build `oldList` for diff
candidates and intermediate column families used for `fromSnapshot` key's path
resolution.
3. Full table scan of `toSnapshot.keyTable` with `updateID` gating reading keys
into `newList`.
4. Full table scan of `fromSnapshot.keyTable` with reading keys into `oldList`
for diff candidates.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
