hemantk-12 opened a new pull request, #4360:
URL: https://github.com/apache/ozone/pull/4360

   ## What changes were proposed in this pull request?
   This change is to return partial snap diff response along with some 
optimization to remove unnecessary serialization and 
   de-serialization while persisting information to RocksDB.
   
   For snap diff jobs and reports persistent, two table `snap-diff-job-table` 
and `snap-diff-report-table` have been added to snapshot Diff RocksDB instance 
(As of now, later can be moved to OM RocksDB instance). `snap-diff-job-table` 
table contains the information about the snap diff job to early return if 
similar job exists. `snap-diff-report-table` table is global table and is used 
to persist the snapdiff report and return the response in paginated fashion 
with client continuation token.
   
   To remove unnecessary serialization and de-serialization, intermediate table 
and report table's type have been changed to byte array. Previously, [type 
map](https://github.com/apache/ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/snapshot/SnapshotDiffManager.java#L180)
 was added for intermediate stages. For that, we serialization and 
de-serialization data while writing and reading on every stage/step.
   
   ## What is the link to the Apache JIRA
   https://issues.apache.org/jira/browse/HDDS-7548
   
   ## How was this patch tested?
   * Using ozone CLI as of now.
   * Unit tests are in progress.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to