George Jahad created HDDS-8943:
----------------------------------

             Summary: Limit the total size of sst files in bootstrapping 
tarball.
                 Key: HDDS-8943
                 URL: https://issues.apache.org/jira/browse/HDDS-8943
             Project: Apache Ozone
          Issue Type: Sub-task
            Reporter: George Jahad
            Assignee: George Jahad


The incremental checkpointing PR I created here: 
https://github.com/apache/ozone/pull/4770 allows multiple increments of data if 
the initial tarball took too long to download.

This is needed for om snapshots but is not completely sufficient, because the 
first increment can grow quite large, as it includes all sst files that exist 
at the time it is created.  (Each subsequent increment only includes the sst 
files created after the first tarball was created.)

This means there is no limit to the size of the inital tarball.  

 

The purpose of this ticket is to address that issue.

Note that this is a relatively small enhancement to the existing incremental 
checkpointing feature; I already have it working, and should be able to create 
a PR in the next few days.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to