frostruan commented on pull request #4115:
URL: https://github.com/apache/hbase/pull/4115#issuecomment-1046484462
hi duo, I've made some progress recently.
1. using WorkerAssigner to distribute the task of snapshot verification.
a. move WorkerAssigner out of SplitWALManager for reuse.
b. new a WorkerAssigner instance in the SnapshotManger and distribute the
task of snapshot verification with it.
2. introduce a RSSnapshotVerifier
a. since now we verify only one region via a verification procedure, it
could be slow if we load the SnapshotManaifest from hdfs every time. so I add a
cache for it.
b. the RSSnapshotVerifier is used to verify regioninfo and store files.
3. if the snapshot is corrupted, we touch a hdfs file to notify the upper
layer procedures.
4. using nonceGroup and nonce field in the snapshot request to identify
whether the client can handle snapshot proc id.
5. introduce a switch in SnapshotManager hbase.snapshot.procedure.enabled to
enable snapshot procedure so that we can fallback to the zk-coordinated
snapshot.
If you have time, would you mind taking a look on this at your convenience
and see if there is any problems ? Thanks. @Apache9
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
