imbajin opened a new pull request, #814: URL: https://github.com/apache/hugegraph-toolchain/pull/814
## Purpose of the PR Import tasks could report completion with their Loader still open, while deletion or a failed metadata transaction could lose the Loader owner. Completion now waits for owned shutdown, and closed owners are retired after the final metadata transaction commits. Source PR: https://github.com/hugegraph/hugegraph-toolchain/pull/66. ## Main Changes - Close each task's Loader, workers, clients and JVM hook on completion or failed publication; retain an owner when cleanup is incomplete. - Serialize task controls and Job create/start/delete admission within one Hubble service, including metadata reads and delayed dispatch. Recheck stale callbacks before running or deleting work. - Retry final metadata writes through the existing poll and preserve independent, typed checkpoint offsets and completed counts during incremental resume. - Add lifecycle, rollback and checkpoint regressions, and document shutdown and recovery behavior in the Hubble and Loader READMEs. ## Verifying these changes - [ ] Trivial rework / code cleanup without any test coverage. (No Need) - [ ] Already covered by existing tests. - [x] Need tests and can be verified as follows: - Formatting, clean compilation, and Client, Loader and Hubble backend unit suites. - Native Server/H2 controls for owned cleanup, stale publication, metadata rollback and task/Job admission, plus three independent final reviews. The merged Loader startup guard in [#812](https://github.com/apache/hugegraph-toolchain/pull/812) is included in the current master baseline. Admission is coordinated within one Hubble service; separate import processes still need graph-mode coordination. Existing backend calls can still block Loader waits. Both repositories' current-head CI, full browser UI, alternate deletion endpoints, cross-Server imports and matching-release integration remain open. ## Does this PR potentially affect the following parts? - [ ] Nope - [ ] Dependencies (add/update license info) - [ ] Modify configurations - [x] The public API (`HugeGraphLoader.shutdown()` and task-control behavior) - [ ] Other affects (typed here) ## Documentation Status - [ ] `Doc - TODO` - [x] `Doc - Done` - [ ] `Doc - No Need` Shutdown and recovery behavior is documented in this PR's Hubble and Loader READMEs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
