Julian Sedding created OAK-11861:
------------------------------------
Summary: segment store initialization should run in parallel
Key: OAK-11861
URL: https://issues.apache.org/jira/browse/OAK-11861
Project: Jackrabbit Oak
Issue Type: Improvement
Components: segment-tar
Affects Versions: 1.84.0
Reporter: Julian Sedding
Assignee: Julian Sedding
Initialization of all TarReaders happens sequentially. In the case of an
azure-based segmentstore, this unnecessarily slows down startup, as the azure
segmentstore has to traverse all segment blobs in order to build an in-memory
segment index.
This heavily I/O bound process could run in parallel, allowing each "tar-file"
folder in azure to be loaded in parallel.
The change would also benefit other segment store implementations, however, the
benefit is of course larger when initialization is generally slow/inefficient.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)