[
https://issues.apache.org/jira/browse/OAK-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Nuno Santos resolved OAK-11412.
-------------------------------
Fix Version/s: 1.76.0
Resolution: Done
> indexing job: delay creation of index writers backend until the start of the
> indexing phase
> -------------------------------------------------------------------------------------------
>
> Key: OAK-11412
> URL: https://issues.apache.org/jira/browse/OAK-11412
> Project: Jackrabbit Oak
> Issue Type: Task
> Components: indexing
> Reporter: Nuno Santos
> Priority: Minor
> Fix For: 1.76.0
>
>
> Currently, the indexing job creates the index writers (one per index, for
> both Lucene and Elastic) at the start of the job. But these writers and
> associated objects are not needed for the download phase of the job, they are
> only needed for the indexing phase. By creating them at the start, they are
> taking up memory and resources which could be better used for the download.
> When indexing a large number of indexes, they may consume a significant
> amount of memory (I did not measure, but these objects are heavy-weight, with
> significant internal buffers and may also start background threads).
> These writers should be created only at the start of the indexing phase,
> after the download phase is terminated and its resources are released.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
