[
https://issues.apache.org/jira/browse/OAK-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Mueller updated OAK-9093:
--------------------------------
Description:
Indexing using oak-run and --doc-traversal-mode uses the FlatFileStore. After
fixing OAK-9052, now in some cases (after one minute, if the file is small) the
following INFO messages from PersistedLinkedList are logged a lot:
{noformat}
14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 33
map size: 33 file size: 2932736 bytes
14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 34
map size: 34 file size: 2932736 bytes
14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 35
map size: 35 file size: 2932736 bytes
14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 36
map size: 36 file size: 2932736 bytes
{noformat}
was:
Indexing using oak-run and --doc-traversal-mode uses the FlatFileStore. For
aggregation, there is a limit on memory usage, by default around 100 MB.
Depending on the content structure, this limit can be exceeded.
It would be good to find a way to avoid a memory limit, for example using a
temporary storage (a file, or a persistent key/value store).
> Reindexing using --doc-traversal-mode may log too much
> ------------------------------------------------------
>
> Key: OAK-9093
> URL: https://issues.apache.org/jira/browse/OAK-9093
> Project: Jackrabbit Oak
> Issue Type: Improvement
> Components: indexing, mongomk, run
> Reporter: Thomas Mueller
> Assignee: Thomas Mueller
> Priority: Major
> Fix For: 1.30.0
>
>
> Indexing using oak-run and --doc-traversal-mode uses the FlatFileStore. After
> fixing OAK-9052, now in some cases (after one minute, if the file is small)
> the following INFO messages from PersistedLinkedList are logged a lot:
> {noformat}
> 14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 33
> map size: 33 file size: 2932736 bytes
> 14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 34
> map size: 34 file size: 2932736 bytes
> 14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 35
> map size: 35 file size: 2932736 bytes
> 14:08:40.799 [main] INFO o.a.j.o.i.i.d.f.l.PersistedLinkedList - Entries: 36
> map size: 36 file size: 2932736 bytes
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
