Amrit Verma created OAK-9576:
--------------------------------
Summary: Multithreaded download synchronization issues
Key: OAK-9576
URL: https://issues.apache.org/jira/browse/OAK-9576
Project: Jackrabbit Oak
Issue Type: Bug
Components: indexing
Reporter: Amrit Verma
Assignee: Amrit Verma
Multithreaded download implementation done in OAK-9434 suffers from some
synchronization issues.
Eg with thread size 4 -
All 4 running tasks got the MemoryManager's signal, which is indicated by the
log lines -
{code:java}
13:54:28.397 [Service Thread] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET19 Setting dumpData to true
13:54:28.398 [Service Thread] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET2 Setting dumpData to true
13:54:28.398 [Service Thread] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET10 Setting dumpData to true
13:54:28.398 [Service Thread] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET1 Setting dumpData to true
{code}
However only three of them actually proceeded with dumping the data and
notifying the MemoryManager, which is indicated by the log lines -
{code:java}
13:54:33.667 [pool-3-thread-2] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET2 Finished saving data to disk. Notifying memory listener.
13:54:34.588 [pool-3-thread-4] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET19 Finished saving data to disk. Notifying memory listener.
13:54:35.438 [pool-3-thread-3] INFO o.a.j.o.i.i.d.f.TraverseAndSortTask -
TAST-NSET10 Finished saving data to disk. Notifying memory listener.{code}
After this newer tasks weren't able to register and process stuck in some cases.
We need to investigate and fix such issues.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
