Nuno Santos created OAK-11157:
---------------------------------
Summary: indexing-job/parallel download: if one of the download
tasks fails, the download is interrupted but considered as successful
Key: OAK-11157
URL: https://issues.apache.org/jira/browse/OAK-11157
Project: Jackrabbit Oak
Issue Type: Bug
Components: indexing
Reporter: Nuno Santos
The logic that handles termination of download tasks is not checking for
failure of the task, assumes that it succeeded.
{noformat}
08:30:40.556 [mongo-dump-ascending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Traversing:
DownloadRange{lastModifiedFrom=0, lastModifiedToInclusive=9223372036854775807,
startAfterDocumentID='null'}. Query: And Filter{filters=[And
Filter{filters=[Operator Filter{fieldName='_modified', operator='$gte',
value=0}, Operator Filter{fieldName='_modified', operator='$lte',
value=9223372036854775807}]},...
08:30:40.565 [mongo-dump-descending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Selected server: ...
08:30:40.566 [mongo-dump-ascending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Selected server: ...
08:30:42.674 [mongo-dump-ascending] WARN
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Error during download:
java.lang.IllegalStateException: Document does not have _id or _modified field:
{"_id": "*"...
08:30:42.674 [mongo-dump-ascending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Thread finished downloading.
Unregistering.
08:30:42.674 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew
- Ascending download task has completed. Cancelling descending download task.
08:30:42.674 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew
- Cancelling download for DESCENDING order task, closing Mongo cursor.
08:30:42.701 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew
- Downloading documents modified since the start of the download: _modified >=
1727857085
08:30:42.701 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew
- Waiting for download of updated documents to complete.
08:30:42.701 [mongo-dump-updated-docs] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Traversing:
DownloadRange{lastModifiedFrom=1727857085,
lastModifiedToInclusive=9223372036854775807, startAfterDocumentID='null'}.
Query: And Filter{filters=[And Filter{filters=[Operator
Filter{fieldName='_modified', operator='$gte', value=1727857085}, Operator
Filter{fieldName='_modified', operator='$lte', value=9223372036854775807}]},
And Filter{filters=[Operator Filter{fieldName='_id', operator='$in', ...
08:30:42.702 [mongo-dump-updated-docs] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Selected server: ...
08:30:42.703 [mongo-dump-descending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Download task was cancelled:
com.mongodb.MongoInterruptedException: Interrupted acquiring a permit to
retrieve an item from the pool
08:30:42.704 [mongo-dump-descending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Finished download task.
Dumped 2141 documents. Rate: 1070.50 nodes/s, 3853800.00 nodes/hr, 8.24 MiB/s.
Elapsed 00:00:02, docsFiltered: 1, longPathsFiltered: 0
08:30:42.704 [mongo-dump-descending] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Thread finished downloading.
Unregistering.
08:30:42.738 [mongo-dump-updated-docs] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Enqueueing last block with 95
elements, estimated size: 420.18 KiB
08:30:42.738 [mongo-dump-updated-docs] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Finished download task.
Dumped 95 documents. Rate: N/A nodes/s, N/A nodes/hr, N/A /s. Elapsed 00:00:00,
docsFiltered: 1, longPathsFiltered: 0
08:30:42.738 [mongo-dump-updated-docs] INFO
o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Thread finished downloading.
Unregistering.
08:30:42.738 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew
- Shutting down download thread pool.
08:30:42.739 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew
- Download thread pool shutdown complete.
08:30:42.739 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.DownloadStageStatistics -
Publishing download stage statistics
{noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
