[
https://issues.apache.org/jira/browse/OAK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joerg Hoh closed OAK-11157.
---------------------------
> indexing-job/parallel download: if one of the download tasks fails, the
> download is interrupted but considered as successful
> ----------------------------------------------------------------------------------------------------------------------------
>
> Key: OAK-11157
> URL: https://issues.apache.org/jira/browse/OAK-11157
> Project: Jackrabbit Oak
> Issue Type: Bug
> Components: indexing
> Reporter: Nuno Santos
> Priority: Minor
> Fix For: 1.72.0
>
>
> The logic that handles termination of download tasks is not checking for
> failure of the task, assumes that it succeeded.
> {noformat}
> 08:30:40.556 [mongo-dump-ascending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Traversing:
> DownloadRange{lastModifiedFrom=0,
> lastModifiedToInclusive=9223372036854775807, startAfterDocumentID='null'}.
> Query: And Filter{filters=[And Filter{filters=[Operator
> Filter{fieldName='_modified', operator='$gte', value=0}, Operator
> Filter{fieldName='_modified', operator='$lte',
> value=9223372036854775807}]},...
> 08:30:40.565 [mongo-dump-descending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Selected server: ...
> 08:30:40.566 [mongo-dump-ascending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Selected server: ...
> 08:30:42.674 [mongo-dump-ascending] WARN
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Error during download:
> java.lang.IllegalStateException: Document does not have _id or _modified
> field: {"_id": "*"...
> 08:30:42.674 [mongo-dump-ascending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Thread finished downloading.
> Unregistering.
> 08:30:42.674 [mongo-dump] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Ascending download task has
> completed. Cancelling descending download task.
> 08:30:42.674 [mongo-dump] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Cancelling download for
> DESCENDING order task, closing Mongo cursor.
> 08:30:42.701 [mongo-dump] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Downloading documents
> modified since the start of the download: _modified >= 1727857085
> 08:30:42.701 [mongo-dump] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Waiting for download of
> updated documents to complete.
> 08:30:42.701 [mongo-dump-updated-docs] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Traversing:
> DownloadRange{lastModifiedFrom=1727857085,
> lastModifiedToInclusive=9223372036854775807, startAfterDocumentID='null'}.
> Query: And Filter{filters=[And Filter{filters=[Operator
> Filter{fieldName='_modified', operator='$gte', value=1727857085}, Operator
> Filter{fieldName='_modified', operator='$lte', value=9223372036854775807}]},
> And Filter{filters=[Operator Filter{fieldName='_id', operator='$in', ...
> 08:30:42.702 [mongo-dump-updated-docs] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Selected server: ...
> 08:30:42.703 [mongo-dump-descending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Download task was
> cancelled: com.mongodb.MongoInterruptedException: Interrupted acquiring a
> permit to retrieve an item from the pool
> 08:30:42.704 [mongo-dump-descending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Finished download task.
> Dumped 2141 documents. Rate: 1070.50 nodes/s, 3853800.00 nodes/hr, 8.24
> MiB/s. Elapsed 00:00:02, docsFiltered: 1, longPathsFiltered: 0
> 08:30:42.704 [mongo-dump-descending] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Thread finished downloading.
> Unregistering.
> 08:30:42.738 [mongo-dump-updated-docs] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Enqueueing last block with
> 95 elements, estimated size: 420.18 KiB
> 08:30:42.738 [mongo-dump-updated-docs] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Finished download task.
> Dumped 95 documents. Rate: N/A nodes/s, N/A nodes/hr, N/A /s. Elapsed
> 00:00:00, docsFiltered: 1, longPathsFiltered: 0
> 08:30:42.738 [mongo-dump-updated-docs] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoServerSelector - Thread finished downloading.
> Unregistering.
> 08:30:42.738 [mongo-dump] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Shutting down download
> thread pool.
> 08:30:42.739 [mongo-dump] INFO
> o.a.j.o.i.i.d.f.p.PipelinedMongoDownloadTaskNew - Download thread pool
> shutdown complete.
> 08:30:42.739 [mongo-dump] INFO o.a.j.o.i.i.d.f.p.DownloadStageStatistics -
> Publishing download stage statistics
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
