[
https://issues.apache.org/jira/browse/SOLR-17149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17815018#comment-17815018
]
ASF subversion and git services commented on SOLR-17149:
--------------------------------------------------------
Commit c98a8f655ceca19ff641bbf675dad74b42df1264 in solr's branch
refs/heads/jira/SOLR-16858 from Pierre Salagnac
[ https://gitbox.apache.org/repos/asf?p=solr.git;h=c98a8f655ce ]
SOLR-17149: Fix backup/restore for large collections. (#2243)
9.4 introduced a new executor used for "expensive" operations, that
relied on a bounded queue. This caused backup operations to fail on
collections large enough to hit this queue capacity.
This commit fixes this problem by making the executor queue unbounded.
---------
Co-authored-by: Pierre Salagnac <[email protected]>
Co-authored-by: Jason Gerlowski <[email protected]>
> Cannot backup/restore large collection.
> ---------------------------------------
>
> Key: SOLR-17149
> URL: https://issues.apache.org/jira/browse/SOLR-17149
> Project: Solr
> Issue Type: Bug
> Security Level: Public(Default Security Level. Issues are Public)
> Affects Versions: 9.4
> Reporter: Pierre Salagnac
> Assignee: Jason Gerlowski
> Priority: Major
> Fix For: 9.5
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
>
> There is a regression introduced in version 9.4 with SOLR-16879.
>
> We cannot backup collections with more than 10 shards per node. The thread
> pool is rejecting new tasks with following error:
> {noformat}
> SolrException: Could not backup all shards
> Task
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda...
> rejected from
> org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor[Running,
> pool size = 5, active threads = 5, queued tasks = 5, completed tasks = 30]"
> {noformat}
> {{expensiveExecutor}} thread pool executor is
> [created|https://github.com/apache/solr/blob/releases/solr/9.4.1/solr/solrj/src/java/org/apache/solr/common/util/ExecutorUtil.java#L170-L174]
> with 5 max threads and bounded queue of the same size (5), so the total
> number of tasks is limited to 10 and all the other tasks are immediately
> rejected.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
