[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890751#comment-16890751 ] Tim Owen commented on SOLR-9961: Thanks.. yes indeed, we had to cherry pick the patch for that into our

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890741#comment-16890741 ] Mikhail Khludnev commented on SOLR-9961: bq. backups to HDFS and to S3 (via S3A) [~TimOwen],

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890015#comment-16890015 ] Tim Owen commented on SOLR-9961: Thanks Mikhail, we're interested in your findings too, as we do backups

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889991#comment-16889991 ] Mikhail Khludnev commented on SOLR-9961: [~TimOwen], I'm not able to measure it now, your

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889969#comment-16889969 ] Tim Owen commented on SOLR-9961: Just curious if you tried increasing the copy buffer size as per

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889599#comment-16889599 ] Mikhail Khludnev commented on SOLR-9961: Linking a bunch of jiras proving that

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888695#comment-16888695 ] Lucene/Solr QA commented on SOLR-9961: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876525#comment-16876525 ] Mikhail Khludnev commented on SOLR-9961: Design would be: * {{BackupRepositoryFactory}} holds

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875750#comment-16875750 ] Lucene/Solr QA commented on SOLR-9961: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875740#comment-16875740 ] Mikhail Khludnev commented on SOLR-9961: Here's the question: what should hold thread pool,

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16875448#comment-16875448 ] Lucene/Solr QA commented on SOLR-9961: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874521#comment-16874521 ] Mikhail Khludnev commented on SOLR-9961: Attached dirty draft. Really dirty. Turns out backup

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863500#comment-16863500 ] Mikhail Khludnev commented on SOLR-9961: {quote}This can even benefit backup operation. What do

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705257#comment-16705257 ] Tim Owen commented on SOLR-9961: We considered using this patch locally, but actually found the problem

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822297#comment-15822297 ] Hrishikesh Gadre commented on SOLR-9961: [~thelabdude] I think this is a great improvement! Couple

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822190#comment-15822190 ] Timothy Potter commented on SOLR-9961: -- The other thing I found here is HdfsDirectory is closing a

[jira] [Commented] (SOLR-9961) RestoreCore needs the option to download files in parallel.

[ https://issues.apache.org/jira/browse/SOLR-9961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15821860#comment-15821860 ] Timothy Potter commented on SOLR-9961: -- Patch is not ready for commit. We need to think about how to