Thomas Mueller created OAK-12004:
------------------------------------
Summary: Datastore: speedup datastore copy / download
Key: OAK-12004
URL: https://issues.apache.org/jira/browse/OAK-12004
Project: Jackrabbit Oak
Issue Type: Improvement
Reporter: Thomas Mueller
I found that using the command line to download binaries (specially Lucene
index binaries in my case) from far away (eg. download from Asia, if the
datastore is hosted in US east) can take a long time, sometimes 5 minutes for
20 GB.
I found a way to speed up download, by using more threads. Also, one of the
challenges is that some files are really large (sometimes GBs) and some are
small. I found that splitting large files into chunks of eg. 16 MB can speed up
download.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
