On 2021-02-23 1:53 AM, Danilo Tomasoni wrote:
Thank you all for the suggestions,
The OS is not windows, it's centos, a colleague thinks that even on linux
defragmenting can improve performance about 2X because it keeps the data
contiguous on disk.
You may want to check the filesystem you're
print this e-mail unless you really need to
Da: Walter Underwood
Inviato: lunedì 22 febbraio 2021 18:25
A: solr-user@lucene.apache.org
Oggetto: Re: defragmentation can improve performance on SATA class 10 disk
~1 rpm ?
[CAUTION: EXTERNAL SENDER]
[
True, but Windows does cache files. It has been a couple of decades since I ran
search on Windows, but Ultraseek got large gains from setting some sort of
system property to make it act like a file server and give file caching equal
priority with program caching.
wunder
Walter Underwood
On 2021-02-22 11:18 AM, Shawn Heisey wrote:
The OS automatically uses unallocated memory to cache data on the disk.
Because memory is far faster than any disk, even SSD, it performs better.
Depends on the os, from "defragmenting solrdata folder" I suspect the OP
is on windows whose
On 2/22/2021 12:52 AM, Danilo Tomasoni wrote:
we are running a solr instance with around 41 MLN documents on a SATA class 10
disk with around 10.000 rpm.
We are experiencing very slow query responses (in the order of hours..) with an
average of 205 segments.
We made a test with a normal pc and
A forced merge might improve speed 20%. Going from spinning disk to SSD
will improve speed 20X or more. Don’t waste your time even thinking about
forced merges.
You need to get SSDs.
The even bigger speedup is to get enough RAM that the OS can keep the
Solr index files in file system buffers.
On 2021-02-22 1:52 AM, Danilo Tomasoni wrote:
Hello all,
we are running a solr instance with around 41 MLN documents on a SATA class 10
disk with around 10.000 rpm.
We are experiencing very slow query responses (in the order of hours..) with an
average of 205 segments.
We made a test with a
Hi Danilo, following my experience now SSD or RAM Disk is the only way to
speed up queries. It depends on your storage occupation of your 41M docs.
If you don't have Enterprise SSD you can add consumer SSD as a fast cache
(linux caching modules "flashcache / bcache" are able to use cheap SSD as a
Hello all,
we are running a solr instance with around 41 MLN documents on a SATA class 10
disk with around 10.000 rpm.
We are experiencing very slow query responses (in the order of hours..) with an
average of 205 segments.
We made a test with a normal pc and an SSD disk, and there the same solr
