Re: Fetching 1000 documents taking around 30ms

2019-03-02 Thread Erick Erickson
“Is this expected” Yes. For each document, if there is any field with stored=true that does _not_ have docValues=true or is flagged as useDocValuesAsStored=false, there is 1> a disk seek to read the stored data from the fdt file 2> decompression of the data read in <1>, 16K block minimum. So get

Fetching 1000 documents taking around 30ms

2019-03-02 Thread Venkat Kranthi Chalasani
Hi, I have an index of ~4M documents. My queries are running in 1-2ms but fetching the top hits (~1000 documents) takes around 30ms. Is this expected? If it is, I was wondering if maintaining an application cache with docId as a key is ok. I understand docIds are ephemeral as documents are add