bq. It seems store field is not perform well.
Stored fields perform exactly as intended. Consider the situation
where very large text fields are stored. Making those into something
like docValues would be a very poor tradeoff, even if it were
possible. Not to mention highlighting etc. There are
I simple tried MultiDocValues.getBinaryValues to fetch result by doc value, it
improves a lot, 2000 result takes only 5 ms. I even encode all the returnable
fields to binary docvalues and then decode them, the results is also good
enough. It seems store field is not perform well In our
Don't use that call. You're exactly right, it goes out to disk, reads
the doc, decompresses it (16K blocks minimum per doc IIUC) all just to
get the field. 2,000 in 50ms actually isn't bad for all that work ;).
This sounds like an XY problem. You're asking how to speed up fetching
docs, but not
can you post your query string?
Best
On 8/27/18 10:33 AM, alex stark wrote:
In same machine, no net latency. When I reduce to 500 limit, it takes 20ms, which is also slower
than I expected. btw, indexing is stopped. On Mon, 27 Aug 2018 22:17:41 +0800
wrote yes, it should be less
In same machine, no net latency. When I reduce to 500 limit, it takes 20ms,
which is also slower than I expected. btw, indexing is stopped. On Mon, 27
Aug 2018 22:17:41 +0800 wrote yes, it should be
less than a ms actually for those type of files. index and search on the same
yes, it should be less than a ms actually for those type of files.
index and search on the same machine? no net latency in between?
Best
On 8/27/18 10:14 AM, alex stark wrote:
quite small, just serveral simple short text store fields. The total index size is
around 1 GB (2m doc). On
quite small, just serveral simple short text store fields. The total index size
is around 1 GB (2m doc). On Mon, 27 Aug 2018 22:12:07 +0800
wrote Alex,- how big are those docs? Best regards
On 8/27/18 10:09 AM, alex stark wrote: > Hello experts, I am wondering is there
any way to
Alex,-
how big are those docs?
Best regards
On 8/27/18 10:09 AM, alex stark wrote:
Hello experts, I am wondering is there any way to improve document fetching
performance, it appears to me that visiting from store field is quite slow. I
simply tested to use indexsearch.doc() to get 2000
