RE: Stored fields and OS file caching

2014-04-05 Thread Toke Eskildsen
Vitaly Funstein [vfunst...@gmail.com] wrote: > It's a bit of a guess on my part, but I did get better write and search > performance with size <= 2K, as opposed to the default 16K. For search that sounds plausible as that is very random access heavy and the disk cache will contain a larger amount

Re: Stored fields and OS file caching

2014-04-05 Thread Jack Krupansky
. -- Jack Krupansky -Original Message- From: Adrien Grand Sent: Friday, April 4, 2014 4:50 PM To: java-user@lucene.apache.org Subject: Re: Stored fields and OS file caching Hi Vitaly, Doc values are indeed well-suited for grouping and sorting. However stored fields remain better at returning

Re: Stored fields and OS file caching

2014-04-04 Thread Vitaly Funstein
sults, DocValues are of no use. > >> > >> Uwe > >> > >> - > >> Uwe Schindler > >> H.-H.-Meier-Allee 63, D-28213 Bremen > >> http://www.thetaphi.de > >> eMail: u...@thetaphi.de > >> > >> > >> > -Or

Re: Stored fields and OS file caching

2014-04-04 Thread Adrien Grand
emen >> http://www.thetaphi.de >> eMail: u...@thetaphi.de >> >> >> > -Original Message- >> > From: Vitaly Funstein [mailto:vfunst...@gmail.com] >> > Sent: Friday, April 04, 2014 9:44 PM >> > To: java-user@lucene.apache.org >> &g

Re: Stored fields and OS file caching

2014-04-04 Thread Vitaly Funstein
Bremen > http://www.thetaphi.de > eMail: u...@thetaphi.de > > > > -Original Message- > > From: Vitaly Funstein [mailto:vfunst...@gmail.com] > > Sent: Friday, April 04, 2014 9:44 PM > > To: java-user@lucene.apache.org > > Subject: Stored fields and OS file caching &g

RE: Stored fields and OS file caching

2014-04-04 Thread Uwe Schindler
://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Vitaly Funstein [mailto:vfunst...@gmail.com] > Sent: Friday, April 04, 2014 9:44 PM > To: java-user@lucene.apache.org > Subject: Stored fields and OS file caching > > I have heard here that stored fields do

Stored fields and OS file caching

2014-04-04 Thread Vitaly Funstein
I have heard here that stored fields don't work well with OS file caching. Could someone elaborate on why that is? I am using Lucene 4.6 and we do use stored fields but not doc values; it appears most of the benefit from the latter comes as improvement in sorting performance, and I don't actually u