On 12/11/2012 11:59 AM, Yonik Seeley wrote: > On Tue, Dec 11, 2012 at 2:32 PM, Greg Bowyer <gbow...@fastmail.co.uk> wrote: >> Yes the index can fit in ram on the boxes I am testing with - Its the >> main rationale for sharding to make sure that we can hold an index in >> ram at all times. >> >> MADV_WILLNEED might be rather bad if the index is bigger than ram >> (something to test maybe) > Agree. And the largest part of the index is often stored fields, > which have a random access pattern. > MADV_RANDOM? Maybe I would have to go digging to see if its implemented.
With this said, so far its a hypothesis supported by weak experimentation so I need to get it under the benchmarking suite to really be sure > > > -Yonik > http://lucidworks.com > > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org > For additional commands, e-mail: dev-h...@lucene.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
