robert engels wrote:
But that would mean we should be using at least 250k buffers for the
IndexInput ? Not the 16k or so that is the default.
Is the OS smart enough to figure out that the file is being sequentially
read, and adjust its physical read size to 256k, based on the other
concurrent IO operations. Seems this would be hard for it to figure out,
and have it not perform poorly in the general case.
Benchmarks have shown that OSes do a decent job at this. You can
increase the applications buffer sizes, but you might just end up
wasting memory if the OS is already doing the right thing. The linux
kernel dynamically increases the readahead window based on the access
pattern: the more you read sequentially, the larger the readahead window.
Doug
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
