Sasha Pachev wrote:
Also fine tune the I/O to eliminate waste. Have a buffer, read chunks into it, then deal with each chunk in place one at a time. Do not copy anything if you can at all avoid it! Figure out a way to deal with the words being chopped off at the end of I/O block. In short, you have essentially full control on the CPU level - use it!
If anyone wants to tackle this, BTW, mmap() should make it easy to avoid copying.
Shane /* PLUG: http://plug.org, #utah on irc.freenode.net Unsubscribe: http://plug.org/mailman/options/plug Don't fear the penguin. */
