Thanks for the comments all, very valuable. My use case is reading a large file that does not fit in memory, (circa 45GB compressed) so it has to be streaming.
After reading the file, I then want to do some basic splitting of the lines, and then hash each part with xxhash. And @cblake thanks for the link to thread 5103, will give it a read.
