What I was thinking is that memory and really fast SSDs are getting cheap and that you maybe didn't need fancy ways of using them. I think separating the read file from the write file. And have the read file on a ram disk or SSD mounted in to a directory, which would be copied when the writing was done with a possible compact step in between. This would be an option in the config file.
What do you think of it? Regards, Olafur Arason
