Rich Freeman <rich0 <at> gentoo.org> writes:
> One thing that both zfs and bcachefs seem to be doing (not that I'm in > an expert in either) is taking a multi-tiered approach to storage. > That is, writes can go into a durable log on a separate device and > then be consolidated onto more long-term storage. I suspect that this > might help with some of the fragmentation issues that you run into > with COW. Then again, I don't know how its performance would compare > to just dumping everything right to a single tier like btrfs and then > just periodically having some kind of smart defragmenter that just > cleans up the stuff that really needs it. I have done quite a bit of research on many aspects of memory and storage. It is probably the single biggest issue with how best to 'cluster' systems and resources and the optimal solutions seem to be numerous, depending on the goals and trade-offs of a specific application. That said, there are as many ideas as there are project leads; so the space in full of experimentation. With RDMA and compiler enhancements in the mix, I do not think issues will narrow any time soon. Sorry I could not be of more help; I swim in these waters pretty much every day, looking for conclusions......still looking...... hth, James
