Our first cut at this is generating about 4x the IO, we are now
saturating on disk.
These results are not definitive, they are eyeball.
Jason Venner wrote:
I have the write side working, the read side seems to be more complex
and I am digging into it.
Doug Cutting wrote:
Ted Dunning wrote:
It seems reasonable that (de)-serialization could be done in threaded
fashion and then just block on the (read) write itself.
That would require a buffer per thread, e.g., replacing Writer#buffer
with a ThreadLocal of DataOutputBuffers. The deflater-related
objects would also need to accessed through ThreadLocals. That could
work.
Doug
