crodier edited a comment on issue #7932: CompressionUtils performance improvement ask URL: https://github.com/apache/incubator-druid/issues/7932#issuecomment-506539897 Yes, local deep storage, to a disk drive. The "atomic" update yes, which was enabled last year, made it 20x slower. You can still do the atomic update, but need to use the Buffered stream, not FilterOutput stream. It is not the fsync, it is the FilterOutputStream. This doesn't use buffers, is pushing a byte at a time? The change (almost certainly) is merely to use, a buffered output stream, need not remove the Atomic fixes for corruption issues. Thx again!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
