xiangfu0 opened a new pull request, #19946: URL: https://github.com/apache/pinot/pull/19946
Shared LZ4 archive creation took 1,124.207 s and extraction 31.355 s for a 157.25 MB segment; use the existing lz4-java fast writer and buffer extraction, preserving Commons readers, frame checksums, and rate-limited sync behavior. Reproduce by creating/extracting a `.tar.lz4` containing many short matches. The new median is 0.185 s / 0.514 s, with a 143.50 MB archive versus 117.56 MB before (+22.06%); this affects existing LZ4 writers and trades compression ratio for usability. Warm-cache Mac M2 Max/JDK 25: one old sample, three new runs; all 20 file hashes match. Split from #19898; Zstd remains preferred there and gzip remains its default. Validation: 12 focused JDK 25 tests, including a 5 MiB multi-block Commons-reader compatibility test, affected-module precommit checks, and independent review passed. Detailed four-codec measurements remain in #19898. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
