jackluo923 opened a new pull request, #14632: URL: https://github.com/apache/pinot/pull/14632
This PR updates the unit tests for CLPMutableForwardIndexV2Test and CLPForwardIndexCreatorV2Test, which previously inherited trivial input data from CLPMutableForwardIndexTest and CLPForwardIndexCreatorTest. The trivial input data has been replaced with logs from real-world system (Apache hadoop). The input log file used in the updated tests is located at `pinot-segment-local/src/test/resources/data/log.jsonl.gz`. It is a JSONL file where each line represents a JSON document containing the fields `ts`, `level`, and `message`. When decompressed, the dataset is approximately 268MB in size. When this dataset is compressed with `CLPForwardIndexCreatorV2Test`, compression ratio is expected to exceed 40x using LZ4 compressor and 66x using ZSTD compressor. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
