andygrove commented on PR #7237: URL: https://github.com/apache/datafusion-comet/pull/7237#issuecomment-6803561513
Added both cases to `CometInMemoryCacheBenchmark --stats-only` (`70eb4dcaeb`): three string columns with 55 to 75 byte keys that share their first 40 to 50 bytes (URLs, file paths and S3 keys), and three with 1 to 6 byte keys that differ in the first word. Before, after, before, after, before, after in one session, medians of the best time over 5M rows. The long-prefix case goes from 227 ms to 163 ms (28% less) and the short-key case from 130 ms to 53 ms (59% less). The gain is smaller where the comparison has to read five or six words before it finds a difference, which is what you expected, but it still pays. The decimal control stayed at 20 ms in every run. The description has the table. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
