stdpain commented on issue #6075: URL: https://github.com/apache/incubator-doris/issues/6075#issuecomment-867548547
@xinghuayu007 It is difficult to find a metric to determine the effectiveness of a runtime filter; the exact effectiveness of RuntimeFilter still depends on the filtering rate and the amount of data filtering involved in saving. So by default RuntimeFilter uses a more conservative approach, generating IN Filter only when the hash table is not large to maintain consistency with the old logic. After a few iterations of RuntimeFilter, the speed of building RuntimeFilter has improved significantly compared to 0.14.12. Also, the storage engine has less cache misses when using short-circuit filtering, so the performance of the original query is slowed down very little. RuntimeFilter is tested with mode=7 in TPCDS, and no significant query speed reduction is found. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
