geoffreyclaude opened a new pull request, #23017: URL: https://github.com/apache/datafusion/pull/23017
## Which issue does this PR close? - Part of #19241. - Stacked on #23016. - Extracted from #19390. ## Rationale for this change This is one draft PR in the `IN LIST` optimization stack. It reuses commit `a19d00b13` verbatim so the existing stack can be reviewed one step at a time. This extends the two-stage string-filter idea to legacy `Utf8` and `LargeUtf8` arrays where short strings can be encoded compactly for quick rejection. ## What changes are included in this PR? - Adds `Utf8TwoStageFilter` for `Utf8` and `LargeUtf8` values. - Encodes short string length and prefix into a compact value for the first-stage lookup. - Falls back to the generic filter when the constant list is not suitable for this path. ## Are these changes tested? Covered by the existing `IN LIST` test suite from the original stack. ## Are there any user-facing changes? No user-facing API changes. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
