The GitHub Actions job "Required Checks" on 
texera.git/fix/keywordsearch-casesensitive-punct-6761 has failed.
Run started by GitHub user kz930 (triggered by kz930).

Head commit for run:
a8ea8825310323149ba43aceb492bc6f2ec69729 / kary zheng <[email protected]>
fix(KeywordSearch): keep punctuation handling consistent in case-sensitive mode

CaseSensitiveAnalyzer used a bare WhitespaceTokenizer, which splits only on
whitespace and leaves punctuation glued to tokens (e.g. "...perfect."
tokenizes to "perfect."). The default StandardAnalyzer splits on Unicode word
boundaries and strips punctuation. So toggling "case sensitive" silently
changed punctuation handling too: a term like "perfect" stopped matching
"...perfect.", even though only case behavior was supposed to change.

Switch CaseSensitiveAnalyzer to StandardTokenizer (the same tokenizer
StandardAnalyzer uses) and simply omit the LowerCaseFilter. Case sensitivity
is now the only behavioral difference from the default analyzer.

Add a regression test asserting "perfect" matches "...perfect." in
case-sensitive mode.

Closes #6761

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>

Report URL: https://github.com/apache/texera/actions/runs/29961148746

With regards,
GitHub Actions via GitBox

Reply via email to