airborne12 opened a new pull request, #60415:
URL: https://github.com/apache/doris/pull/60415
## Summary
Cherry-pick of #59117 to branch-4.0.
This PR adds support for multiple tokenize indexes on a single column,
allowing users to create multiple inverted indexes with different analyzers
(e.g., chinese, english, standard) on the same text column and query using
specific analyzers.
Key changes:
- Add `USING ANALYZER` syntax for MATCH predicates
- Support multiple inverted indexes with different analyzers on the same
column
- Add analyzer key normalization and matching logic in BE
- Add `filterIndexesByAnalyzer` method in OlapTable for index selection
## Conflicts Resolved
- `MatchPredicate.java` - Updated constructor signatures for analyzer support
- `OlapTable.java` - Added imports and new filtering methods
- `ExpressionTranslator.java` - Updated to use new MatchPredicate constructor
## Test plan
- [x] Regression tests included in original PR
- [x] Unit tests for analyzer key matcher and normalizer
## Check List (For Author)
- Test
- [x] Regression test
- [x] Unit Test
- [ ] Manual test
- [ ] No need to test
- Behavior changed:
- [ ] No.
- [x] Yes. Adds new `USING ANALYZER` syntax for MATCH predicates.
- Does this need documentation?
- [x] Yes. (covered by original PR documentation)
## Check List (For Reviewer who merge this PR)
- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
