JingsongLi opened a new pull request, #8316:
URL: https://github.com/apache/paimon/pull/8316

   ## Summary
   
   Support `global-index.search-mode=full` for full-text search by searching 
both existing full-text index files and raw row ranges that are not covered by 
those indexes. This aligns full-text search behavior with global index FULL 
mode while keeping FAST mode index-only.
   
   ## Changes
   
   - Add raw full-text search splits for uncovered row ranges when full mode is 
enabled.
   - Read raw rows with `_ROW_ID`, build temporary in-memory full-text index 
files using the same global index writer/reader path, and merge those results 
with indexed results.
   - Preserve partition filters for raw full-text scans.
   - Serialize full-text search splits explicitly, including index file 
metadata and raw row ranges.
   - Avoid caching one-off Tantivy raw search readers by allowing 
`tantivy.searcher-pool.max-size=0` to create a non-pooled indexer.
   - Add coverage for full mode raw search, partition filtering, partially 
indexed multi-column queries, and Tantivy pool disabling.
   
   ## Testing
   
   - [x] `mvn -pl paimon-core -am -Pfast-build -DfailIfNoTests=false 
-Dtest=FullTextSearchBuilderTest test`
   - [x] `mvn -pl paimon-tantivy/paimon-tantivy-index -am -Pfast-build 
-DfailIfNoTests=false -Dtest=TantivyFullTextGlobalIndexerFactoryTest test`
   - [x] `git diff --check master..HEAD`
   
   ## Notes
   
   `-Pfast-build` skips some full verification checks such as 
spotless/enforcer, so this PR has focused unit coverage plus whitespace 
validation.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to