JingsongLi opened a new pull request, #8651:
URL: https://github.com/apache/paimon/pull/8651

   ## Summary
   
   Build on #8649 by adding LSM-style incremental maintenance for primary-key 
full-text index archives.
   
   ## Changes
   
   - add primary-key full-text index configuration and schema validation
   - integrate bucket-local full-text maintenance with 
`BucketedPrimaryKeyIndexMaintainer`
   - reuse `PrimaryKeyIndexLevels` and the Vector/Sorted compaction options to 
consolidate similarly sized archives and rebuild stale coverage
   - publish archive replacements through the existing append/compaction 
increments, including asynchronous completion, abort, rollback, and cleanup 
handling
   - document the multi-source archive and LSM maintenance design
   
   ## Scope
   
   - no `index.type` option; full text remains the implicit/default index type
   - no definition fingerprint is persisted
   - query/search integration and Flink/Spark exposure are deferred to 
follow-up PRs
   
   ## Testing
   
   - `mvn -pl paimon-core -am -DskipTests package`
   - `mvn -pl paimon-core -am -Pfast-build -DfailIfNoTests=false 
-DwildcardSuites=none 
-Dtest='PkFullTextIndexFileTest,PkFullTextBucketIndexStateTest,BucketedFullTextIndexMaintainerTest,BucketedPrimaryKeyIndexMaintainerTest,PrimaryKeyIndexDefinitionsTest,PrimaryKeyIndexWriteTest,PrimaryKeyFullTextIndexValidationTest,SchemaManagerTest'
 test`
   - `git diff --check origin/master..HEAD`
   
   The focused test set runs 84 tests.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to