JingsongLi opened a new pull request, #8467: URL: https://github.com/apache/paimon/pull/8467
## Summary Adapt Paimon's full-text global index integration to the new native `paimon-full-text` module and the latest standalone full-text API. This removes the old Tantivy-facing module/API surface, switches the index identifier to `full-text`, and makes Java/Python/Spark pass a table column plus raw query JSON string directly. ## Changes - Rename `paimon-tantivy` to `paimon-full-text`, including CI, module wiring, service registration, class/package names, file type names, and docs. - Replace `FullTextQuery` helper usage with direct query strings across Java, Spark, Python, and hybrid search APIs. - Update full-text scan/read to distinguish indexed and raw full-text splits and support raw fallback for uncovered row ranges in full/detail search modes. - Align PyPaimon full-text implementation with Java, including native reader/writer names, `full-text.` option handling, raw split search, and tests. - Rewrite full-text documentation around the `paimon-full-text` native engine, `full-text` index identifier, option prefixing, Spark TVF signature, and query JSON DSL. ## Testing - `git diff --check` - `python -m pytest pypaimon/tests/vector_search_filter_test.py pypaimon/tests/global_index_build_test.py pypaimon/tests/multimodal_table_test.py -q` - `yarn build` - `mvn -pl paimon-common,paimon-core,paimon-full-text -am -Pfast-build -DfailIfNoTests=false -Dtest=FullTextSearchTest,FullTextSearchBuilderTest,FileTypeTest,NativeFullTextIndexOptionsTest,NativeFullTextGlobalIndexerFactoryTest,NativeFullTextGlobalIndexTest,JavaPyNativeFullTextE2ETest test` - `mvn -pl paimon-spark/paimon-spark-common -am -Pfast-build -DfailIfNoTests=false -DwildcardSuites=org.apache.paimon.spark.catalyst.plans.logical.VectorSearchQueryTest -Dtest=none test` ## Notes - `yarn build` reports the existing site-wide `/docs/master/concepts/overview` broken-link warning, but the build succeeds. - Native full-text integration tests that require the native library are skipped when the local library is unavailable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
