QuakeWang opened a new pull request, #8294:
URL: https://github.com/apache/paimon/pull/8294
### Purpose
`weighted_score` previously fused hybrid search routes by directly summing
`weight * raw_score`.
This is incorrect for heterogeneous routes because vector similarity scores
and full-text/BM25 scores use different scales. A route with larger numeric
scores can dominate the final ranking, making route weights ineffective.
### Tests
- `mvn -pl paimon-common -Dtest=HybridSearchRankerTest test`
- `PYTHONPATH=paimon-python pytest
paimon-python/pypaimon/tests/hybrid_search_ranker_test.py -q`
- `mvn -pl paimon-spark/paimon-spark-ut -am -DfailIfNoTests=false
-DwildcardSuites=org.apache.paimon.spark.sql.HybridSearchTest -Dtest=none test`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
