JingsongLi opened a new pull request, #11328:
URL: https://github.com/apache/paimon/pull/11328

   ### Purpose
   
   Exact cosine scoring squares float coordinates. For very large finite 
coordinates the norms can overflow; for very small ones they can round to zero. 
The resulting score can cause an antiparallel vector to win Top-1 over the 
parallel vector.
   
   Recompute the dot product and norms in double precision when the 
single-precision terms overflow or lose their normal range. This applies to the 
exact scorer used by Data Evolution and primary-key vector search.
   
   ### Tests
   
   - An unindexed Data Evolution table with parallel, antiparallel, and 
orthogonal vectors returned the antiparallel row before this change at both 
large and small scales. Each query now returns the parallel row with score 1.
   - JDK 8 Maven `verify` passed 249 targeted tests covering vector and 
full-text search, scalar filtering, and BTree Top-N.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to