JingsongLi opened a new pull request, #11328: URL: https://github.com/apache/paimon/pull/11328
### Purpose Exact cosine scoring squares float coordinates. For very large finite coordinates the norms can overflow; for very small ones they can round to zero. The resulting score can cause an antiparallel vector to win Top-1 over the parallel vector. Recompute the dot product and norms in double precision when the single-precision terms overflow or lose their normal range. This applies to the exact scorer used by Data Evolution and primary-key vector search. ### Tests - An unindexed Data Evolution table with parallel, antiparallel, and orthogonal vectors returned the antiparallel row before this change at both large and small scales. Each query now returns the parallel row with score 1. - JDK 8 Maven `verify` passed 249 targeted tests covering vector and full-text search, scalar filtering, and BTree Top-N. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
