liangjie3138 opened a new issue, #8825:
URL: https://github.com/apache/paimon/issues/8825

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Motivation
   
   Flink’s vector_search procedure currently performs vector candidate search 
locally in the procedure process. For large tables with many index splits, raw 
data ranges, or primary-key buckets, this limits scalability and prevents the 
search from utilizing cluster resources.
   
   ### Solution
   
   Add an optional distributed execution mode for Flink vector search. Large 
searches are dispatched to a bounded Flink job and merged into a global TopK 
result, while small searches retain the existing local execution path to avoid 
unnecessary job startup overhead.
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to