TheR1sing3un commented on code in PR #9805:
URL: https://github.com/apache/paimon/pull/9805#discussion_r4011835987
##########
paimon-python/pypaimon/table/source/vector_search_read.py:
##########
@@ -451,6 +460,43 @@ def _eval_batch(self, row_range_start, row_range_end,
vector_index_files,
future.add_done_callback(lambda _: reader.close())
return future
+ def _search_index_splits(self, splits, query, search_limit, pre_filters,
batch=False):
+ # Native readers finish their search before returning a completed
Future.
+ # Schedule the entire open/search/close operation, not just
Future.result().
+ key = "vector.search.parallelism"
Review Comment:
reuse CoreOptions.GLOBAL_INDEX_THREAD_NUM now
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
