ashoka1981 opened a new pull request, #4183:
URL: https://github.com/apache/doris-website/pull/4183

   ## Versions 
   
   - [x] dev
   - [x] 4.x
   - [ ] 3.x
   - [ ] 2.1 or older (not covered by version/language sync gate)
   
   ## Languages
   
   - [x] Chinese
   - [x] English
   
   ## Docs Checklist
   
   - [x] Checked by AI
   - [ ] Test Cases Built
   - [x] Updated required version and language counterparts, or explained why 
not
   - [x] If only one language changed, confirmed whether source/translation 
counterparts need sync
   
   ## What this documents
   
   Companion to the feature tracked in apache/doris#68626 (code PR to follow; 
it will be linked here).
   
   - New AI resource property **`ai.max_concurrency`** (optional, default `1`): 
the maximum number of batch requests one execution instance keeps in flight for 
the scalar AI functions (`ai_filter`, `ai_classify`, `ai_sentiment`, ...). `1` 
keeps today's behaviour (batches of a block sent one after another); higher 
values overlap them. Changeable with `ALTER RESOURCE`; does not apply to 
`embed` and `ai_agg`. Batch size stays with the session variable 
`ai_context_window_size`.
   - New BE configs **`ai_function_thread_pool_thread_num`** (default 64) and 
**`ai_function_thread_pool_queue_size`** (default 10240) for the shared pool 
that runs those requests.
   
   Pages touched (en + zh-CN, `docs/` + `versioned_docs/version-4.x`): 
`sql-manual/sql-functions/ai-functions/overview.md` (parameter list + example), 
`ai/ai-function-overview.md` (parameter table), 
`key-features/llm-sql-functions.mdx` (en only; no zh-CN counterpart exists), 
`admin-manual/config/be-config.md`.
   
   3.x is not updated because the feature is not in 3.x.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to