LiteSun opened a new issue, #12072:
URL: https://github.com/apache/apisix/issues/12072
### Description
Currently, AI-related plugins only have a timeout parameter. After reviewing
the code, I found that timeout is the total of connect, read, and send timeout
durations, making it impossible to precisely control the timeout for requests
to the LLM service. This needs to be improved.
Currently:
```lua
...
local http = require("resty.http")
...
httpc:set_timeout(conf.timeout)
```
Expected:
```lua
...
local http = require("resty.http")
...
httpc:set_timeouts(connect_timeout, send_timeout, read_timeout)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
