XZHUNZHUN opened a new issue, #12129:
URL: https://github.com/apache/apisix/issues/12129

   ### Description
   
   通过apisix调用大模型,使用 stream: true 
流式输出,虽然结果是流式的格式,但响应会等待全部chunk返回才会一起输出,感觉是不是有个缓存的配置,求助
   
   ### Environment
   
   - APISIX version (run `apisix version`): 3.9.1
   - Operating system (run `uname -a`): x86 86 GNU/linux
   - OpenResty / Nginx version (run `openresty -V` or `nginx 
-V`):openresty/1.25.3.1
   - etcd version, if relevant (run `curl 
http://127.0.0.1:9090/v1/server_info`):3.5.5.4
   - APISIX Dashboard version, if relevant: 3.0.1
   - Plugin runner version, for issues related to plugin runners:
   - LuaRocks version, for installation issues (run `luarocks --version`):
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscr...@apisix.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to