478320 opened a new pull request, #6296: URL: https://github.com/apache/shenyu/pull/6296
Currently, the chatClient calls in the aiRequest and aiResponse plugins are blocking and handled via a worker thread pool to process these blocking operations. This introduces unnecessary thread context switching. Since chatClient supports asynchronous responses, this PR modifies the model calls to be asynchronous. Additionally, it adds a request path rewriting feature to the aiRequest plugin. <!-- Describe your PR here; e.g. Fixes #issueNo --> <!-- Thank you for proposing a pull request. This template will guide you through the essential steps necessary for a pull request. --> Make sure that: - [ ] You have read the [contribution guidelines](https://shenyu.apache.org/community/contributor-guide). - [ ] You submit test cases (unit or integration tests) that back your changes. - [ ] Your local test passed `./mvnw clean install -Dmaven.javadoc.skip=true`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
