Aias00 opened a new pull request, #651:
URL: https://github.com/apache/rocketmq-dashboard/pull/651
## Summary
- add an OpenAI-compatible LLM client for openai/deepseek/tongyi/ollama chat
completions
- add a primary LLM gateway that uses the real provider when config is
complete and falls back to the stub only when config is incomplete
- preserve the existing SSE contract by emitting message events with
{"text": ...} and done events with [DONE]
- cover non-streaming calls, SSE streaming, auth headers, Ollama without API
key, upstream errors, fallback, and unsupported provider handling
## Scope
- Track 3 / RIP-3 AI Native
- Related to #545
## Non-goals
- no tool calling in this slice
- no multi-turn history changes
- no Azure/Bedrock native adapters yet
- no frontend API contract changes
## Tests
-
`JAVA_HOME=/Users/aias/Library/Java/JavaVirtualMachines/openjdk-21.0.2/Contents/Home
mvn -q
-Dtest=OpenAiCompatibleLlmClientTest,OpenAiCompatibleLlmGatewayTest,AiServiceTest,LlmConfigServiceTest,StudioApplicationTest
test`
-
`JAVA_HOME=/Users/aias/Library/Java/JavaVirtualMachines/openjdk-21.0.2/Contents/Home
mvn -q test`
- `git diff --check`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
