GitHub user Alanxtl edited a discussion: [AI] AI gateway milestones
https://jimmysong.io/blog/ai-gateway-in-depth/ ### Step1: 基础 - [x] 1. 基础 AI 协议支持 (SSE/HTTP) #657 - [x] 2. Streamable HTTP ([doc](https://spec.modelcontextprotocol.io/specification/2025-03-26/basic/transports/#streamable-http)/[pr](https://github.com/modelcontextprotocol/specification/pull/206)) #674 - [x] 3. Token 用量获取 #659 ### Step2: 兼容 - [ ] 1. 面向密钥的负载均衡 - [x] 2. fallback策略 #685 #692 - [x] 3. retry策略 #685 #692 - [x] 4. LLM 供应商的兼容 #678(需持续适配) - [ ] 6. OpenAI 请求适配层 https://github.com/apache/dubbo-go-pixiu/discussions/686 ### Step3: 完善 - [ ] 1. AI 可观测性 - [ ] 1.1. Token 用量 - [ ] 1.2. 响应时间 - [ ] 2. 响应合规性和请求合规性 - [ ] 3. 日志 - [ ] 4. 更智能的路由 GitHub link: https://github.com/apache/dubbo-go-pixiu/discussions/696 ---- This is an automatically sent email for notifications@dubbo.apache.org. To unsubscribe, please send an email to: notifications-unsubscr...@dubbo.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: notifications-unsubscr...@dubbo.apache.org For additional commands, e-mail: notifications-h...@dubbo.apache.org
