GitHub user Alanxtl edited a discussion: [AI] AI gateway milestones
https://jimmysong.io/blog/ai-gateway-in-depth/ ### Step1: 基础 - [x] 1. 基础 AI 协议支持 (SSE/HTTP) #657 - [x] 2. Streamable HTTP ([doc](https://spec.modelcontextprotocol.io/specification/2025-03-26/basic/transports/#streamable-http)/[pr](https://github.com/modelcontextprotocol/specification/pull/206)) #674 - [x] 3. Token 用量获取 #659 ### Step2: 兼容 - [x] ~1. 面向密钥的负载均衡~ https://github.com/apache/dubbo-go-pixiu/discussions/696#discussioncomment-14020512 - [x] 2. 密钥的健康性检测 https://github.com/apache/dubbo-go-pixiu/pull/731 https://github.com/apache/dubbo-go-pixiu/discussions/696#discussioncomment-14013522 - [x] 3. fallback策略 #685 #692 - [x] 4. retry策略 #685 #692 - [x] 5. LLM 供应商的兼容 #678(需持续适配) - [ ] 6. OpenAI 请求适配层 https://github.com/apache/dubbo-go-pixiu/discussions/696#discussioncomment-13973597 - [ ] 7. LLM服务发现 (Nacos 注册中心) ### Step3: 完善 - [x] 1. AI 可观测性 - [ ] Token 用量 - [ ] 响应时间 - [ ] 2. 响应合规性和请求合规性 - [ ] 3. 日志 - [ ] 4. 更智能的路由 GitHub link: https://github.com/apache/dubbo-go-pixiu/discussions/696 ---- This is an automatically sent email for notifications@dubbo.apache.org. To unsubscribe, please send an email to: notifications-unsubscr...@dubbo.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: notifications-unsubscr...@dubbo.apache.org For additional commands, e-mail: notifications-h...@dubbo.apache.org
