[
https://issues.apache.org/jira/browse/HDDS-14817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arafat Khan reassigned HDDS-14817:
----------------------------------
Assignee: Arafat Khan
> Multi-LLM Provider Support with Intelligent Routing
> ---------------------------------------------------
>
> Key: HDDS-14817
> URL: https://issues.apache.org/jira/browse/HDDS-14817
> Project: Apache Ozone
> Issue Type: Sub-task
> Reporter: Arafat Khan
> Assignee: Arafat Khan
> Priority: Major
>
> Customers differ in which AI services they are contracted to use some run on
> Azure OpenAI, others on Anthropic, and others still on Google Cloud. This
> JIRA ensures the Recon AI Assistant is not tied to a single vendor by
> building out a pluggable provider model and adding native support for OpenAI
> and Anthropic alongside Gemini. It introduces a smart routing layer that
> automatically determines which AI provider to use based on the model the user
> selects so if a user picks a GPT model, it routes to OpenAI; if they pick
> Claude, it routes to Anthropic. Administrators can also set a cluster-wide
> default provider. The result is a flexible, provider-agnostic assistant that
> works within whatever AI ecosystem an organization already has in place.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
