kunwp1 commented on code in PR #4544: URL: https://github.com/apache/texera/pull/4544#discussion_r3169806893
########## bin/single-node/README.md: ########## @@ -146,6 +168,45 @@ $ docker compose up y // answer y to this prompt ``` +### Add more LLMs or providers +Only Claude Haiku 4.5 is enabled by default. To add more LLMs, open `litellm-config.yaml` in the installation folder and append entries under `model_list`. Each entry follows this shape: +```diff + model_list: + ... ++ - model_name: <name shown in Texera> ++ litellm_params: ++ model: <provider model id> ++ api_key: "os.environ/<API_KEY_ENV_VAR>" +``` +For example, to add OpenAI's GPT-5.2 and Google's Gemini 2.5 Pro: +```diff + model_list: + ... ++ - model_name: gpt-5.2 ++ litellm_params: ++ model: gpt-5.2 ++ api_key: "os.environ/OPENAI_API_KEY" ++ ++ - model_name: gemini-2.5-pro ++ litellm_params: ++ model: gemini/gemini-2.5-pro ++ api_key: "os.environ/GEMINI_API_KEY" +``` +Make sure to set the corresponding API key environment variable when you launch Texera (see [Enable the Texera Agent](#enable-the-texera-agent)). Get keys from each provider's console — for example, [OpenAI](https://platform.openai.com/api-keys) or [Google](https://aistudio.google.com/apikey). + +If your provider is not Anthropic, OpenAI, or Google, also pass its key into the LiteLLM container by editing `docker-compose.yml`: +```diff + litellm: + ... + environment: + ANTHROPIC_API_KEY: ${ANTHROPIC_API_KEY:-} + OPENAI_API_KEY: ${OPENAI_API_KEY:-} + GEMINI_API_KEY: ${GEMINI_API_KEY:-} ++ <NEW_API_KEY>: ${<NEW_API_KEY>:-} +``` + +For the full list of supported providers and model IDs, see the [LiteLLM proxy config docs](https://docs.litellm.ai/docs/proxy/configs). Review Comment: I think the link should be this: https://docs.litellm.ai/docs/providers -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
