henrikdukefoss opened a new issue, #13205:
URL: https://github.com/apache/seatunnel/issues/13205

   ### Search before asking
   
   - [X] I had searched in the 
[feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   ### Description
   
   Disclosure: I work on Standard Compute, so this is a vendor proposal. I'd 
like to contribute it to SeaTunnel the same way OrcaRouter was added in #11997.
   
   Add Standard Compute as an `AI_PROVIDER` option for `seatunnel-cli`. 
Standard Compute is an OpenAI-compatible API (`https://api.stdcmpt.com/v1`). 
Its routed model `StandardCompute` picks one of the user's enabled models for 
each request, based on a quality preference, and falls back automatically if an 
upstream fails. Users can opt in to Europe-only or US-only processing per key, 
and prompts aren't stored or used for training.
   
   Proposed scope, kept to parity with #11997 so it doesn't clash with #12552:
   
   - `StandardComputeProvider(OpenAIProvider)` in `llm_provider.py`, with the 
default base URL and the `StandardCompute` model.
   - Env vars: `STANDARDCOMPUTE_API_KEY` (required, and it never falls back to 
`OPENAI_API_KEY`), `STANDARDCOMPUTE_MODEL`, `STANDARDCOMPUTE_SMALL_FAST_MODEL` 
and `STANDARDCOMPUTE_ECHO_REASONING_CONTENT` (to match 
`OPENAI_ECHO_REASONING_CONTENT`).
   - `--init` setup, `env.example.sh`, `setup.sh`, the CLI READMEs, and 
`docs/{en,zh}/ai-cli/{overview,quickstart}.md`.
   - Tests: a new `test_llm_provider_standardcompute.py` for defaults, the 
missing-key error, env overrides and the no-`OPENAI_API_KEY` case. The routing 
tests go in the existing `test_cli_provider_routing.py` class.
   
   Acceptance checks I'll paste into the PR:
   
   1. A real multi-turn session (for example "MySQL CDC to Doris") that makes 
tool calls and produces a config that passes the CLI validator.
   2. The same session with reasoning echo on. A routed model can change 
upstream models between turns, so I'll test `reasoning_content` replay 
explicitly and document the env var if it has to be off.
   3. Streaming output through `chat_stream()`.
   4. `pytest seatunnel-cli/tests -q`.
   
   ### Usage Scenario
   
   Users who want one key for several models in the AI CLI, with automatic 
fallback, or who need Europe-only or US-only processing.
   
   ### Related issues
   
   #11997 (OrcaRouter, merged), #12552 (Cheaper Inference, open).
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to