Mao Jiayi created FLINK-40411:
---------------------------------
Summary: Introduce an OpenAI-compatible model client for Flink CDC
Pipeline
Key: FLINK-40411
URL: https://issues.apache.org/jira/browse/FLINK-40411
Project: Flink
Issue Type: New Feature
Components: Flink CDC
Reporter: Mao Jiayi
h3. Motivation
FLINK-39568 introduced the generic AI model client API and the {{AI_COMPLETE}}
and {{AI_EMBED}} functions. This issue adds a concrete OpenAI-compatible model
client so that Flink CDC Pipeline jobs can use model services exposing
OpenAI-compatible completion and embedding APIs.
h3. Scope
* Add an independent {{openai-compatible}} model module discovered through the
Factory SPI.
* Support configurable model name, endpoint, and API key.
* Support configurable system and user prompts and input text, including
English and Chinese.
* Support common request parameters such as temperature, top-p, token limits,
penalties, response format, additional headers, and additional body properties.
* Support text completion and text embedding.
* Support retry, backoff, response validation, and error handling.
* Package the required client dependencies and ensure that the model provider
JAR is available to TaskManagers.
* Add English and Chinese documentation.
h3. Compatibility
The OpenAI-compatible client is added alongside the existing legacy model API.
This issue does not remove or migrate the legacy API.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
