[
https://issues.apache.org/jira/browse/FLINK-38572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated FLINK-38572:
-----------------------------------
Labels: pull-request-available (was: )
> Support controlling randomness and format of Chat Model Function
> ----------------------------------------------------------------
>
> Key: FLINK-38572
> URL: https://issues.apache.org/jira/browse/FLINK-38572
> Project: Flink
> Issue Type: Improvement
> Components: Library / Machine Learning
> Affects Versions: 2.2.0
> Reporter: Yunfeng Zhou
> Priority: Major
> Labels: pull-request-available
>
> In order to better support controlling the randomness and format of Chat
> Model Function, we propose to pass the following OpenAI API parameters
> through model function parameter.
> * presence-penalty: Number between -2.0 and 2.0. Positive values penalize new
> tokens based on whether they appear in the text so far, increasing the
> model's likelihood to talk about new topics.
> * n: How many chat completion choices to generate for each input message.
> * seed: the random seed to generate results
> * response-format: The format of the response, e.g., 'text' or 'json_object'.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
