branch: externals/minuet
commit 526d8be6d87658d26dd202830c34f58f197f773b
Author: Milan Glacier <d...@milanglacier.com>
Commit: Milan Glacier <d...@milanglacier.com>
doc: update README.
---
README.md | 16 ++++++++++++++++
1 file changed, 16 insertions(+)
diff --git a/README.md b/README.md
index 506847b621..784304c941 100644
--- a/README.md
+++ b/README.md
@@ -374,6 +374,14 @@ The following config is the default.
"config options for Minuet OpenAI FIM compatible provider")
```
+The following configuration is not the default, but recommended to prevent
+request timeout from outputing too many tokens.
+
+```lisp
+(minuet-set-optional-options minuet-openai-compatible-options :max_tokens 256)
+(minuet-set-optional-options minuet-openai-compatible-options :top_p 0.9)
+```
+
</details>
## OpenAI-FIM-Compatible
@@ -397,4 +405,12 @@ For example, you can set the `end_point` to
"config options for Minuet OpenAI FIM compatible provider")
```
+The following configuration is not the default, but recommended to prevent
+request timeout from outputing too many tokens.
+
+```lisp
+(minuet-set-optional-options minuet-openai-fim-compatible-options :max_tokens
256)
+(minuet-set-optional-options minuet-openai-fim-compatible-options :top_p 0.9)
+```
+
</details>
