Skip to content
Snippets Groups Projects
Commit 66338b96 authored by Grießhaber Daniel's avatar Grießhaber Daniel :squid:
Browse files

respect --max-tokens cli parameter

parent ad25c5a5
No related branches found
No related tags found
2 merge requests!2remove is_chat argument,!1Refactor models
......@@ -88,6 +88,7 @@ class LLMModel(ABC):
**model_input,
stop=stop,
use_cache=use_cache,
max_tokens=self.options.max_tokens,
**kwargs,
)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment