Skip to content
Snippets Groups Projects
Commit 1f10b51f authored by Max Kimmich's avatar Max Kimmich
Browse files

Set temperature to lowest value for evaluation script

parent ba90bb7e
No related branches found
No related tags found
No related merge requests found
......@@ -23,6 +23,8 @@ def evaluate_prompt(prompt: str, task_name: str, args: Namespace):
load_in_8bit=True,
torch_dtype=torch.float16,
device_map="auto",
# use less randomness, i.e., more certain outputs
temperature=0.0,
# torch_dtype is not JSON serializable therefore we ignore it
ignore_cache_kwargs=["torch_dtype"],
)
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment