Commits · 755c15d1d0557f086573d28c0620cdbc8bdeca2e · Grießhaber Daniel / evoprompt · GitLab

Snippets Groups Projects

Feb 03, 2025
- add results for evaluation strategies · 755c15d1
  Grießhaber Daniel authored 1 month ago
  
  755c15d1
Jan 31, 2025
- Allow setting wandb tags via CLI · 7d9097e6
  Max Kimmich authored 1 month ago
  
  7d9097e6
- allow setting --evolution-demo-source to none · 244ad597
  Grießhaber Daniel authored 1 month ago
  
  244ad597
- use static evolution demos by default · b579b8f6
  Grießhaber Daniel authored 1 month ago
  
  b579b8f6
- remove unused ForcedImprovementBasedStopping · b1637d5b
  Grießhaber Daniel authored 1 month ago
  
  b1637d5b
- fix hardest-first early stopping · a3610d71
  Grießhaber Daniel authored 1 month ago
  
  a3610d71
- add subsample evaluation strategy · cd99e124
  Grießhaber Daniel authored 1 month ago
  
  cd99e124
Jan 30, 2025
- Merge branch 'user-interaction-after-non-improvement' into 'master' · 902da356
  Grießhaber Daniel authored 1 month ago
  
  User interaction only after non improvement See merge request !12
  902da356
- add notebook to evaluate optimization strategies · 5ad6c0b7
  Grießhaber Daniel authored 1 month ago
  
  5ad6c0b7
- add parameters for number of evolutions and population size · e531f70d
  Grießhaber Daniel authored 1 month ago
  
  e531f70d
Jan 27, 2025
- Fix not performing evolution if no human feedback is available anymore · b6e8481d
  Max Kimmich authored 1 month ago
  
  b6e8481d
- Fix missing return value · debcaf63
  Max Kimmich authored 1 month ago
  
  debcaf63
Jan 24, 2025
- Adding logging of amount of user interactions per generation · 867cc0ed
  Max Kimmich authored 1 month ago
  
  867cc0ed
- Always log generation in addition to iteration (iteration is kept for... · 2a6e9b81
  Max Kimmich authored 1 month ago
  
  Always log generation in addition to iteration (iteration is kept for backwards compatibility with old experiments)
  2a6e9b81
- Fix issue where a generation was repeated even though no human feedback was available anymore · 8aa58790
  Max Kimmich authored 1 month ago
  
  8aa58790
- Improve readability and logging · 4508772b
  Max Kimmich authored 1 month ago
  
  4508772b
- Use "baseprompt_manual" for manually designed initial prompts · 1c5c2d62
  Max Kimmich authored 1 month ago
  
  1c5c2d62
- Perform evolution for 20 iterations · 5a52a774
  Max Kimmich authored 1 month ago
  
  5a52a774
Jan 21, 2025
- Use "none" action for first iteration without improvement · 5df86c2f
  Max Kimmich authored 1 month ago
  
  5df86c2f
- Fix judge resolution handling · aa37f80c
  Max Kimmich authored 1 month ago
  
  aa37f80c
Jan 15, 2025
- Fix best prompt score computation · 395b6cc6
  Max Kimmich authored 1 month ago
  
  395b6cc6
Jan 02, 2025
- implement judge_action=correct to only be effective after a iteration without improvements · 0c034ebb
  Grießhaber Daniel authored 2 months ago
  
  0c034ebb
- add framework to retry evolution with human feedback if performance did not improve · 13e3d550
  Grießhaber Daniel authored 2 months ago
  
  13e3d550
Dec 17, 2024
- better non-interactive handling for tqdm · bc7445bc
  Grießhaber Daniel authored 2 months ago
  
  bc7445bc
- don't use built-in openai retry · 339d1d7f
  Grießhaber Daniel authored 2 months ago
  
  339d1d7f
- disable tqdm in non-interactive mode · 31b6144d
  Grießhaber Daniel authored 2 months ago
  
  31b6144d
- fix loading of wrong model during eval · 4d7cabdc
  Grießhaber Daniel authored 2 months ago
  
  4d7cabdc
Dec 16, 2024
- Revert "Fix crash if `evolution_demo_source` is not passed as CLI argument" · a1b42c16
  Max Kimmich authored 2 months ago
  
  This reverts commit 1c75f4bb
  a1b42c16
- Fix crash if `evolution_demo_source` is not passed as CLI argument · 1c75f4bb
  Max Kimmich authored 2 months ago
  
  1c75f4bb
Dec 11, 2024
- Fix assigning lists to columns · 4080d7c4
  Max Kimmich authored 3 months ago
  
  4080d7c4
- use better backoff strategry for openai model · 43664293
  Grießhaber Daniel authored 3 months ago
  
  43664293
- add default value for --evolution-demo-source · fc284390
  Grießhaber Daniel authored 3 months ago
  
  fc284390
- Merge branch 'add-human-feedback' into 'master' · 02102671
  Grießhaber Daniel authored 3 months ago
  
  Add human feedback See merge request !11
  02102671
Dec 10, 2024
- Add script for downloading wandb experiments · 4293bbea
  Max Kimmich authored 3 months ago
  
  4293bbea
Dec 06, 2024
- Refactor evolution and add GA-CoT · 80057a95
  Max Kimmich authored 3 months ago
  
  80057a95
Dec 03, 2024
- Update response editor to better show response · 91e60332
  Max Kimmich authored 3 months ago
  
  91e60332
- Log user interactions · fe66ab5a
  Max Kimmich authored 3 months ago
  
  fe66ab5a
Dec 02, 2024
- Update default value for CLI parameter `--max-annotations-per-evolution` · 1205a889
  Max Kimmich authored 3 months ago
  
  1205a889
- Consider limit for annotations per evolution · c203cb79
  Max Kimmich authored 3 months ago
  
  c203cb79
Nov 30, 2024
- Use default value for annotation strategy CLI parameter · 0e697c53
  Max Kimmich authored 3 months ago
  
  0e697c53