Add human feedback
Use human feedback for demonstration data, currently there is only one strategy: simple
which asks for interaction until the maximum is reached.
There are some new and changed CLI parameters:
-
--evolution-demo-source
instead of--use-evolution-demo
takes 1+ arguments (i.e., both can be used):static
(using predefined evolution demos) andinteractive
(using human feedback) -
--annotation-strategy
(currently onlysimple
(always use human feedback until maximum, and use all annotations for demonstration) exists) -
--max-annotations
: the maximum number of human interactions -
--max-annotations-per-evolution
:the idea is toset a limit for interactions per evolution, but this is not used yet
Edited by Max Kimmich
Merge request reports
Activity
Filter activity
requested review from @griesshaber
added 1 commit
- 0e697c53 - Use default value for annotation strategy CLI parameter
added 1 commit
- c203cb79 - Consider limit for annotations per evolution
added 1 commit
- 1205a889 - Update default value for CLI parameter `--max-annotations-per-evolution`
added 2 commits
added 1 commit
- 4293bbea - Add script for downloading wandb experiments
mentioned in commit 02102671
Please register or sign in to reply