Skip to content
Snippets Groups Projects

Add demonstration data for evaluation and change answer extraction for text classification tasks

Merged Max Kimmich requested to merge add-demo-for-evaluation into master
  • Implemented adding demonstration data for evaluation (can be used on the CLI via -n-evaluation-demo n which adds n samples per class as demonstration to the prompt)
  • This leads to a new response format for the LM which needed a new answer parsing
  • Currently only implemented for text classification tasks
  • Needs more testing though, especially the new answer parsing

Merge request reports

Approval is optional

Merged by Grießhaber DanielGrießhaber Daniel 7 months ago (Aug 20, 2024 7:36am UTC)

Merge details

  • Changes merged into with 719e2ffa.
  • Did not delete the source branch.

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
Please register or sign in to reply
Loading