Templates
Evaluation harness
Reference entryEvaluation harness
An evaluation harness runs models or prompts against a fixed test set, records outputs and calculates repeatable quality, safety or performance measures.
Where it sits
An evaluation harness runs models or prompts against a fixed test set, records outputs and calculates repeatable quality, safety or performance measures.