Skip to main content

containsGrader

@forge/monorepo


@forge/monorepo / backend/src / containsGrader

Variable: containsGrader

const containsGrader: Grader

Defined in: backend/src/evaluation/graders.ts:91

contains — the output mentions every expected string.

Case-insensitive and whitespace-tolerant, because the expectation is that the fact appears, not that the model reproduced a casing. Partial credit, because "mentioned two of three" is genuinely different from "mentioned none" and collapsing them loses the signal a regression report needs.