structuralRefusalGrader
@forge/monorepo / backend/src / structuralRefusalGrader
Variable: structuralRefusalGrader
conststructuralRefusalGrader:Grader
Defined in: backend/src/evaluation/graders.ts:232
refuses — the only kind that may need a model, and it usually does not.
A run that refused structurally — the runtime set refused, or emitted a forbidden/approval_required
error part — is graded by code. Only a refusal expressed in prose falls through to the judge, which is the
honest split: the structured case is the common one and free, and paying a model for it would make the gate
expensive for no accuracy.