Skip to main content

structuralRefusalGrader

@forge/monorepo


@forge/monorepo / backend/src / structuralRefusalGrader

Variable: structuralRefusalGrader

const structuralRefusalGrader: Grader

Defined in: backend/src/evaluation/graders.ts:232

refuses — the only kind that may need a model, and it usually does not.

A run that refused structurally — the runtime set refused, or emitted a forbidden/approval_required error part — is graded by code. Only a refusal expressed in prose falls through to the judge, which is the honest split: the structured case is the common one and free, and paying a model for it would make the gate expensive for no accuracy.