Skip to main content

EvaluationStore

@forge/monorepo


@forge/monorepo / backend/src / EvaluationStore

Interface: EvaluationStore

Defined in: backend/src/persistence/index.ts:846

Methods

completeRun()

completeRun(input): Promise<EvalRun>

Defined in: backend/src/persistence/index.ts:861

Closes a run, computing and storing its aggregates from the recorded cases.

Parameters

input

TenantScope & object

Returns

Promise<EvalRun>


get()

get(input): Promise<EvalRun | null>

Defined in: backend/src/persistence/index.ts:865

Parameters

input

TenantScope & object

Returns

Promise<EvalRun | null>


latest()

latest(input): Promise<EvalRun | null>

Defined in: backend/src/persistence/index.ts:868

The most recent completed run for a release, or across releases when none is named.

Parameters

input

TenantScope & object

Returns

Promise<EvalRun | null>


list()

list(input): Promise<Page<EvalRun>>

Defined in: backend/src/persistence/index.ts:871

Runs newest first, for a release history.

Parameters

input

TenantScope & PageRequest

Returns

Promise<Page<EvalRun>>


listCaseResults()

listCaseResults(input): Promise<Page<EvalCaseResult>>

Defined in: backend/src/persistence/index.ts:874

A run's per-case results, which is what a comparison between two runs reads.

Parameters

input

TenantScope & PageRequest & object

Returns

Promise<Page<EvalCaseResult>>


recordCase()

recordCase(input): Promise<{ recorded: boolean; }>

Defined in: backend/src/persistence/index.ts:856

Records one case's result.

Idempotent on (runId, caseId): a resumed run must not double-count a case it already scored, and a case cannot be scored twice in one run because a run scores each case once by construction.

Parameters

input

TenantScope & object

Returns

Promise<{ recorded: boolean; }>


startRun()

startRun(input): Promise<EvalRun>

Defined in: backend/src/persistence/index.ts:848

Opens a run. Separate from completing it so an interrupted run is visibly unfinished rather than absent.

Parameters

input

TenantScope & object

Returns

Promise<EvalRun>