Skip to main content

AgentEvalConfig

Agent Runtimes


Agent Runtimes / types/evals / AgentEvalConfig

Interface: AgentEvalConfig

Defined in: types/evals.ts:35

Eval configuration for an agent spec.

Indexable

[key: string]: unknown

Properties

category?

optional category?: string

Defined in: types/evals.ts:39


description?

optional description?: string

Defined in: types/evals.ts:38


difficulty?

optional difficulty?: string

Defined in: types/evals.ts:43


id?

optional id?: string

Defined in: types/evals.ts:36


languages?

optional languages?: string[]

Defined in: types/evals.ts:44


metric?

optional metric?: string

Defined in: types/evals.ts:41


name?

optional name?: string

Defined in: types/evals.ts:37


source?

optional source?: string

Defined in: types/evals.ts:42


task_count?

optional task_count?: number

Defined in: types/evals.ts:40