five-on-it / apps/creator/src/evals / EvalRun
Interface: EvalRun
Defined in: apps/creator/src/evals.ts:192
One creation of the evals: a model's on a brief, and how it went.
Properties
brief
brief:
string
Defined in: apps/creator/src/evals.ts:194
built
built:
boolean
Defined in: apps/creator/src/evals.ts:197
Built without an error, with the missions asked for.
calls
calls:
number
Defined in: apps/creator/src/evals.ts:206
city?
optionalcity?:boolean
Defined in: apps/creator/src/evals.ts:201
A city's: held to its own target.
cost
cost:
number
Defined in: apps/creator/src/evals.ts:207
error?
optionalerror?:string
Defined in: apps/creator/src/evals.ts:209
missions
missions:
number
Defined in: apps/creator/src/evals.ts:198
model
model:
string
Defined in: apps/creator/src/evals.ts:193
moderated
moderated:
boolean
Defined in: apps/creator/src/evals.ts:205
Moderation let what it wrote through.
seconds
seconds:
number
Defined in: apps/creator/src/evals.ts:208
state
state:
string
Defined in: apps/creator/src/evals.ts:195
turns?
optionalturns?:number
Defined in: apps/creator/src/evals.ts:203
The turns of the conversation it took.
wanted
wanted:
number
Defined in: apps/creator/src/evals.ts:199