five-on-it / apps/creator/src/evals / EvalRun
Interface: EvalRun
Defined in: apps/creator/src/evals.ts:229
One creation of the evals: a model's on a brief, and how it went.
Properties
brief
brief:
string
Defined in: apps/creator/src/evals.ts:231
built
built:
boolean
Defined in: apps/creator/src/evals.ts:234
Built without an error, with the missions asked for.
calls
calls:
number
Defined in: apps/creator/src/evals.ts:243
city?
optionalcity?:boolean
Defined in: apps/creator/src/evals.ts:238
A city's: held to its own target.
cost
cost:
number
Defined in: apps/creator/src/evals.ts:244
error?
optionalerror?:string
Defined in: apps/creator/src/evals.ts:246
missions
missions:
number
Defined in: apps/creator/src/evals.ts:235
model
model:
string
Defined in: apps/creator/src/evals.ts:230
moderated
moderated:
boolean
Defined in: apps/creator/src/evals.ts:242
Moderation let what it wrote through.
seconds
seconds:
number
Defined in: apps/creator/src/evals.ts:245
state
state:
string
Defined in: apps/creator/src/evals.ts:232
turns?
optionalturns?:number
Defined in: apps/creator/src/evals.ts:240
The turns of the conversation it took.
wanted
wanted:
number
Defined in: apps/creator/src/evals.ts:236