five-on-it / apps/creator/src/evals / EvalRun

Interface: EvalRun

Defined in: apps/creator/src/evals.ts:191

One creation of the evals: a model's on a brief, and how it went.

Properties

brief

brief: string

Defined in: apps/creator/src/evals.ts:193

---

built

built: boolean

Defined in: apps/creator/src/evals.ts:196

Built without an error, with the missions asked for.

---

calls

calls: number

Defined in: apps/creator/src/evals.ts:201

---

cost

cost: number

Defined in: apps/creator/src/evals.ts:202

---

error?

optional error?: string

Defined in: apps/creator/src/evals.ts:204

---

missions

missions: number

Defined in: apps/creator/src/evals.ts:197

---

model

model: string

Defined in: apps/creator/src/evals.ts:192

---

moderated

moderated: boolean

Defined in: apps/creator/src/evals.ts:200

Moderation let what it wrote through.

---

seconds

seconds: number

Defined in: apps/creator/src/evals.ts:203

---

state

state: string

Defined in: apps/creator/src/evals.ts:194

---

wanted

wanted: number

Defined in: apps/creator/src/evals.ts:198