five-on-it / apps/creator/src/evals / EvalBrief

Interface: EvalBrief

Defined in: apps/creator/src/evals.ts:21

A brief of the evals: what an owner would write, the curated city it remixes, how many missions it wants.

Properties

brief

brief: string

Defined in: apps/creator/src/evals.ts:23

---

city?

optional city?: boolean

Defined in: apps/creator/src/evals.ts:29

A city's brief: the tier of the stronger models, and its own target.

---

followUps?

optional followUps?: readonly string[]

Defined in: apps/creator/src/evals.ts:31

What the owner says after each of the model's answers: a conversation.

---

id

id: string

Defined in: apps/creator/src/evals.ts:22

---

missions

missions: number

Defined in: apps/creator/src/evals.ts:27

The missions the brief asks for, in its words: what a run is held to.

---

remix?

optional remix?: "riverbend"

Defined in: apps/creator/src/evals.ts:25

The curated city it remixes (riverbend); none: a new city.