promptdojo_

Evals before it works — golden cases and the ratchet — step 7 of 8

ch 57 · agent studio7/8

Three ratchet entries landed in one PR after a rough on-call week. Write lint_entry(entry) — the reviewer that holds every entry to the five-field standard before it's merged:

  1. Each of the five fields — date, failure, rule, artifact, remove_when — must be present and non-empty. First missing or empty one (in that order) → "reject: missing <field>".
  2. If the rule contains "be careful" (any casing) → "reject: vibes rule". Rules are actions with concrete strings, not adjectives.
  3. Otherwise → "ok".

Print one line per entry, then the summary count.

Expected output:

R1 ok
R2 reject: missing remove_when
R3 reject: vibes rule
1/3 entries earned their line

full-screen editor opens — close anytime to keep reading.

read, then continue.