Triage the bad prediction — reproduce with the logged input, then route by class (step 5/7) · debugging broken ai output

promptdojo_

This repro script feeds the pipeline support's paraphrase of the customer's question — and the paraphrase drops the clause that triggers the bug. The script cheerfully reports the failure as unreproducible while the bug sits live in production.

Fix the reproduction line so it re-runs the pipeline on the exact logged_input from the trace.

Expected output:

reproduced: yes - now classify it

The break is on line 18 — but read the whole snippet first.

Fix the reproduction line so it re-runs the pipeline on the exact logged_input from the trace.

Expected output:

reproduced: yes - now classify it

The break is on line 18 — but read the whole snippet first.

full-screen editor opens — close anytime to keep reading.

Triage the bad prediction — reproduce with the logged input, then route by class — step 5 of 7