The four breakage classes — sort any LLM failure before you touch the prompt — step 2 of 9
A chatbot told a customer their refund was processed. It wasn't.
The trace shows retrieval pulled ticket ALT-CUST-04 instead of
the customer's actual account CUST-04 — different customer,
similar ID. The model read the ticket and answered honestly from it.
Which class is this?
⌘↵ runs the editor.read, then continue.
The four breakage classes — sort any LLM failure before you touch the prompt — step 2 of 9
A chatbot told a customer their refund was processed. It wasn't.
The trace shows retrieval pulled ticket ALT-CUST-04 instead of
the customer's actual account CUST-04 — different customer,
similar ID. The model read the ticket and answered honestly from it.
Which class is this?
⌘↵ runs the editor.read, then continue.