lesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptlesson 2 of 4 · the four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the promptthe four breakage classes — sort any llm failure before you touch the prompt
Checkpoint
One last thing before we move on. pass this to mark the lesson done, or skip and keep moving. hop to the next when you're ready.
Final drill. You got three user-reported failures from the support inbox this morning. Each has a trace attached. Classify them so the right team gets the right ticket — retrieval team, prompt team, ML team (hallucination), or backend team (parse).
Write classify_failure(trace) using the same priority order
from the previous step:
- retrieved_chunks non-empty + retrieved_chunks_match_query False
→
"retrieval" - raw_output != output_after_postprocess →
"parse" - retrieved_chunks empty →
"hallucination" - else →
"prompt"
Then print one line per trace in this format:
ticket_<id>: <class>
Expected output:
ticket_8821: retrieval
ticket_8822: prompt
ticket_8823: parse