promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_promptdojo_

Decoding, KV cache, and quantization — step 3 of 7

ch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internalsch 44 · cnns, transformers, and useful llm internals3/7

Greedy decoding over a 3-word vocabulary, then weights crushed to quarter-steps. What does this print?

open the editor to run it.