How Models Generate Text
Logits to probabilities, temperature and sampling, the prefill/decode phases, and why models hallucinate.
Units coming soon.
←Applied AI EngineeringChapter 2 of 17 · Level 1 · Foundations: How LLMs Work
Logits to probabilities, temperature and sampling, the prefill/decode phases, and why models hallucinate.
Units coming soon.