Applied AI Engineering
Chapter 1 of 23 · Level 1 · Foundations: How LLMs Work

Inside a Language Model

What an LLM actually is: next-token prediction, why "just autocomplete" is true but misleading, and the three things a frozen model cannot do for you.

  1. 1.1

    What an LLM Actually Is

    A language model does one thing. It predicts the next token. It is frozen, it has no memory, and it cannot act. Everything else you will build in this course is a ring around that one function.

    5 min read