←Applied AI Engineering
Chapter 19 of 23 · Level 9 · Production & Capstone

Running Your Own Model

Open weights, llama.cpp and Ollama, what self-hosting really costs, and the licence that decides whether you may ship it.

  1. 19.1

    Running Your Own Model

    Open weights make self-hosting possible. A GPU bill, an on-call rotation and a licence you have to actually read decide whether it is wise. Here is when running your own model is the right call, and when it is a hobby with a budget.

    6 min read
    →