Token

The unit a model processes text in — roughly a word or sub-word; tokens determine context-window size and cost.

A token is the unit language models use to process text — roughly equivalent to a word or piece of a word. Tokens matter in agentic gaming because they determine both how much a model can hold in its context window and how much each inference call costs. A dungeon that produces a large state each tick burns more tokens per action, raising cost and potentially slowing the run.