The context window, and why models hallucinate
An LLM only sees a fixed-size slice of text at a time. When it doesn't know something, it predicts anyway — that's a hallucination, not a bug.
Blog
#context-window
Posts on AI engineering, LLM systems, and software development.