A context window is the maximum amount of text, measured in tokens, that an AI language model can consider at one time when generating a response, directly limiting how much information can be provided as input in a single interaction.
Larger context windows, now exceeding one million tokens in some leading models, allow AI systems to process and reason over much larger amounts of retrieved content when generating grounded, cited answers.
Understanding context window limitations helps explain why some AI systems may miss or fail to fully incorporate information from a very long, unstructured source document.
We consider context window implications when structuring content for AI retrieval within our SEO Content Strategy service.