KV cache
Simple
The AI’s internal memory of what it already read — so it doesn’t re-read from scratch.
Business
Why reusing an identical request prefix is drastically cheaper; shapes prompt design.
Tech
A cache of attention key/value tensors for the prefix; reuse on prefix match is the basis of prompt caching.