Prompt caching
Simple
The repeating start of a request is not recomputed — it is reused.
Business
The main cost lever for long contexts: an identical request prefix is billed several times cheaper on repeat.
Tech
Reuse of the KV prefix on the provider side when the prompt start matches; saves both money and time-to-first-token.