Cache

Simple

Remembering ready answers so you never compute the same thing twice.

Business

Direct savings: repeat requests are served instantly and almost for free.

Tech

Layers: provider prompt caching (KV-cache prefixes, up to −90% input price), response cache, CDN/ISR on the web; invalidation by TTL/version.

Related terms

All glossary terms