Latency

Simple

Delay: how long you wait for an answer.

Business

System response time; in agent chains it adds up across dozens of calls and decides real-time viability.

Tech

p50/p95/p99 response time; sequential LLM calls dominate in MAS; treated with parallelism, caching, and streaming.

Related terms

All glossary terms