Retrieval latency is the elapsed time needed to return ranked passages. It should be measured separately from answer-generation latency. First-run model loading, embedding computation, cache state, CPU or GPU load, and corpus size can affect latency. A fair performance report should repeat measurements, report the median and spread, keep the hardware and corpus fixed, and distinguish cold-start from warm-run timing.
