LLM Latency Benchmarks

Is ChatGPT getting slower? How much faster are OpenAI models when hosted on Azure? How do Anthropic's models stand up against OpenAI's?

Get all your latency questions answered with our latest benchmark report. Updated and delivered monthly.

No spam, ever. Just 1 email a month about model latencies.

A report with a few graphs on it and the PromptHub logo