Status
Live availability of the caft API, per model. Updated every minute.
What the numbers mean
- Success rate
- The share of requests that completed without an error. A model below 90% is shown as degraded.
- Time to first token (TTFT)
- How long a streamed response took to produce its first token, averaged over the hour. A model's row shows its latest hour.
- Throughput
- Output tokens per second, averaged over the hour.
These are the service's own measurements of real traffic, unedited. A request that fails before producing any output is not charged; see the Service Level page.