Elevated inference 500s for models in a single US-based cluster
major- Started
- Aug 31, 2:38 AM EDT
- Resolved
- Aug 31, 3:02 AM EDT
- Duration
- 24 min
Baseten's updates (3)
- investigating · Aug 31, 2:38 AM EDT
We are currently investigating this issue.
- monitoring · Aug 31, 2:57 AM EDT
Fix is in place and traffic is back.
- resolved · Aug 31, 3:02 AM EDT
This incident has been resolved.
What our checks recorded
We checked Baseten 4 times from Baseten's start time to its resolution, once every five minutes. Every one of them reached Baseten's site, so this incident did not show up as a failed page load. Our check loads the public site; it cannot see an API error or a broken feature. Median response time was 69 ms, against 105 ms over the 24 hours before. Baseten posted the incident at Aug 31, 2:38 AM EDT.
Updates are Baseten's own words from its status page (status: resolved); we never add an inferred cause. The vendor's incident page ↗