Model Performance Issue: llama-3.1-8b-instant
minor- Started
- Nov 3, 9:11 PM EST
- Resolved
- Nov 3, 9:47 PM EST
- Duration
- 37 min
Groq's updates (3)
- identified · Nov 3, 9:11 PM EST
We have **identified an issue** affecting the lama-3.1-8b-instant service. A fix is in progress. Users may still experience latency until the fix completes.
- monitoring · Nov 3, 9:33 PM EST
We have **implemented a fix** for llama-3.1-8b-instant service and performance is improving. We’re now **monitoring** the model to ensure stability. If all remains normal, we will resolve the incident in the next update.
- resolved · Nov 3, 9:47 PM EST
The issues affecting llama-3.1-8b-instant have been **resolved**. The model is operating normally. Root cause: Two recent changes to the inference-engine-instances repository that were contributing to the elevated Orion LoRA latencies were reverted . We apologize for the disruption and thank you for your patience.
Updates are Groq's own words from its status page (status: resolved); we never add an inferred cause.