Serval - Elevated latency for some API requests – Incident details

Elevated latency for some API requests

Resolved
Degraded performance
Started 10 days agoLasted 3 hours 30 minutes

Affected

Third Party: OpenAI

Degraded performance from 5:05 PM to 5:13 PM, Operational from 5:05 PM to 5:13 PM, Degraded performance from 5:13 PM to 8:35 PM

Third Party: OpenAI → APIs → Chat Completions

Operational from 5:05 PM to 5:13 PM, Degraded performance from 5:13 PM to 8:35 PM

Third Party: OpenAI → APIs → Responses

Degraded performance from 5:05 PM to 8:35 PM

Updates
  • Resolved
    UTC
    Resolved

    All impacted services have now fully recovered.

  • Monitoring
    UTC
    Monitoring

    We have applied the mitigation and are monitoring the recovery.

  • Update
    UTC
    Update

    We have implemented an initial mitigation and are seeing improvements in API latency. We are continuing to investigate the scope of the issue and apply additional mitigations as needed. Some requests to the Responses and Chat Completions APIs may still experience elevated latency or timeouts.

  • Update
    UTC
    Update

    We have identified that users are experiencing elevated latency for the impacted services.

    We are working on implementing a mitigation.

  • Identified
    UTC
    Identified

    We have identified that users are experiencing elevated latency for the impacted services.

    We are working on implementing a mitigation.