Oct 10, 20:26:15 GMT+0
Resolved - We’ve migrated to a new status page provider. Please visit <https://status.serval.com> and select “Subscribe to updates” to receive future status updates..

Duration: 11 days, 1 hour and 55 minutes

Affected Components:

Oct 6, 20:11:27 GMT+0
Resolved - All impacted services have now fully recovered..

Oct 6, 16:39:48 GMT+0
Identified - We are implementing the mitigation..

Oct 6, 15:45:31 GMT+0
Investigating - We are investigating the issue for the listed services..

Duration: 8 days and 18 hours

Affected Components: ,

Sep 30, 20:35:46 GMT+0
Resolved - All impacted services have now fully recovered..

Sep 30, 18:21:53 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 30, 17:51:40 GMT+0
Identified - We have implemented an initial mitigation and are seeing improvements in API latency. We are continuing to investigate the scope of the issue and apply additional mitigations as needed. Some requests to the Responses and Chat Completions APIs may still experience elevated latency or timeouts..

Sep 30, 17:13:13 GMT+0
Identified - We have identified that users are experiencing elevated latency for the impacted services. We are working on implementing a mitigation..

Sep 30, 17:05:46 GMT+0
Identified - We have identified that users are experiencing elevated latency for the impacted services. We are working on implementing a mitigation..

Duration: 13 days, 9 hours and 9 minutes

Affected Components: ,

Oct 6, 08:26:10 GMT+0
Resolved - All impacted services have now fully recovered..

Sep 29, 23:14:02 GMT+0
Resolved - The issue causing elevated errors across ChatGPT, Codex, and the API has been resolved, and all affected services have recovered. Thank you for your patience while we worked to restore service. The detailed Root Cause Analysis (RCA) will be published in the next 5 business days..

Sep 29, 22:47:10 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 29, 22:03:22 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 29, 21:09:11 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 29, 19:39:36 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 29, 19:08:39 GMT+0
Investigating - We’re still investigating elevated errors affecting ChatGPT, Codex, and the API including the Agents API. Some users may experience failed requests, difficulty logging in or signing up, and tasks that do not complete. We’ll share updates as we learn more..

Sep 29, 18:24:17 GMT+0
Investigating - We’re investigating elevated errors affecting ChatGPT, Codex, and the API including the Agents API. Some users may experience failed requests, difficulty logging in or signing up, and tasks that do not complete. We’ll share updates as we learn more..

Sep 29, 18:09:42 GMT+0
Resolved - .

Duration: 2 hours and 10 minutes

Affected Components: ,

Sep 29, 18:10:40 GMT+0
Resolved - We implemented a fix and are currently monitoring the result..

Sep 29, 16:00:23 GMT+0
Identified - We are continuing to work on a fix for this incident..

Duration: 57 minutes

Affected Components:

Sep 19, 18:56:29 GMT+0
Resolved - This was resolved by a rate limit increase..

Sep 19, 17:59:23 GMT+0
Investigating - We are experiencing email deliverability issues due to a AWS SES rate-limit issue. We are working with AWS support to get it resolved ASAP..

Duration: 27 minutes

Affected Components:

Sep 18, 23:35:05 GMT+0
Resolved - This issue is resolved. WorkOS has recovered from their API errors..

Sep 18, 23:07:39 GMT+0
Investigating - We are currently investigating issues with SSO-based login. It appears to be an issue with a downstream auth-provider, WorkOS. See <https://status.workos.com/>.

Duration: 1 hour and 41 minutes

Affected Components:

Sep 18, 22:16:23 GMT+0
Resolved - This incident has been resolved..

Sep 18, 21:33:52 GMT+0
Monitoring - We are still monitoring. Many customers report being able to create tickets via email and getting fast response times. Some customers will still experience slow response times caused by the outage to AWS Simple Notification Service (SNS)..

Sep 18, 21:10:26 GMT+0
Monitoring - This is caused by AWS outage with SNS in us-west-1\. We are still actively monitoring. Some customers are reporting they are now able to create email tickets. .

Sep 18, 20:36:20 GMT+0
Identified - We are continuing to work on a fix for this incident..

Sep 18, 20:35:25 GMT+0
Investigating - We are currently investigating this incident..

Duration: 21 hours

Affected Components: ,

Sep 17, 21:50:36 GMT+0
Resolved - All impacted services have now fully recovered..

Sep 17, 21:20:00 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 17, 20:20:00 GMT+0
Identified - We have identified that users are experiencing elevated errors for the impacted services. We are working on implementing a mitigation..

Duration: 1 hour and 1 minute

Affected Components:

Sep 16, 23:37:44 GMT+0
Resolved - This incident has been resolved..

Sep 16, 23:06:31 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Sep 16, 22:37:12 GMT+0
Investigating - We are currently investigating this incident..

Duration: 38 minutes

Affected Components:

Sep 14, 07:29:46 GMT+0
Resolved - This incident has been resolved..

Sep 14, 07:28:18 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Sep 14, 07:08:39 GMT+0
Identified - We are continuing to work on a fix for this incident..

Sep 14, 06:51:17 GMT+0
Investigating - We are currently investigating this incident..

Duration: 5 days, 13 hours and 28 minutes

Affected Components: ,

Sep 11, 11:21:43 GMT+0
Resolved - All impacted services have now fully recovered..

Sep 11, 10:09:47 GMT+0
Monitoring - We have brought additional capacity online and are seeing improvements for some GPT-5.6 Sol API traffic. We continue to mitigate elevated errors affecting Chat Completions and Responses and are monitoring recovery.

Sep 11, 09:08:15 GMT+0
Identified - We have identified that users are experiencing elevated errors for the impacted services. We are working on implementing a mitigation..

Duration: 37 minutes

Affected Components: ,

Sep 8, 21:51:47 GMT+0
Resolved - This incident has been resolved..

Sep 8, 21:39:42 GMT+0
Monitoring - Latency is recovering after working through a backlog of events. We're monitoring..

Sep 8, 21:19:55 GMT+0
Identified - We are continuing to work on a fix for this incident..

Sep 8, 21:14:29 GMT+0
Investigating - We are currently investigating this incident..

Duration: 45 minutes

Affected Components:

Sep 6, 07:21:00 GMT+0
Resolved - This incident has been resolved..

Sep 6, 06:30:08 GMT+0
Investigating - We are currently investigating this incident..

Duration: 30 minutes

Affected Components: ,

Sep 4, 20:27:49 GMT+0
Resolved - This incident has been mitigated. We are working to implement long-term preventative fixes..

Sep 4, 20:18:03 GMT+0
Monitoring - We are observing a return to normal behavior and are continuing to monitor recovery..

Sep 4, 20:13:51 GMT+0
Monitoring - We implemented a fix and are currently monitoring recovery..

Sep 4, 20:11:35 GMT+0
Identified - We have identified a root cause and are implementing a fix..

Sep 4, 19:57:29 GMT+0
Investigating - We are currently investigating this incident..

Duration: 30 minutes

Affected Components:

Sep 3, 11:00:00 GMT+0
Resolved - We identified and addressed a period of increased load that impacted workflow runs from approximately 01:40 to 03:40 AM PT. We are implementing longer term fixes for this class of issue. This incident has been resolved..

Sep 3, 10:30:00 GMT+0
Investigating - We are currently investigating this incident..

Duration: 33 minutes

Affected Components:

Sep 3, 11:03:16 GMT+0
Resolved - We have observed performance returning to normal baseline. We are implementing longer term fixes to address this class of performance degradation. This incident has been resolved..

Sep 3, 10:30:00 GMT+0
Investigating - We are currently investigating this incident..

Duration: 20 days, 13 hours and 49 minutes

Affected Components:

Sep 1, 19:05:46 GMT+0
Resolved - All impacted services have now fully recovered..

Sep 1, 18:09:31 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Sep 1, 17:36:17 GMT+0
Identified - We are implementing the mitigation..

Sep 1, 15:15:09 GMT+0
Identified - We have identified elevated latencies impacting Responses API on the US endpoint..

Sep 1, 01:46:22 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Aug 31, 23:13:46 GMT+0
Monitoring - We have applied a mitigation and are monitoring recovery..

Aug 31, 22:27:56 GMT+0
Identified - We have identified an issue causing elevated latency for some Responses API requests. We are working on implementing a mitigation..

Duration: 9 hours and 36 minutes

Affected Components: ,

Sep 1, 02:43:51 GMT+0
Resolved - We are continuing to use Anthropic for all agent responses as we monitor OpenAI's recovery. We will return to normal operation once API responsiveness returns to expected baseline..

Aug 31, 22:51:45 GMT+0
Monitoring - We are continuing to use Anthropic for all agent responses as we monitor OpenAI API incident response and recovery. Follow OpenAI's status updates here: <https://status.openai.com/incidents/01M1CYZDD84XD0H56XNEV2PT98>.

Aug 31, 21:34:40 GMT+0
Monitoring - We are continuing to use Anthropic for all agent responses as we monitor OpenAI API recovery..

Aug 31, 20:16:08 GMT+0
Monitoring - We are continuing to observe issues with OpenAI API responsiveness, so will maintain failover to Anthropic models and continue monitoring..

Aug 31, 19:43:53 GMT+0
Monitoring - We are recording improved API responsiveness from OpenAI and are evaluating a progressive rollback to normal operations..

Aug 31, 19:17:54 GMT+0
Monitoring - We have completed failing remaining inference activity to Anthropic and are continuing to monitor OpenAI endpoints for recovery. .

Aug 31, 18:58:57 GMT+0
Monitoring - We are continuing to failover to Anthropic and are implementing other mitigations..

Aug 31, 18:26:11 GMT+0
Monitoring - We are continuing to failover to Anthropic models for remaining affected agent behaviors and monitoring rollout..

Aug 31, 17:45:26 GMT+0
Monitoring - We are continuing to observe inconsistent response latencies with OpenAI endpoints. We are deploying a mitigation to failover all remaining affected model usages to Anthropic..

Aug 31, 17:32:44 GMT+0
Monitoring - We are seeing consistent availability from the OpenAI endpoint, but performance remains degraded. We are continuing to monitor the situation..

Aug 31, 17:21:42 GMT+0
Investigating - We are continuing to see fluctuating availability and response times from OpenAI across multiple model classes. We are continuing to investigate and implement mitigations..

Aug 31, 17:14:47 GMT+0
Investigating - We are currently investigating this issue with OpenAI. We are seeing some inconsistent response times from OpenAI..

Aug 31, 17:07:57 GMT+0
Investigating - We are currently experiencing elevated error rates and API hangs communicating with OpenAI. We are investigating the issue..

Duration: 41 minutes

Affected Components:

Aug 25, 01:31:34 GMT+0
Resolved - This incident has been resolved..

Aug 25, 01:09:41 GMT+0
Monitoring - We have implemented a fix and are observing availability is recovering. We are currently monitoring recovery..

Aug 25, 00:54:01 GMT+0
Identified - We have identified a root cause and are now implementing a fix..

Aug 25, 00:50:09 GMT+0
Investigating - We are currently investigating this incident..

Duration: 58 minutes

Affected Components:

Aug 20, 11:24:56 GMT+0
Resolved - This incident has been resolved..

Aug 20, 11:02:46 GMT+0
Monitoring - We have deployed a fix and are monitoring for service recovery and stability..

Aug 20, 10:27:14 GMT+0
Identified - We have identified an issue causing intermittent connectivity issues with our EU deployment. We are working to implement a fix..

Duration: 3 hours and 10 minutes

Affected Components: ,

Aug 7, 08:41:04 GMT+0
Resolved - This incident has been resolved..

Aug 7, 08:01:17 GMT+0
Monitoring - We have implemented mitigations for issues impacting availability and are monitoring recovery..

Aug 7, 07:48:33 GMT+0
Identified - We have identified additional contributing factors that are impacting Serval availability. We are working to restore service and will provide updates as they become available..

Aug 7, 07:04:14 GMT+0
Monitoring - We have deployed the fix and are monitoring service recovery..

Aug 7, 06:15:00 GMT+0
Identified - We are deploying the fix and monitoring the result..

Aug 7, 05:45:00 GMT+0
Identified - We have identified the root cause of the availability issue and are implementing a fix..

Aug 7, 05:30:52 GMT+0
Investigating - We are currently investigating this incident..

Duration: 48 minutes

Affected Components:

Jul 30, 19:28:02 GMT+0
Resolved - This incident has been resolved. We are implementing long term remediations..

Jul 30, 19:07:11 GMT+0
Monitoring - We are continuing to monitor recovery. Performance has recovered to baseline..

Jul 30, 18:55:01 GMT+0
Monitoring - We have applied a fix and are monitoring for service recovery. Service performance is degraded but recovering..

Jul 30, 18:45:00 GMT+0
Investigating - We are currently investigating this incident..

Jul 30, 18:39:37 GMT+0
Investigating - We are currently investigating this incident..

Duration: 3 days, 12 hours and 51 minutes

Affected Components:

Jul 29, 02:20:19 GMT+0
Resolved - All impacted services have now fully recovered..

Jul 29, 01:39:33 GMT+0
Monitoring - We have applied the mitigation and are monitoring the recovery..

Jul 29, 00:55:27 GMT+0
Investigating - We are investigating the issue for the listed services..

Duration: -1 days, -12 hours and -39 minutes

Affected Components:

Jul 27, 17:30:00 GMT+0
Resolved - All impacted services have now fully recovered..

Jul 27, 15:30:00 GMT+0
Investigating - We are investigating the issue for the listed services..