WorkOS Outage History

WorkOS experienced a major incident where webhook deliveries were significantly delayed for a subset of their webhook traffic. The issue affected the webhook delivery system, causing a backlog in the webhooks queue. The incident was resolved after 18 minutes when the engineering team cleared the backlog and restored normal webhook delivery operations.

WorkOS experienced errors with OIDC (OpenID Connect) connections that affected authentication services. The issue was resolved within 4 minutes of detection.

WorkOS experienced an issue where AuthKit emails, including invitations, were being delivered with empty content and rendering without copy in some email clients, particularly Gmail. The problem was identified and a fix was applied, with newly-sent emails displaying properly again after 1.3 hours.

WorkOS experienced elevated webhook latency for 42 minutes, causing delays in webhook delivery to customers. The team identified the root cause and implemented mitigations, with webhook delivery recovering normally. The incident was fully resolved after monitoring confirmed stable performance.

WorkOS experienced 504 Gateway Timeout errors that prevented users from logging into the Dashboard at dashboard.workos.com through both SSO and Google sign-in methods. The WorkOS API and AuthKit services remained operational throughout the incident. The login issues were resolved after 11 minutes.

WorkOS experienced a major incident where Authkit webhook delivery was significantly delayed for 3.1 hours. The service team identified the issue, monitored the recovery process, and successfully restored normal webhook delivery operations. All delayed webhooks were eventually processed and delivered.

WorkOS experienced elevated errors affecting their Dashboard service for 24 minutes. The incident impacted user access to the Dashboard interface. The issue was investigated and resolved without further details on the specific cause or fix.

WorkOS experienced email delivery delays affecting a subset of users for 1.5 hours. The engineering team identified the root cause and implemented mitigations to restore normal email functionality. The incident was fully resolved with continued monitoring to ensure stable service.

WorkOS experienced elevated HTTP 429 (Too Many Requests) error rates on the /directory_users endpoint for 2.3 hours. The issue impacted API requests to this endpoint, causing rate limiting errors for users attempting to access directory user data. The problem was resolved after deploying a fix, with error rates returning to normal levels.

WorkOS experienced a Dashboard issue where the custom branding editor's CSS code editor and JWT editor were unavailable for 1.4 hours. The functionality was restored and the service team confirmed the impact was resolved.