SuperTokens - A shared database stopped responding, causing an outage in associated instances – Incident details

All systems operational

A shared database stopped responding, causing an outage in associated instances

Resolved
Major outage
Started 3 months agoLasted about 2 hours

Affected

Managed service (N. Virginia region)

Partial outage from 12:20 AM to 1:50 AM, Degraded performance from 1:50 AM to 2:00 AM

Production environment

Partial outage from 12:20 AM to 1:50 AM, Degraded performance from 1:50 AM to 2:00 AM

Updates
  • Resolved
    UTC
    Resolved
    This incident has been resolved.
  • Monitoring
    UTC
    Monitoring
    We implemented a fix and are currently monitoring the result.
  • Update
    UTC
    Update

    We are experiencing a database outage caused by an AWS infrastructure incident in us-east-1b (thermal event / power loss affecting use1-az4). We are monitoring recovery and moving the db instance to a different AZ.

  • Identified
    UTC
    Identified

    Rebooting db instance

  • Investigating
    UTC
    Investigating
    We are currently investigating this incident.