Disaster recovery — where the runbooks live
Step-by-step playbooks for major incidents (database loss, Stripe webhook gaps, domain cutover rollback, DDoS).
When something big breaks, do not improvise. We have written, tested step-by-step runbooks for the eight most likely emergencies. Each one tells you who to call, what commands to run, how to verify recovery, and how to communicate to customers.
Where the runbooks live
Open the docs/runbooks/ folder in the repository. There is one Markdown file per scenario, plus a README.md that indexes them and an SLA.md that documents recovery time objectives.
The 8 runbooks
- 01-database-restore.md — Supabase point-in-time restore
- 02-vercel-rollback.md — promote a previous Vercel deployment
- 03-stripe-webhook-replay.md — replay missed Stripe webhook events
- 04-mailgun-suspended.md — Mailgun account locked or rate-limited
- 05-domain-cutover-rollback.md — undo a custom domain change that broke
- 06-credential-rotation.md — rotate any leaked secret (Stripe, Mailgun, Twilio, Supabase, OAuth)
- 07-tenant-data-corruption.md — recover one tenant without touching others
- 08-ddos-response.md — Vercel + Cloudflare mitigation playbook
How to use a runbook
- 1Open docs/runbooks/README.md and find the scenario that matches.
- 2Read the runbook end-to-end before doing anything destructive.
- 3Follow the steps in order — they are dependency-ordered.
- 4After recovery, write a short post-incident summary in the same folder.
⚠️
Important: Do NOT improvise during an incident. The runbooks have been tested. Improvising under stress is how second outages happen.
💡
Tip: Run a tabletop drill once a quarter — pick a runbook, walk through it on a staging branch with the on-call team, time it, and update the runbook with anything you learn.
ℹ️
Note: docs/runbooks/SLA.md documents recovery time objectives (RTO) and recovery point objectives (RPO) per scenario. Use it when communicating expectations to a customer mid-incident.
Was this article helpful?
Still need help?
We're here for you — call or email us any time during business hours.
Mon–Fri 8am–5pm Central Time
Related articles
Getting started with your admin dashboard
Understand your dashboard at a glance — today's stats, action items, and quick access to everything.
A full tour of your admin dashboard
KPIs, greeting, Today's Classes, Action Items, Revenue & Pipeline, Recent Activity, and Quick Actions — all explained.
Finding any setting fast
The settings sidebar, category grid, search bar, and Recent Changes panel — how to get to any of the 29 settings categories without clicking around.