Disaster recovery & failover
This page defines how quickly perryscope.ai can be restored if the primary hosting environment fails, and the procedure used to do it. It extends the site recovery & backups runbook, which covers rebuilding the site from source and backups; this page covers doing that quickly and in a controlled way.
Recovery targets
Failover approach
Failover redeploys the mirrored repository to a fresh project on the same hosting provider, then repoints DNS — rather than maintaining an always-on standby host on a second provider. This is sufficient for the 4-hour RTO on a static site and avoids the cost of standing secondary infrastructure.
DNS cutover procedure
- Confirm the redeployed target is live and serving correct content at its provider-assigned URL.
- Update the A/CNAME records in Cloudflare DNS to point to the new target.
- Allow for propagation per the current record TTL.
- Verify: site loads over HTTPS,
robots.txt/sitemap.xmlresolve, spot-check a docs page. - Update the DNS record snapshot to reflect the new state once stable.
Credentials used during recovery
DNS and hosting changes during a recovery event use the same access path as routine administration. Use is expected to be logged and MFA-protected.
Recovery exercises
Recovery exercises are scheduled quarterly, and after any change to the hosting or DNS architecture. Each exercise simulates the primary as unavailable and times a full recovery against the 4-hour RTO using only the documented steps above — no undocumented knowledge. Any step that requires information not on this page is recorded as a gap, fixed, and re-tested at the next cycle. Exercise records are retained internally.
Control:Required to keep restoration time and data loss within agreed limits if the primary hosting environment fails.