Lesson 5 of 9 · DURING RECOVERY · 3 min read

Failback: getting back to the primary region

Short answer

A failover ends an outage; it does not end the incident. At some point service must return to the primary region, along with every change made while it ran elsewhere. Of the tools scored here, only Arpio publishes automated failback, in its Premium tier. For the rest, plan failback as its own procedure and ask the vendor how it works.

Why is failback hard?

During a failover the recovery environment becomes production. Users write data to it, teams deploy fixes to it and settings change. Returning to the primary region means moving all of that back, in the right order, with a second short interruption that someone has to schedule.

Teams that practise failover but not failback often find that the return trip is the slower and riskier one, because it is rehearsed less.

What has to move back?

  • Data written during the failover period.
  • Configuration changes made in the recovery environment, including emergency fixes.
  • DNS and traffic routing, switched back once the primary is healthy.
  • Any resources created only in the recovery region, which either move back or are removed.

What do the vendors publish?

Arpio lists automated failback in its Premium tier, alongside real-time RPOs and network sandbox testing. It is the only tool scored here that names failback on the pages we reviewed.

Firefly, Commvault Cloud Rewind and Cohesity describe recovery into another region, account or isolated environment but do not describe the return trip. With a rebuild-based tool, one option is to treat failback as a second rebuild, from a fresh capture of the recovery environment back into the primary. Ask the vendor whether that is supported and tested.

How should you test it?

The AWS guidance on testing disaster recovery applies to both directions: a path that is not tested regularly is not one you can rely on. Include failback in at least one rehearsal a year, and time it separately from the failover.

How do you decide when to fail back?

Fail back when the primary region is healthy, when the data written during the failover has been copied back and checked, and when a maintenance window is agreed with the teams who own the applications. A rushed failback can cause a second outage that is larger than the first, because it happens with less preparation.

Record the decision criteria in the runbook in advance, so the choice is not made under pressure by whoever is on call that day. A simple rule, such as a healthy primary for a set period and a completed data check, is enough to start with.

What should you take from this lesson?

Put failback in the plan with its own owner, its own steps and its own test. When you compare vendors, ask each one to describe failback in writing.

Sources