← All insights

Governance & delivery

How can you tell whether a digital change actually worked?

A system being live is evidence of delivery. It is not evidence that the business problem has improved.

Published 25 September 2026

Measure the work, not only the launchBefore · After · Hidden work

Write down the baseline before changing it

Choose a small number of observations tied to the reason for investing: time to resolve a case, avoidable rework, the share of enquiries answered or the number of disputed records. Record how each is measured and what it looked like before launch.

Usage is useful context but not a benefit by itself. A tool may be heavily used because people have no alternative, while the original delay remains.

Look for work that moved elsewhere

Speak with customers and staff, examine awkward cases and check whether a new spreadsheet or inbox has appeared. Improvements in one team's measure can conceal extra work for another.

Decide in advance when to review the result and who can change the design. If the evidence is mixed, refine the process or stop an unhelpful feature rather than defending the launch.

An online intake service attracts more submissions, but staff spend longer correcting incomplete cases.

Compare complete cases and staff time, not form submissions alone. The apparent growth may be a transfer of effort to the back office.