Why Indicators Started Misleading
You have watched the same numbers for years, the numbers are still accurate, and yet your decisions are landing less well than they used to. The cause is not that the indicators broke. The cause is that the link between what they measure and what results has weakened.
Three separate mechanisms produce this, and each needs a different fix. Knowing which one you face sends the correction to the right place.
First Cause: The Unit Is Drifting
BU BÖLÜMÜN ÖZETİ
- The ruler is not fixed
- Invisible at low inflation
- The fix is simple
- Where you meet it
The most widespread mechanism and the easiest to correct.
The ruler is not fixed
Every indicator measured in money drifts as the money itself changes. Revenue, wages, asset values and budget targets all sit in this group.
Invisible at low inflation
A few percentage points can be ignored. Above thirty, the same omission can flip the sign of the indicator. The problem is not new; its magnitude is.
The fix is simple
Adding a quantity-based pair is enough: units, order count, customer numbers. For this group the correction takes half a day.
Where you meet it
Setting budgets, fixing targets, discussing wages and assessing investments. All four are comparisons made in currency.
Second Cause: The Excluded Group Is Growing
BU BÖLÜMÜN ÖZETİ
- Every ratio has a scope
- As the excluded group grows, the ratio improves
- The denominator needs separate tracking
- Where you meet it
The more insidious mechanism; it appears in ratio indicators.
Every ratio has a scope
Unemployment counts only active jobseekers. Conversion counts only visitors who arrived. A satisfaction survey counts only those who replied.
As the excluded group grows, the ratio improves
Those falling outside the scope are usually on the negative side: the person who stopped looking, the visitor who never came, the customer who did not respond. The ratio improves while the situation deteriorates.
The denominator needs separate tracking
The denominator is an indicator in its own right. Read apart from it, the source of any improvement stays unknown.
Where you meet it
In unemployment, conversion, satisfaction, click-through and return rates. Without an indicator for the denominator, the ratio misleads on its own.
Third Cause: A Layer Moved In
BU BÖLÜMÜN ÖZETİ
- New actors sit between indicator and outcome
- The indicator still measures correctly
- Explanatory power falls as the layer thickens
- Where you meet it
The newest mechanism and the slowest to fix.
New actors sit between indicator and outcome
A summary layer, a model layer and an agent layer have moved between your ranking and your visitor. Each one weakens the link a little further.
The indicator still measures correctly
Your ranking really is where it says. The problem is that the position no longer brings the visitors it did. The measurement did not break; what it corresponds to changed.
Explanatory power falls as the layer thickens
Ranking once explained most of the traffic. The share it explains today has narrowed and continues narrowing.
Where you meet it
In search visibility, platform-mediated sales and enquiries arriving through intermediaries. Anywhere a system sits between you and the outcome.
Whose Problem Is This?
BU BÖLÜMÜN ÖZETİ
- Those sitting comfortably
- Those under pressure
- Those outside it
- How it compounds
Exposure follows which mechanism you face.
Those sitting comfortably
Businesses reading their indicators in pairs. The same defence works against all three mechanisms: a second number.
Those under pressure
Businesses deciding from a single dashboard. Here the problem surfaces only on the outcome side — cash pressure, customer loss — and the cause gets hunted at that point.
Those outside it
Very small businesses doing no measurement escape this particular error; their difficulty is different. Once growth begins, however, they walk straight into the same trap.
How it compounds
The indicator looks fine, the problem goes unnoticed, a loss surfaces on the outcome side, the cause is sought in the wrong place and the fix goes there too. Misdiagnosis costs more than the problem itself.
Which One Are You Facing?
Three questions separate the three mechanisms.
All three can apply at once
In an e-commerce business, revenue faces the first mechanism, conversion rate the second and search visibility the third. Three separate corrections are needed simultaneously.
A Solid Digital Foundation
BU BÖLÜMÜN ÖZETİ
- Appearing and being chosen have separated
- Channel diversity is a defence
- Accumulate your own data
- Measurement is set up once
The third mechanism is most visible on the search side.
Appearing and being chosen have separated
Your impressions can rise while clicks fall; your ranking can hold while citation changes. The Google Search Central documentation explains how impression and click data should be read apart. Visibility is no longer measured by a single number.
Channel diversity is a defence
Traffic sitting behind a single system disappears entirely when that system changes. Email and direct relationships spread that risk.
Accumulate your own data
Where a customer arrives through an intermediary and their details stay with the intermediary, the customer leaves when the intermediary does. This is the most concrete protection against layer risk.
Measurement is set up once
Paired indicators and channel separation, defined once, generate data every period. We cover the setup within digital consulting and the wider picture in our guide to the period.
Frequently Asked Questions
Sık Sorulan Sorular
Then the first mechanism applies. Adding a quantity-based pair resolves it, and this is the fastest group to fix.
Then look to the second: its denominator may be moving. The denominator needs tracking separately.
Where a platform, search engine or intermediary sits in between, the third mechanism is at work. Here a paired indicator is not enough on its own; a channel that measures the outcome directly is also needed.
No. Adding a pair to each without dropping any is enough; the existing indicators still measure correctly.
With three questions: is it denominated in money, is it a ratio, is there a system in between? The answers indicate which correction is needed.
The first. Adding a quantity pair to currency indicators takes half a day and delivers immediately.
You cannot remove the intervening layer, but you can build channels independent of it. Your own customer data and direct contact do that job.
The mechanisms are not new; their magnitude is. High inflation and intervening systems made the effect impossible to ignore.
With the indicator driving the most decisions. That is usually revenue, and it is also the easiest to correct.
Source: Prepared from the shared mechanism analysis across the six developments covered in this set.