What skipping incrementality testing actually costs you
Attribution tells you which channel was nearby when revenue happened. Incrementality tells you which channel caused it.
Most teams discover the gap the same way. They pause a channel expecting revenue to fall, and it doesn’t.
That moment is uncomfortable because it invalidates a year of reporting in about ten minutes. But it is also the most useful thing that will happen to the budget all quarter, and the only real question is whether you find it deliberately or by accident.
Attribution answers a different question than you think
Attribution models answer: of the touchpoints we observed, which ones should get credit? That is a bookkeeping question. It assumes the revenue was going to happen and asks how to divide it up.
Incrementality answers: would this revenue have happened anyway? That is a business question, and the two answers routinely disagree. Branded search is the classic case — it attributes beautifully and is frequently buying customers who had already decided.
The cost is not the wasted spend
It is the decisions built on top of it. A channel that over-attributes gets more budget next quarter, which makes it over-attribute further, which justifies more budget. By the time anyone tests it, the number is load-bearing: it is in the board deck, it is in someone’s targets, and disproving it has become politically expensive.
That compounding is the actual cost. The wasted media spend is usually the smaller half.
Running the test is cheaper than you expect

You do not need a perfect experiment. Geo-based holdouts get you most of the way — split comparable regions, suppress the channel in some, watch total revenue rather than platform-reported conversions. Two weeks and a small share of your footprint is often enough to see whether the effect is real.
The discipline that matters is deciding what would change your mind before you look. Write down the threshold. Teams that skip that step reliably find a reason the result was atypical.
What we do with the answer
If a channel is incremental, we scale it and stop apologizing for its attribution. If it is not, we cut it and reallocate — and we say so in the readout, including when it is a channel we recommended. A partner who only reports the results that flatter their own recommendations is not measuring anything.