
Incrementality testing: What geo and holdout lift tests measure, and where they fall short
What geo lift and holdout incrementality tests actually measure, where each falls short, and where always-on causal measurement fills the gap.

AI is reshaping marketing mix modeling, from open-source Bayesian models to causal structure learning. What's changing, and what it means for your budget.

Chief marketing officers now put 15.3% of their budgets into AI. Only 30% say they are ready to scale it, according to Gartner's 2026 CMO Spend Survey.
Scaling AI means trusting it enough to move budget on it, and that trust rests on measurement. Marketing mix modeling is the measurement in question, which is why that gap sits directly on top of it, and part of why the method is back in favor at Fortune 500 consumer brands and fast-scaling ecommerce companies alike. AI is the reason the conversation has changed.
The question I hear from CMOs and growth leads is the same. Is AI making the model better, or just easier to talk to? The honest answer separates the two, and it starts with what marketing mix modeling was always built to do.
Marketing mix modeling (MMM) is a statistical method that uses aggregated historical data, including sales, media spend by channel, price, promotions, and seasonality, to estimate how much each input contributes to a business outcome. It works at the aggregate level, so it needs no cookies and no user-level tracking.
MMM has served marketers well for decades, and I want to be fair to it. Before digital attribution arrived, it was how consumer brands set national budgets, and it still answers questions that click-based measurement cannot.
Its resurgence is really about signal loss. Google confirmed it will keep third-party cookies in Chrome, so the cookie survives, yet the identifiers that power user-level tracking keep degrading. Aggregate methods hold up under that erosion, which is why the Fortune 500 CPG planner and the DTC growth lead have both come back to MMM.
Ask the problem with marketing mix modeling and most teams would be quick to blame data quality, too many channels, or tooling that cannot keep up. So budgets move to chase them. But the results stay flat, because the real constraint lies elsewhere.
That constraint is the model's architecture. Traditional MMM is built on correlation: it reads which inputs moved alongside sales and infers effect from co-movement, which breaks down the moment two channels rise and fall together.
I won't re-derive the mathematics here, because we've already set out why the correlation-based architecture has held marketing measurement back for decades, with multicollinearity as the specific failure.
That same architecture fragments the business. A correlation model strains as the variables pile up, and a second business function breaks its assumptions outright, so each function ends up running a model of its own. That is what creates the silos and fragmentation: the CFO's forecast and the CMO's plan sit on different models, and neither team can prove the other wrong.
The shift underway replaces correlation with causal inference, modeling the relationships between activities, not simply their statistical association with an outcome. That is the ground causal AI is built on, and it is what lets a model genuinely answer a what-if question, forecasting the effect of a change before you make it.
AI is reshaping marketing mix modeling along four fronts at once. Gartner predicts that 70% of large organizations will adopt AI-based supply chain forecasting to predict future demand by 2030. I expect marketing measurement to move on the same curve.
The most visible change is that serious MMM went open source. Google released Meridian, an open-source marketing mix modeling framework built for privacy-durable measurement.
Robyn, Meta's contribution, is an automated MMM package from its Marketing Science team that reduces the manual choices an analyst has to make.
And PyMC-Marketing brought Bayesian marketing mix modeling to any Python team. Bayesian methods matter here because they carry uncertainty explicitly and let an analyst encode prior knowledge. It is a method for combining what you already believe with what the data shows, and updating as new data arrives. If you have ever revised a forecast as the numbers came in, starting from what you expected and adjusting as evidence landed, you have reasoned the Bayesian way.
The output is a distribution of plausible values where a classical model would hand back one point estimate and call it truth. For the DTC growth lead, this is the moment MMM became something a lean team could run in-house, versus being a six-figure consulting engagement.
Automated marketing mix modeling turns MMM from an annual project into a standing capability. Where a team once commissioned a study a year, the model now refreshes continuously as new sales and spend data arrive, so the answer keeps pace with the plan.
A growth lead who reallocates budget every week feels that speed directly: the model finally keeps pace with the decisions it feeds. But automation only changes the cadence; the method underneath is untouched.
What we see consistently across Fortune 500 brands is that speed without a change in architecture just scales the error. This is the trap to be wary of. Automating a correlation-based model does not fix its blind spots. It only reproduces them faster and makes a confident wrong answer available on demand.
AI agents are the layer most people notice first. They sit on top of the model as natural-language interfaces and media-buying assistants, so a marketer can ask a question in plain English or push a reallocation without touching code.
For a time-poor CMO, that accessibility is genuine progress. The output of a model that once lived in an analyst's notebook becomes something the whole team can query and act on.
But an agent is only as good as the model it reads from. Sitting on a correlation-based model, it will answer fluently and still inherit every blind spot, because it reports the model's view of the world without correcting it. Accessibility is one thing; accuracy is another.
Causal structure learning changes marketing mix modeling by modeling how activities actually relate to each other and to sales, going beyond simple correlation. It uses causal graphs, or directed acyclic graphs, to separate genuine cause from coincidence, so the model can estimate what would happen if you cut a channel, projecting forward from the cause it has identified.
This is the one change on the list that rebuilds the model itself; the other three work on top of it. Causal graphs are great at disentangling causes from correlations, which is precisely what a flat regression cannot do.
The academic direction is clear. The CausalMMM paper, an early-stage research preprint shared publicly before formal peer review, learns causal structure directly from the data, where older models simply assumed it, and work like DeepCausalMMM uses directed acyclic graphs to represent how channels influence one another. That is the difference between running the old model faster and building a better one.
Marketing mix modeling and multi-touch attribution answer different questions. MMM works top-down on aggregated data to estimate each channel's contribution, while multi-touch attribution (MTA) works bottom-up, tracing individual user paths to credit touchpoints. AI improves both, but it does not make one method win; the two still produce different numbers.
The enterprise CPG planner tends to trust MMM, and the DTC growth lead grew up on attribution, so the two segments often talk past each other. Both are right about their own method and wrong to expect it to answer the other's question.
Each method gets more accurate with AI, yet the deeper problem stays untouched: you still hold two models and two truths, with no principled way to reconcile them. We work through marketing mix modeling vs multi-touch attribution, and where each method breaks down, in a separate piece.
Marketing mix modeling is as accurate as the method behind it. Traditional regression-based MMM gives directional guidance, useful for setting broad budgets though too coarse for precise channel calls. AI methods change the ceiling: modern machine-learning models cut forecasting error well below traditional statistical baselines, though accuracy still depends on data quality and model design.
The clearest evidence comes from forecasting research, the field closest to what MMM does: predict sales from past inputs. There, deep-learning models have pulled ahead of the classical regression that traditional MMM runs on.
One of them, a CNN-LSTM (Convolutional Neural Network-Long Short-Term Memory) built for time-series data, hit a mean absolute percentage error of 4.16% on retail sales data, according to a September 2025 study in PeerJ Computer Science. That is a level classical regression struggles to reach.
The harder issue is coverage, well before precision. Classic MMM reports a single layer of each channel's contribution and misses the rest, meanwhile your channel ROI has more layers than your MMM reports. Accuracy that measures the wrong thing precisely is still the wrong number.
Choose a marketing mix modeling approach by what it measures and what it leaves out, looking past the feature list. The questions that matter are whether it estimates causal effect or correlation, and whether it gives you one model across functions or adds another siloed one. Explainability and fit to your data reality matter just as much.
The specifics differ by segment, but the tests are shared. Run any approach against the following:
The direction of travel is clear: one causal model that measures every marketing driver at once, where teams once ran three.
The gap between the advertisers who compound growth and the ones who tread water is rarely budget size. It is measurement: knowing what actually caused the last unit of growth, and putting the next dollar there.
This is the problem we built for. POEM365, DATA POEM's Large Causal Model (LCM), is built on FOUNT's Large Causal Architecture (LCA). It measures causal incrementality across every channel and function in a single model. The CFO's forecast and the CMO's plan are drawn from the same source of truth, which is what unified marketing means in practice.
For the enterprise CPG planner it ends the standoff between finance and marketing. For the DTC growth lead it replaces a stack of partial models with one that can be trusted to guide the next dollar.
Marketing mix modeling and media mix modeling are used interchangeably, and both shorten to MMM. Strictly, marketing mix modeling is the broader term, covering price, promotion, and distribution alongside media, while media mix modeling narrows the focus to paid media channels. Most vendors mean the broader method.
Marketing mix modeling can work for DTC and small ecommerce brands, but the binding constraint is data history. A model needs enough consistent weekly sales and spend to see seasonality, usually two to three years, before its read is reliable. While you accumulate that, log spend cleanly by channel and lean on simpler benchmarks; the history you bank now is what makes the later model trustworthy.
An AI marketing mix model needs format more than volume: a weekly aggregated time series with one consistent channel taxonomy held steady over the whole period, so a renamed or merged channel doesn't break the history. No user-level identifiers are required; everything sits at the aggregate level, which is exactly why it survives signal loss.
Marketing mix modeling still works as signals degrade, and in practical terms almost nothing changes on your side. Because the model reads aggregated inputs that never depended on identifiers, you don't re-tag your site, re-platform your stack, or rebuild anything as cookies and device IDs decay. The weekly feed that worked last year keeps working, so the method stays a stable base while attribution wobbles.
If you take one thing from this, make it this: the constraint on marketing measurement is no longer data or tooling, it's whether your model measures cause or correlation. AI raises the ceiling on both, but only a causal model changes what you can actually know.
The practical next step is small and manageable. You don't have to rip out what you run today. You have to stop asking which of your partial models to believe and start from one that measures what caused growth.
For the enterprise planner and the DTC growth lead alike, that's the shift worth making this budget cycle. See how a single causal model replaces the patchwork in our approach to unified marketing, then book a demo to run your own mix through it.

Head of Growth Marketing
Let's talk about how we can help you grow your business.

What geo lift and holdout incrementality tests actually measure, where each falls short, and where always-on causal measurement fills the gap.

Predictive analytics tells you what will happen; causal AI tells you what to do about it. The methodology difference, and when each one fits.

See the mechanism behind causal AI's replacement of MMM, MTA, and forecasting models for enterprise revenue decisions, and where each still falls short.

AI agents execute marketing decisions at scale. But can they own them? Why LLM agents recommend but don't decide, and what causal reasoning changes.