Incrementality testing consultant · New York City
I'm Chelsea Cramer, an independent incrementality testing consultant. I design and read geo experiments, holdout tests and lift studies that show the real return on your spend, not what the platforms claim.
Book a 30-min callEmail meEvery ad platform reports its own results, and every one of them over-credits itself. Incrementality testing answers a simpler question: what would have happened without this spend? By holding out a group of people or markets and comparing them to a group that saw the ads, you measure the lift a channel truly causes, not just the conversions it touched.
Brands usually bring me in when they want to:
At Credit Karma, I ran the paid marketing experimentation program behind a $300M+ budget, with geo tests across Google Search, Meta, TikTok, Apple Search Ads, DV360, Moloco, linear TV and CTV. I automated geo-test monitoring in Python and SQL, replacing six-week readouts with weekly checkpoints so the team could run more tests at once. Those results calibrated the marketing mix model that guided spend as budget scaled from $100M to $300M.
At Talkiatry, I built the lifecycle experimentation roadmap and revenue-impact reporting, taking email and push testing from zero to 10 tests a month. At Robinhood, I use geo-lift experiments and brand lift studies to validate upper-funnel brand spend.
I work as an independent incrementality testing consultant on a project or fractional basis, from designing and reading a single high-stakes test to building an ongoing experimentation program and roadmap. I do the design and analysis myself, so you work directly with me.
Common questions
Incrementality testing measures the extra sales or sign-ups a marketing channel actually causes, by comparing a group exposed to the marketing with a similar group that wasn't. It separates true lift from conversions that would have happened anyway.
A geo experiment changes spend in some geographic markets while leaving matched markets unchanged, then compares results. Because it works on aggregate market data, it can measure channels like TV and CTV and isn't affected by cookie or tracking loss.
Most tests run between two and eight weeks, depending on your sales volume, the size of the expected effect and the channel's lag. I size each test up front so it runs long enough to give a clear answer.
They can be useful, but the platform is grading its own work and controls the method. I use them where they're sound and add independent geo tests to check the results.
They work best together. Experiments give precise, causal reads on specific channels, and the marketing mix model covers everything at once. Calibrating the MMM with test results makes the whole picture more accurate.
Work with me
A 30-minute call is enough to tell whether I can help and what a first engagement would look like. I'm based in New York City and happy to meet in person.
Book a 30-min call