---
title: How to Read Lift Test Results Without Mistakes
description: How to read an incrementality lift test: lift, confidence interval, p-value and incremental installs, the mistakes that turn noise into wins, what to report.
url: https://incrementalitycalculator.com/learn/read-lift-test-results/
---

[Start](https://incrementalitycalculator.com/) / [Learn](https://incrementalitycalculator.com/learn/) / Reading results

# How to read lift test results without fooling yourself

How to read an incrementality lift test: lift, confidence interval, p-value and incremental installs, the mistakes that turn noise into wins, what to report.

**Short answer**

Read a lift test from its confidence interval, not its headline number. If the whole 95% interval sits above zero, the ads most likely added conversions, and the low end is the safe planning number. If the interval crosses zero, the test could not tell, which is not the same as proving the ads do nothing.

## What a lift test result contains

A lift test result is an estimate of how much the ads raised the conversion rate, with a range showing how uncertain that estimate is.

**Lift:** (test rate minus control rate) divided by control rate. A 1.2% test rate against a 1.0% control rate is a 20% lift.

**Confidence interval:** the range of lifts consistent with the data at a chosen confidence level, usually 95%.

**Incremental conversions:** the rate difference times the number of people in the test group.

Everything else, from incremental CPI (the causal version of [cost per install](https://linkrunner.io/glossary/what-is-cost-per-install?utm_source=incrementalitycalculator&utm_medium=referral&utm_campaign=learn-read-lift-test-results&utm_content=inline)) to iROAS, is built from these.

## How do you know if a lift result is real?

Look at the 95% interval. If all of it sits above zero, the result is unlikely to be noise; if it crosses zero, the test cannot distinguish the effect from chance. The p-value says the same thing in another form: below 0.05 matches an interval that excludes zero.

## Same lift, different answers

Sample data: a made-up app to show the method, not a benchmark.

Two made-up tests both report a 15% to 20% lift. Only one is usable.

|  | Test 1 | Test 2 |
|---|---|---|
| Control conversions | 100 | 500 |
| Lift | +15% | +20% |
| 95% interval | about −6% to +36% | about +11% to +29% |
| p-value | about 0.16 | below 0.001 |
| Verdict | Cannot tell | Positive and clear |

Test 1's headline looks fine, but its interval includes zero and even a small negative effect. Test 2, with five times the control conversions, pins the lift between roughly 10% and 30%. Paste either into the [lift test reader](https://incrementalitycalculator.com/labs/lift-reader/) to see the working.

## Seven mistakes that turn noise into wins

1. **Reporting the point estimate alone.** "+20%" without its range invites budget decisions the data cannot support. Always show the interval.
2. **Stopping when it looks good.** Checking daily and stopping at the first significant day inflates false wins. Fix the length before starting; the [holdout simulator](https://incrementalitycalculator.com/labs/holdout-simulator/) shows an estimate that clears zero and then slips back.
3. **Calling an inconclusive test a failure.** An interval of −10% to +40% means the test was too small, not that the ads do nothing.
4. **Mixing up percentage lift and percentage points.** A 20% lift on a 1% rate is 0.2 percentage points, or 2 extra installs per 1,000 people reached.
5. **Comparing test-group incremental installs with campaign-wide attributed installs.** Scale to the same population first: incremental installs from the test group cover only the people in the test group.
6. **Ignoring contamination.** If the control group was reached by another campaign, a retargeting list or the same ads on another device, the measured lift shrinks. Note what else ran.
7. **Reading many slices and reporting the best.** Split a test into ten audiences and one will look significant by chance. Decide the cuts in advance.

## From lift to incrementality

Most teams want a single share: of the installs this campaign was credited with, how many did it cause?

**Incrementality** = incremental conversions ÷ attributed conversions in the same group and period

Sample data: a made-up app to show the method, not a benchmark.

Suppose the test group had 2,160 installs and 360 of them were incremental (a 20% lift on a 1% control rate across 180k people). If the attribution tool credited the campaign with 900 of those 2,160 installs, incrementality is 360 ÷ 900, or 40%. The other 540 credited installs would have happened anyway.

The denominator matters. Use attributed installs from the test group over the test period, not the campaign's lifetime totals.

## What to report

A one-paragraph read-out that holds up in a budget meeting:

- **What was tested:** channel, audience, regions or holdout share, dates.
- **The result:** lift with its 95% interval, and incremental installs.
- **The comparison:** incrementality against attributed installs, and incremental CPI.
- **Caveats:** what else changed during the test, and whether the planned length was reached.
- **The decision:** what you will change, planned on the cautious end of the interval.

A guide to [measuring true marketing ROI](https://linkrunner.io/blog/how-to-measure-true-marketing-roi-in-mobile-apps-complete-guide?utm_source=incrementalitycalculator&utm_medium=referral&utm_campaign=learn-read-lift-test-results&utm_content=inline) covers how to carry these numbers into a finance conversation. When platform and MMP numbers disagree before you even start, Attribution Debugger's guide on [which number to trust](https://attributiondebugger.com/guides/which-number-to-trust/) helps settle the baseline.

## Platform reports vs your own maths

Platform lift studies sometimes report at confidence levels other than 95%. Google's App Uplift experiments, for example, offer 80%, 85% and 95% and recommend 80% (Google Ads Help, read 26 Oct 2026). Lower confidence gives faster answers and more false positives, so note the level when you compare tests. The [platform guide](https://incrementalitycalculator.com/learn/incrementality-meta-google-apple/) has the details.

Run this on your own data

A lift result becomes a budget number when you set it against each channel's attributed installs and revenue, which your MMP reports daily. Linkrunner's free plan covers 25k attributed installs, with no credit card and every feature included.

- [Measuring true marketing ROI for mobile apps](https://linkrunner.io/blog/how-to-measure-true-marketing-roi-in-mobile-apps-complete-guide?utm_source=incrementalitycalculator&utm_medium=referral&utm_campaign=learn-read-lift-test-results&utm_content=panel)
- [Incrementality testing, defined](https://linkrunner.io/glossary/what-is-incrementality-testing?utm_source=incrementalitycalculator&utm_medium=referral&utm_campaign=learn-read-lift-test-results&utm_content=panel)
- [Create a free account](https://dashboard.linkrunner.io/sign-in?utm_source=incrementalitycalculator&utm_medium=referral&utm_campaign=learn-read-lift-test-results&utm_content=panel)

## Questions

**What p-value should I use for a lift test?**

Below 0.05 is the convention, matching a 95% interval that excludes zero. If you use a looser level such as 80% to move faster, say so and expect more results that do not hold up on retest.

**My test showed a negative lift. What now?**

Check the set-up first: was the split random, did the control group stay unexposed, and did both groups have the same tracking? A clearly negative result after those checks is rare and worth repeating before acting on.

**How precise does a result need to be?**

Precise enough that the low end of the interval and the high end would lead to the same decision. If the low end says cut and the high end says scale, the test needs more volume.

**What is incrementality in app marketing?**

Incrementality is the share of conversions that would not have happened without the ad. It is measured by comparing people who could see the ads with a similar group who could not, so it captures what the ads changed rather than what they were credited with.

**Is attributed the same as incremental?**

No. Attribution credits a campaign when a user touched an ad before installing, even if that user would have installed anyway. Incremental installs are only the ones the ads caused, so they are always equal to or fewer than attributed installs.

**How big should my holdout group be?**

Big enough that the control group collects enough conversions to detect the lift you care about within the time you can wait. Lower conversion rates and smaller expected lifts need bigger holdouts or longer tests; the holdout simulator on this site shows the trade-off.

## More guides

- [01 **What is incrementality in app marketing?** Incrementality in app marketing explained: the share of installs and revenue your ads really caused, how it differs from attribution, and how to measure it.](https://incrementalitycalculator.com/learn/what-is-incrementality/)
- [02 **Holdout, geo lift, ghost ads, PSA and on/off tests** Compare incrementality test types for app marketers: user holdouts, geo lift, ghost ads, PSA and on/off tests, plus how to run a geo lift test for installs.](https://incrementalitycalculator.com/learn/incrementality-test-types/)
- [03 **How big should my holdout group be?** How to size an incrementality holdout for an app: control conversions needed, and how holdout share, install rate and expected lift set the test length.](https://incrementalitycalculator.com/learn/holdout-group-size/)
- [04 **Incrementality on Meta, Google and Apple Search Ads** How to test incrementality on Meta, Google App Campaigns and Apple Search Ads: what each platform's lift tools offer, their published rules and the fallbacks.](https://incrementalitycalculator.com/learn/incrementality-meta-google-apple/)
- [05 **Which UA campaigns are cannibalising organic installs?** How to identify which UA campaigns are cannibalising organic installs: brand search and retargeting patterns, a four-step data check, and how to test it.](https://incrementalitycalculator.com/learn/cannibalisation-brand-retargeting/)
- [06 **MMM vs MTA vs incrementality testing** Media mix modelling, multi-touch attribution and incrementality tests compared for app marketers: what each measures, the data needed, how they fit together.](https://incrementalitycalculator.com/learn/mmm-mta-incrementality/)
- [07 **How to act on incrementality results** Turn incrementality test results into budget decisions: incremental CPI and iROAS by channel, moving spend in steps, when to retest, and reading CTV and brand.](https://incrementalitycalculator.com/learn/act-on-incrementality-results/)