How it works
The A/B test is the reference method.
- Storefront visitors are split at random into two groups.
- Group A sees the tool being tested, for example the AI Shopping Assistant. Group B, the control group, does not.
- After a long enough period, you compare revenue per visitor in the two groups.
- The gap, scaled to total traffic, gives the incremental revenue.
Because both groups are drawn at random, the gap can only be explained by the tool being tested.
Why it matters in e-commerce
It is the metric that answers the question asked of any investment: what did it bring in on top? It lets you calculate a real return on investment, by comparing incremental revenue with the cost of the tool. It also avoids crediting a tool with sales that would have happened anyway.
Real-life example: Samsonite
Samsonite measured the effect of the iAdvize AI Shopping Assistant with an A/B test over three months. The result was a 2.2x return on investment, driven by both higher conversion and higher average order value. With that proof, the brand scaled the assistant to 12 sites across its five brands.
Common confusion
Incremental revenue is often confused with AI-influenced revenue. AI-influenced revenue counts all sales from shoppers who interacted with the AI, including those that would have happened without it. Incremental revenue only keeps the difference the AI made. See: AI-influenced revenue.