Worse here than elsewhere. Layout tests win 6% of the time on product pages, against 15% across all page types. The category is not the problem; this page is.
Headline tests carry a higher published rate on product pages — 18% on 100+ tests — though see the note below before reading that as a recommendation.
Small sample. Few of these tests cleared the bar. The 95% interval on that win rate runs 2% to 15%, so read the figure as directional.
| product pages | all page types | |
|---|---|---|
| Tests analysed | 50+ | 250+ |
| Beat control | 6% | 15% |
| No measurable difference | 68% | — |
| Lost to control | 26% | — |
| Median lift when it won | not reported | — |
Median traffic per variant was 4693 visitors.
| change type | win rate on product pages | tests |
|---|---|---|
| Headline | 18% | 100+ |
| Styling | 11% | 250+ |
| Social proof | 11% | 50+ |
| Split URL | 9% | 100+ |
| Price framing | 8% | 38 tests |
| Body copy | 7% | 100+ |
| Layout (this page) | 6% | 50+ |
| CTA copy | 6% | 48 tests |
Only change types with at least 30 tests on product pages appear here.
A win rate only means as much as the thing being counted, so this is what these tests were actually optimising for.
| measured outcome | share of tests |
|---|---|
| Purchase / order complete | 56% |
| Add to cart | 13% |
| Lead / form submission | 9% |
| Signup / registration | 6% |
Outcomes below 5% of the set are not listed, so these do not sum to 100. How the outcome was measured moves the win rate a lot — see the methodology.
These rates are not like-for-like. How often a test wins depends partly on what it chose to measure: a goal that records a soft signal — a click, a scroll — clears the bar more often than one that records a purchase. Across this data, tests measured against a proxy goal win 13%, against 9% for tests measured against a business outcome.
Categories differ a lot in that mix — proxy goals account for anywhere from 2% to 41% of a category's tests.
Hold the metric fixed and the spread narrows sharply. Comparing only tests measured against a business outcome, the gap between the highest and lowest category falls from 9 points to 6 — at which point the intervals overlap and the categories are not statistically distinguishable.
So read the table as a description of what happened, not as a ranking of what works. If you want the comparison to mean something, compare categories that were measured the same way. The methodology page has the full breakdown.
Blocks move, reorder or change position. No copy is rewritten and no new content is added. If you moved a section <em>and</em> rewrote it, that is two variables and the result will not tell you which one worked.
A new sticky mobile bottom bar was added with a variant selector, price display, and an add-to-cart button that matched the existing action.
It replaced the course info section with a bundle upsell box that added a badge, offer copy, price, a payment plan tooltip, and an enroll button.
One element was shown by removing hidden classes, two other elements were removed from the page, and hidden form tracking field values were set.
The page changed from a dark theme with a benefits bullet list to a light theme with a navigation menu, eyebrow tagline, intro paragraph, checklist, and updated form heading and fields.
The first and fifth product gallery thumbnails were swapped, and the main image was updated to match the new first thumbnail.
The saddle guide image was hidden, and a saddle guide quiz element was shown in its place.
The fit chart block moved to immediately after the buy buttons instead of its original position.
These are individual tests, not rules. Each ran on one site, with one audience, against one page we are not showing you. They are picked to be illustrative rather than sampled at random, and a change that won here can lose on your page for reasons none of this captures. Read them as prompts for what to test, not as findings to copy.
This is every Mida account that ran a readable test — in-house marketers, founders, product teams, and agencies working on client sites. Nothing here is filtered by who ran the experiment or how experienced they are.
Low win rates are normal in experimentation, including at the top end. Microsoft's experimentation team, reporting on its own platform, found that only about one third of ideas improve the metric they were designed to improve — and that roughly another third actively hurt it. That is a dedicated experimentation organisation with research, prioritisation and review behind every test.
A mixed population like this one runs below that. The gap is roughly what disciplined practice buys you: ideas grounded in research rather than opinion, one variable at a time, and tests built so the result can actually be read.
So treat these as a general base rate, not a target. If you would rather not close that gap the slow way, find a CRO agency in the United States, the United Kingdom, the Netherlands or Australia — or browse every region.
A win is a variant that beat its control on that test's primary goal with a statistically significant result. Tests that never got enough traffic to say anything either way are excluded. The methodology has the full detail, including what these numbers cannot tell you.
Mida.so is a super lightweight A/B testing tool to help you experiment, analyze and implement conversion strategies in minutes.
Still deciding?
A quick screen share on your actual site — no slides, no generic tour. Just your questions answered.
30 min · no commitment · no sales pressure