Mida's agent reads your own results and tells you what is worth testing next.

Try it for FREE now

Do headline A/B tests work in SaaS / Software?

In line with both baselines. Headline tests win 6% in SaaS / Software, against 8% for headline tests generally and 9% for SaaS / Software generally. Neither the category nor the vertical is moving this much.

The strongest change type we can measure in SaaS / Software is Styling at 13% on 100+ tests.

The numbers

Won 6% No measurable change 85% Lost 9%
SaaS / Softwareall industries
Tests analysed100+500+
Beat control6%8%
No measurable difference85%
Lost to control9%
Median lift when it won +47.1%

Median traffic per variant was 828 visitors. Most ran on homepages (166), landing pages (26), lead capture pages (16).

Every change type we can measure in SaaS / Software

change typewin rate in SaaS / Softwaretests
Styling 13%100+
Split URL 12%100+
Body copy 9%33 tests
Headline (this page) 6%100+
CTA copy 2%50+

What headline tests in SaaS / Software measured

A win rate only means as much as the thing being counted, so this is what these tests were actually optimising for.

measured outcomeshare of tests
Signup / registration54%
Purchase / order complete13%
Booking / appointment10%
On-page click / engagement9%

Outcomes below 5% of the set are not listed, so these do not sum to 100. How the outcome was measured moves the win rate a lot — see the methodology.

Why this table is not a ranking

These rates are not like-for-like. How often a test wins depends partly on what it chose to measure: a goal that records a soft signal — a click, a scroll — clears the bar more often than one that records a purchase. Across this data, tests measured against a proxy goal win 13%, against 9% for tests measured against a business outcome.

Categories differ a lot in that mix — proxy goals account for anywhere from 2% to 41% of a category's tests.

Hold the metric fixed and the spread narrows sharply. Comparing only tests measured against a business outcome, the gap between the highest and lowest category falls from 9 points to 6 — at which point the intervals overlap and the categories are not statistically distinguishable.

So read the table as a description of what happened, not as a ranking of what works. If you want the comparison to mean something, compare categories that were measured the same way. The methodology page has the full breakdown.

The industry overview is at SaaS / Software benchmarks; rates across all industries are on the headline benchmark.

What counts as a headline test

The main heading is rewritten. Structure, styling and every other element stay put.

Control and variant wireframe for a headline A/B test
Control on the left, variant on the right. Only the changed element is highlighted.

Headline tests that won in SaaS / Software

  • The hero headline and subhead copy were changed, and the hero image of a person with an app screenshot was replaced with a phone and laptop mockup collage.

    Homepage+34.7%

  • The left-aligned headline and subhead were replaced with a centered mind-mapping headline, eyebrow text, and a new illustrated hero graphic with converging lines and avatars.

    Homepage+7.1%

  • The plain text headline and static screenshot hero were replaced with a translated headline inside an illustrated mind-map graphic, and the CTA button was restyled as a pill shape.

    Homepage+6.9%

  • The headline changed from a vague title to a short call-to-action inviting users to join the brand.

    Homepage+47.1%

Headline tests that did not

  • The centered generic headline was replaced with a left-aligned benefit-driven headline, a bullet list, category pills and focus-area buttons, and a product screenshot on the right.

    Landing pageNo significant difference

  • The heading and subheading changed from a general introduction to a free medical evidence evaluation for veteran disability rating accuracy, with a prompt to answer the questions below.

    Lead capture pageNo significant difference

  • The headline and subhead changed from saving on fleet costs to fewer parked vehicles and more mileage return, and the hero image and dashboard graphics also changed.

    Landing pageNo significant difference

These are individual tests, not rules. Each ran on one site, with one audience, against one page we are not showing you. They are picked to be illustrative rather than sampled at random, and a change that won here can lose on your page for reasons none of this captures. Read them as prompts for what to test, not as findings to copy.

Who ran these tests

This is every Mida account that ran a readable test — in-house marketers, founders, product teams, and agencies working on client sites. Nothing here is filtered by who ran the experiment or how experienced they are.

Low win rates are normal in experimentation, including at the top end. Microsoft's experimentation team, reporting on its own platform, found that only about one third of ideas improve the metric they were designed to improve — and that roughly another third actively hurt it. That is a dedicated experimentation organisation with research, prioritisation and review behind every test.

A mixed population like this one runs below that. The gap is roughly what disciplined practice buys you: ideas grounded in research rather than opinion, one variable at a time, and tests built so the result can actually be read.

A win is a variant that beat its control on that test's primary goal with a statistically significant result. Tests that never got enough traffic to say anything either way are excluded. The methodology has the full detail, including what these numbers cannot tell you.