Mida's agent reads your own results and tells you what is worth testing next.

Try it for FREE now

Do split URL A/B tests work in SaaS / Software?

Better than the SaaS / Software average, though not because the industry helps. Split URL tests win 12% there against 9% for all change types in SaaS / Software. Across all industries split URL tests run at 11%, so the category is carrying this, not the vertical.

The strongest change type we can measure in SaaS / Software is Styling at 15% on 100+ tests.

The numbers

SaaS / Softwareall industries
Tests analysed100+1,000+
Beat control12%11%
No measurable difference68%
Lost to control20%
Median lift when it won +36%

Median traffic per variant was 695 visitors. Most ran on homepages (54), lead capture pages (34), pricing pages (31).

Every change type we can measure in SaaS / Software

change typewin rate in SaaS / Softwaretests
Styling 15%100+
Split URL (this page) 12%100+
Body copy 9%33 tests
Headline 6%100+
CTA copy 2%50+

The industry overview is at SaaS / Software benchmarks; rates across all industries are on the split URL benchmark.

What counts as a split URL test

Traffic is split between two addresses. The variant is a different page at its own URL, not a modified version of the control.

Control and variant wireframe for a split URL A/B test
Control on the left, variant on the right. Only the changed element is highlighted.

Why there are no examples on this page

A split URL variant is a whole separate page, so every description of what changed reduces to "traffic goes to a different page". The detail lives on the variant page itself, which belongs to the customer.

Who ran these tests

This is every Mida account that ran a readable test — in-house marketers, founders, product teams, and agencies working on client sites. Nothing here is filtered by who ran the experiment or how experienced they are.

Low win rates are normal in experimentation, including at the top end. Microsoft's experimentation team, reporting on its own platform, found that only about one third of ideas improve the metric they were designed to improve — and that roughly another third actively hurt it. That is a dedicated experimentation organisation with research, prioritisation and review behind every test.

A mixed population like this one runs below that. The gap is roughly what disciplined practice buys you: ideas grounded in research rather than opinion, one variable at a time, and tests built so the result can actually be read.

A win is a variant that beat its control on that test's primary goal with a statistically significant result. Tests that never got enough traffic to say anything either way are excluded. The methodology has the full detail, including what these numbers cannot tell you.