SEO split test planner

Picks a control group and tells you sample size and duration

This tool is planned. Sign up and we’ll email you when it ships.

Planned cost: 1 credit

PlannedSEO split test planner
Input
your topic
Options
Default
Runuses 1 credit
Output
First result
Second result
Third result
Illustration — sample content, not a screenshot or a real resultNotify me when it’s live

Overview

What it does

Plans a legitimate SEO test: treatment, control group, sample requirements, duration and how to measure it.

Method

How it works

1. Upload a Search Console export

Page-level data for the section you want to test. Nothing else is stored — the file is processed and discarded.

2. Describe the change

What you intend to alter, and on which pages.

3. It picks a control group

Pages matched to your test set on traffic, position and trend, so the two groups behave the same before you change anything. This is the step that makes the result mean something.

4. It tells you how long to run

Based on the traffic you have and the effect size worth detecting. If your sample is too small to detect anything useful, it says so rather than giving you a number that will mislead you.

Example

Sample output

Illustrative example. The tool is not connected yet, so this shows the shape of the output rather than a real run.

Input

142 product pages. Proposed change: rewrite meta descriptions.

Output

  • Test group: 71 pages

  • Control group: 71 pages, matched on impressions, average position and 90-day trend

  • Run for: 6 weeks

  • Detectable effect: a 6% change in click rate or larger

Warning: 18 pages excluded — too little traffic to contribute.

FAQ

Common questions

What does it cost, and what do I need to run it?

What does it cost, and what do I need to run it?

One credit, and a Search Console export for the pages you want to test. All the statistics run in code rather than through an API, so the cost is the base rate. Free gives you one full plan at a time; Pro saves them so you can come back when the test finishes. See pricing. A plan costs one credit whether it covers ten pages or a thousand, since the work is the same. The results analyzer is priced the same way.

What happens to the file I upload?

What happens to the file I upload?

It is processed to build the plan and then discarded. Without an account nothing about the run is stored once the result comes back — not the file, not the URLs, not the output. With a Pro account the plan is saved to your history so you can return to it, and you can delete any run or the whole history. The privacy policy has the detail. Anonymous runs are not logged anywhere, including in error traces.

Why does it insist on a control group?

Why does it insist on a control group?

Because without one you are measuring seasonality and calling it a result. Traffic moves for a dozen reasons that have nothing to do with your change. A matched control group experiences the same seasonality, so the difference between the two groups is the part your change is responsible for. That comparison is what the results analyzer reads. Picking the control group by hand is where most homemade tests go wrong, usually by choosing pages that were already trending differently.

What if I do not have enough traffic?

What if I do not have enough traffic?

Then it says so rather than giving you a number that will mislead you. Below a certain volume no test length will detect a realistic effect, and a plan that pretends otherwise wastes eight weeks. It will tell you the smallest effect your data could detect, so you can decide whether that is worth running at all. Being told a test is not worth running is the cheapest result the tool can give you. The AI SEO tools guide makes the same argument about measurement generally.

Is this tool available now?

Is this tool available now?

Not yet. It’s on the SERPish roadmap. Join the waitlist and you’ll get an email when it’s live.

Get new SERPish things, when they’re ready.

Subscribe

Get new SERPish things, when they’re ready.

Subscribe