Mockingbird

Creative testing

How does creative testing work on Meta?

Why ads in one ad set get uneven spend, how Meta's controlled tests split people and budget, and which question each method answers.

7 min read·Updated

Creative testing on Meta works in two broad ways. Advertisers either put several ads in one ad set and let the delivery system move spend towards the ads it predicts will do best, or they run a controlled test that gives each version a fair share of people and budget. Meta offers two controlled options: the A/B test in Experiments, which splits the audience so nobody sees both versions, and a creative test set up inside an ad, which reserves part of the budget for two to five new ads.

After reading this you will be able to

  • Explain why ads in the same ad set receive uneven spend.

  • Describe how Meta's A/B test and creative test split people and budget.

  • Choose a testing method that matches the question you need answered.

  • Read a test result without claiming more than it shows.

Two ways advertisers test creative

Every creative test asks which ad does better. The method decides how fair the comparison is.

The first way is informal. You launch several ads in one ad set, let Meta deliver them, and compare the results. It needs no setup, and it mirrors how ads run once a test is over. The second way is controlled. A Meta tool gives each version its own share of people and budget, so the ads do not compete for delivery and the gap between them means more.

Meta warns against one informal habit in particular, which is switching ad sets or campaigns on and off by hand to compare them. Its help pages say this can lead to overlapping audiences and unreliable results, while its A/B test keeps audiences evenly split and statistically comparable.

What happens when ads share an ad set

Ads in the same ad set share its audience, placements, budget and schedule. The delivery system then decides which ad to show each time. Meta's help pages say the system learns over time which ads perform best, so some ads are delivered more than others, and that an ad earning more engagement runs more often to get the best results for the budget.

That turns an ad set into a contest the system judges as it goes. It forms a view as results come in and concentrates spend on the ads it favours. An ad that gets little spend has not lost a fair test. It has lost the system's prediction, which may rest on very little data. An ad that wins has shown it performs well under the conditions it got, and those conditions included most of the budget.

This method still answers a useful question, namely which ad the system chooses to spend on. For many accounts that is the question that matters, because it is how ads run after the test. It cannot tell you whether a low-spend ad would have done well with equal delivery.

Meta's A/B test in Experiments

Meta's A/B test compares versions of an ad strategy that differ in one variable, such as the creative, the audience or the placement. Meta shows each version to a separate segment of the audience, makes sure nobody sees both, and then picks a winner.

You can create one from the Ads Manager toolbar by duplicating an existing campaign, ad set or ad and changing one thing, or you can compare existing campaigns or ad sets in the Experiments tool. Duplicating copies the budget, while comparing two existing items divides the budget you already have. Meta recommends the same budget for each version and one variable per test. It suggests a minimum of seven days, some of its help pages suggest two weeks, and a test can run for up to 30 days. A test can include up to five versions.

At the end, Meta names the version with the lowest cost per result for the campaign's objective and reports a confidence percentage, its estimate of the chance of getting the same winner if the test ran again. The article on statistical significance in ad tests explains how to read that number.

The creative test inside an ad

Meta added a second controlled option in 2025. Its help centre documents it as setting up a creative test in Meta Ads Manager, and it lives in the ad editor rather than in Experiments. Jon Loomer, a Meta ads consultant who documented the feature in October 2025, describes how it works:

  • You start from an existing or draft ad and create two to five test ads, each a duplicate of it that you then change. The original ad is not part of the test.

  • You set aside part of the campaign or ad set budget for the test. Meta recommends no more than 20%, so the existing ads keep most of the spend.

  • Each person sees only one of the test ads, and Meta aims to spend similar amounts on each.

  • The campaign must use the highest volume bid strategy.

  • You pick the metric that decides the test, such as cost per result, and view results in Experiments.

This design answers a narrower question than a full A/B test. It shows which of the new ads performs best when each gets a fair share, while the rest of the campaign carries on as normal. It suits teams that want to test new creative without building a separate campaign. Later reports say some accounts now allow up to ten test ads, so check what your account shows.

The three methods side by side

Each method trades setup effort against how fair the comparison is and which question it answers.

FeatureSeveral ads in one ad setA/B test in ExperimentsCreative test in an ad
How spend is splitThe system shifts spend towards the ads it predicts will do bestEach version gets its own budget, ideally equalA reserved share of the budget, spread across the test ads
Who sees whatOne person can see several of the adsEach person sees one version onlyEach person sees one test ad only
What it can testCreative, within one audienceCreative, audience, placement and other variablesNew creative inside an existing campaign
How the winner is calledYou compare results yourselfLowest cost per result, with a confidence percentageThe metric you chose, reported in Experiments
What it tells youWhich ad the system prefers to spend onWhich version performs better with a fair splitWhich new ad performs best with a fair split
What it cannot tell youHow a low-spend ad would do with equal deliveryHow the winner will do once it competes inside a normal ad setHow the test ads compare with your existing ads on equal terms
Setup effortNoneMostSome

Dynamic creative and Advantage+ creative enhancements are left off this list on purpose. They mix components or variations and report combined results. Meta says that because you only see aggregate performance, it does not recommend dynamic creative as a substitute for split testing.

What any test can and cannot prove

A controlled test isolates one change. If the only difference between two ads is the hook, a reliable gap points to the hook. If they differ in image, copy and offer at once, you learn which ad won but not why. Meta's advice is to start with a hypothesis and test one variable at a time.

A test also only covers the people, placements and dates it ran on. A winner from a two-week test in spring may not hold during a December sale. A winner also does not stay a winner. Once it runs at scale, its frequency rises and it starts to fatigue.

The last limit is volume. Small tests produce noisy results, and the budget a test needs depends on how many purchases or leads each version must gather. The guides on running a creative test and setting a testing budget turn this into steps.

Frequently asked questions

Should I test Facebook ads in the same ad set or in separate ad sets?
The same ad set is simpler and shows which ad Meta prefers to spend on, but spend will be uneven. Separate ad sets give each ad its own budget, though their audiences can overlap. For a fair comparison, Meta's A/B test or creative test splits people so nobody sees both versions.
How long should a Meta A/B test run?
Meta recommends at least seven days, and some of its help pages suggest two weeks. Tests can run for up to 30 days. Meta also says to wait until the test ends before judging, even though early results appear once 100 events have been recorded.
Why did Meta spend almost nothing on one of my ads?
Within an ad set, Meta's delivery system shifts spend towards the ads it predicts will get the best results, so some ads get little delivery. A low-spend ad has not had a fair test. If you need to know how it performs, put it in a controlled test with its own share of budget.
Can I A/B test ads that are already running?
Yes. Meta's Experiments tool can compare existing campaigns or ad sets, and it divides their current budget between them. The creative test inside an ad works differently, because it duplicates an existing ad into new test ads rather than testing the live one.

Key takeaways

  • Ads in one ad set compete for delivery, and Meta shifts spend towards the ads it predicts will perform best.

  • Meta's A/B test splits the audience so nobody sees both versions and picks a winner on cost per result.

  • The creative test inside an ad reserves part of the budget so two to five new ads each get a fair share without pausing the campaign.

  • Each method answers a different question, so pick the one that matches what you need to know.

  • Test one variable at a time, or you will learn which ad won but not why.

Sources

  1. 1.Meta's A/B test changes one variable, shows each version to a separate audience segment so nobody sees both, duplicates or divides budget depending on setup, recommends equal budgets and at least seven days, allows up to 30 days, and warns that informal on and off testing can cause overlapping audiences. Meta Business Help Centre, About A/B testing. Checked 14 October 2026.
  2. 2.Meta suggests keeping A/B tests running for at least two weeks or up to 30 days and not reusing the test audience in other campaigns at the same time. Meta Business Help Centre, Tips for improving A/B tests. Checked 14 October 2026.
  3. 3.The A/B test winner is the version with the lowest cost per result for the objective, confidence is the likelihood of the same results on a rerun, thresholds are given for two to five versions, and results appear after 100 events but should be judged when the test ends. Meta Business Help Centre, Viewing and understanding A/B test results. Checked 14 October 2026.
  4. 4.All ads in the same ad set share the same audience, placement, budget and schedule settings. Meta Business Help Centre, What are the advertising levels in Meta Ads Manager?. Checked 14 October 2026.
  5. 5.Over time the system learns which ads perform best, so some ads in an ad set are delivered more than others. Meta Business Help Centre, Specifications for ad performance. Checked 14 October 2026.
  6. 6.When one ad earns more engagement, the system runs it more often to get the best results for the budget, so it gets more impressions than the other ads in the ad set. Meta Business Help Centre, How to fix it: One ad in your ad set is getting more impressions than the rest. Checked 14 October 2026.
  7. 7.Meta documents a creative test that is set up in Meta Ads Manager. Meta Business Help Centre, Set up a creative test in Meta Ads Manager. Checked 14 October 2026.
  8. 8.The creative test is set up in the ad editor, creates two to five duplicate test ads, uses a share of budget Meta recommends keeping to 20% or less, requires the highest volume bid strategy, shows each person one test ad, and reports results in Experiments. Jon Loomer Digital, Meta's Creative Testing Tool: Setup, Strategy, and Results. Checked 14 October 2026.
  9. 9.Advertisers report the creative test limit rising from five to ten test ads in some accounts. Jon Loomer Digital, Is Meta Expanding Creative Testing to 10 Ads?. Checked 14 October 2026.
  10. 10.Because only aggregate performance of delivered variations is visible, Meta does not recommend dynamic creative as a substitute for split testing. Meta Business Help Centre, About dynamic creative. Checked 14 October 2026.

Key terms

Put it to work

Part of Creative testing in the Mockingbird Learning Center.

Next: What does statistical significance mean in an ad test?