Skip to content

How to A/B Test YouTube Thumbnails (and Titles) in YouTube Studio

7 min read

What YouTube's A/B testing does

YouTube Studio's A/B testing (also known as Test & compare) lets you test up to three different thumbnails, three titles, or combinations of title and thumbnail for the same video. YouTube shows the options to different viewers and, at the end of the test, shows the best-performing option to everyone.

The winner is not picked by click-through rate. YouTube compares watch time share — each option's share of the total watch time the test produced. That rewards thumbnails that bring in viewers who actually watch, not just viewers who click.

Who can use it

According to YouTube's help center, these are the requirements:

  • Computer only: tests are set up in YouTube Studio on a computer
  • Advanced features must be enabled on your channel
  • Not available for Shorts, scheduled lives and Premieres (Premieres become eligible after they turn into a normal video; live archives can be tested)
  • Not available for videos made for kids, for mature audiences, or private videos

How to set up a test, step by step

The whole setup takes a minute once your variants are ready:

  • Sign in to YouTube Studio on a computer
  • New video: click Create → Upload videos. Existing video: Content → click the video
  • In the Title box or under Thumbnail, click A/B Testing
  • Choose Title only, Thumbnail only, or Title and thumbnail
  • Upload up to 3 thumbnails and/or titles, then click Done

How long a test takes and how to read results

Most tests finish within two weeks, sometimes in a few days, depending on impressions and how recently the video was published. You can follow a running test in Analytics → Reach under “How your A/B test is going”.

Results come in three kinds. Winner means one option clearly outperformed the others and the result is statistically significant. Preferred means one option likely did better, but the difference was too small to be certain. Performed same means there was no meaningful difference. If there is no clear winner, YouTube keeps the first option you uploaded.

Two things stop a test early: changing the video's title or thumbnail while it runs. YouTube may also keep a small control group that only sees your default thumbnail and title.

The resolution rule most creators miss

If any thumbnail in the test is below 720p (1280×720), YouTube downscales all of the test thumbnails to 480p (854×480). One small image makes every option look worse. Upload all variants at 1280×720 or larger — YouTube now recommends 3840×2160.

How to make variants worth testing

YouTube itself warns that options which are too similar make tests run longer, because there is no real difference to measure. Test different ideas, not different shades of the same idea.

Thumbnail ideas and prompts for your niche

  • Change the concept: your reaction vs. the result vs. a before/after
  • Change the hook text: a number vs. a question vs. no text
  • Change the focal point: face vs. object vs. place
  • Keep the title fixed when you test thumbnails, so you learn what the image did
  • Start with older videos that still get impressions, so a weaker option costs less

Making three strong variants in minutes

The hardest part of testing is designing three genuinely different thumbnails. In ThumbMagic you describe the video once and choose 2 or 4 variations, or ask for a different angle with a sentence (“same scene, but show the result instead of my face”). Every version is saved, exported at up to 3840×2160 and ready to upload as a test option.

Create your next thumbnail with AI

Describe your video and get a thumbnail in the exact YouTube size. Your first one is free.