Introducing BetScores

When we launched DoWhatWorks, it felt magical to be able to pick any brand and see their split tests.

It still does.

People love that they can see specific experiments like this one testing videos vs images on a home page.

Now that we have analyzed over 20,000 experiments, we can do something even more powerful. We can understand what wins across many experiments.

For example, we've seen over 50 experiments similar to the one above run by other companies. That volume lets us analyze how videos perform in split tests by page, industry, geography, and more.  

‍

We worked with a professor from Johns Hopkins University to develop a method to synthesize results across similar experiments into something we call "BetScores". The method quantifies how likely something is to win in an experiment by key dimensions like sector, page, geography.

The BetScores range from 1 to 99 and indicate how likely something is to help your results or hurt them. You want to remove or adjust low scored elements on your page, then double down on elements with higher scores. Along the way our clients use real examples of what won as design inspiration.

Since we have over 1 million pieces of meta-data associated with experiments in our large and growing database, we can now ask and answer questions like:

• Where and how should you use star ratings?
• When and where should you convey savings as "% off" vs. specific dollars off?
• How many plans should you offer by sector?
• What information should you include on sign up pages?

And thousands more. There are infinite combinations of variables that you can try. Gathering the data has been a massive investment and it has paid off.

Over the last 2 years, we have worked with world class customers in streaming, SaaS, banking, health, retail, and other major sectors to refine the BetScore methodology and prove it works.

And, boy does it work. Our clients ask us to diagnose their key pages with BetScores. We use BetScores to pinpoint what is suboptimal and recommend changes based on evidence. Our clients regularly report multi-million dollar wins as a result.

We are now rolling out a service more broadly that lets you get your key pages analyzed against BetScore evidence so you can get more impact from your website (and lower CAC). This is in addition to the dynamic dashboard that allows you to explore tests by variable, page, platform, brand, and geography. If you are are interested, let's chat.  

Want to see a BetScore in action? Check out this BetScore analysis of videos on websites.

‍