We score every AI slide tool and model on 10 criteria that describe a consulting-grade deck. A consulting-grade deck is one a McKinsey, BCG or Bain team would send to a client and is based on our experience at the those three consulting firms. The 10 criteria fall into three groups (the individual slide, the deck as a whole and the finish overall), and each is scored pass, partial or fail. Price, speed and exported file format are reported next to the score, along with a date for testing and model settings.
In this article, we explain why we have decided to use a fixed standard, what our 10 criteria are in more detail, what the method doesn’t cover, and examples of what we mean to make it concrete.
Why we use a fixed standard
With AI tools and models popping up and getting better week to week it can be difficult to get an overview of how good each new tool or model is, and especially to assess how well they function in a typical business or consulting workflow.
We’re interested in creating high-quality, consulting-level slides that ideally match the outputs from top-tier houses like McKinsey, BCG, and Bain. Therefore, we decided to set up a fixed standard and sets of tests to be able to objectively and consistently judge outputs of new models or specialized AI slide tools and thus compare them and ultimately recommend the best ones to use.
The standard is based on the training and techniques that were drilled into us during our years as consultants at Bain, BCG, and McKinsey. We’ve synthesized them here in 10 criteria that reflect both the little things that make a difference like consistent font sizes or well-formulated action titles, as well as the big things that make decks look and feel client-ready like clear messages, the right amount of information on slides, and compelling storylines.
Let’s dig in.
How we set up a test
A score only means something if every tool gets the same task. In our tests, we’ve narrowed it down to the following setup:
- The same brief: Each tool receives the same prompt with the same source material, when relevant. We purposefully try to test mostly finished research and reports to limit the effects of how well the different models conduct research and only focus on how they turn data into slides.
Our standard source materials are a 52-page industry report Oil & Gas in Egypt: Market Report, a 28-page public industry report on the China Juice Market Report, and a made-up business case that we ask the tools to make better. Each test post describes the brief it used.
- The same slide master: When relevant for the test, we use our own Slideworks PowerPoint master, which represents a neutral, corporate master and color palette. Where a tool cannot take a master, we note it and score criterion 10 as a fail.
- The same starting point: We use the prompt as written, and typically follow the recommended options if a model or tool suggests something. We do not edit the output by hand before scoring.
- Recorded and dated: We note the tool, the model or version, the plan tier and the test date. Where possible, we publish an unedited screen recording of the run.
- Fixed criteria: We use the same 10 criteria to score each output. We take turns scoring output and often discuss it between us. When the call is close, we say so in the review.
As a rule of thumb, a test is only comparable with another test if the brief and the method version match. Each review states both in a method box near the top.