The first 3 interviews are free · Start free or see the prices

How to Write a Discussion Guide for an AI Moderator

A guide for a person can be a list of topics. A guide for an AI moderator must say the exact words, the purpose and what counts as an answer.

Overview

A person who moderates uses a guide as a reminder. They know the goal of the study, they skip what is already covered and they change words for each participant. An AI moderator has only what you write in the guide.

So a guide for an AI moderator is more explicit and usually shorter. Each question is the exact words to say. Each probe note says what the question is for and when it is answered. Instructions to the moderator go in the notes, not in the question text.

In User Evaluation, Eva drafts about five open questions, each with one follow-up for a thin answer. A guide can have up to 30 questions. The Adaptive moderator follows what people say and can change the order. The Structured moderator asks the same questions in the same order for everyone.

Rules

  1. 01

    Write each question as the exact words to say.

    A topic heading forces the moderator to invent the question. It can invent a different question in each session.

    Do not

    Pricing: perceptions and objections

    Do

    When you first saw the price, what did you think?

  2. 02

    Use fewer questions than in a guide for a person.

    The moderator asks follow-ups on its own. A long list leaves no time for them, so the interview becomes a fast survey. Five strong questions can fill 30 minutes.

  3. 03

    Tell the moderator what counts as covered.

    An earlier answer often covers a later question. A moderator that asks it again sounds like it did not listen. A moderator that skips it too early loses data.

    Do not

    Question: "What did you do after you signed up?" No note.

    Do

    Note: if they already described their first day after sign-up, do not ask again. Ask only what they did the next time they logged in.

  4. 04

    Choose Adaptive or Structured on purpose.

    Adaptive order gives a more natural conversation. Structured order makes sessions easier to compare. Use it when an earlier question must not influence a later one, such as in a concept test.

  5. 05

    Write each question so it still makes sense out of order.

    An adaptive moderator can move a question. A question that says "as you said before" breaks when the earlier question did not come first.

    Do not

    Following on from your last answer, how did that change your plans?

    Do

    How did the price change your plans for the next month?

  6. 06

    Ask for a spoken description of anything visual.

    In User Evaluation the moderator only hears the participant. It does not see the camera, the screen or the item you show. The question must ask the participant to put it into words.

    Do not

    What do you think of this?

    Do

    Describe what you see on this screen. What do you think it lets you do?

  7. 07

    Keep moderator instructions out of the question text.

    The moderator may read the instruction aloud. Attach images and prototypes to the question with the product settings, and put the logic in the probe note.

    Do not

    [Show prototype] What do you think? (probe on navigation)

    Do

    Question: "Take a minute to look at this. What would you do first?" Note: if they do not mention the menu, ask how they would find their saved items.

  8. 08

    Ask one idea in each question.

    With two ideas in one question, people answer the second one. The moderator may then treat the question as answered.

    Do not

    How did you find us, and what made you sign up?

    Do

    How did you first hear about us?

Checklist before launch

  • Every question is the exact words the moderator will say.
  • The guide has about five main questions for a 30-minute interview.
  • Each probe note says what counts as covered.
  • You chose Adaptive or Structured for a reason you can name.
  • No question depends on the question before it.
  • Questions about visual items ask the participant to describe what they see.
  • Instructions are in notes and product settings, not in the question text.
  • Each question asks one idea.

Questions

A guide for a person can be a list of topics with prompts. A guide for an AI moderator needs exact wording, explicit probe notes and rules for when a question is covered.

Fewer than you think. The moderator follows up on its own. About five strong questions can fill a 30-minute interview.

Yes, after you rewrite it. Turn topics into exact questions, add probe notes with stop rules and remove questions that depend on the previous answer.

Ask real people your question

The AI moderator interviews screened people by voice or text. Each claim in the study report links to its clip. The first 3 interviews are free.

Start free