The first 3 interviews are free · Start free or see the prices

Messaging Test Interview: Value Proposition Testing Guide

Use this guide to test the words on your homepage, ad or sales deck. It captures the words customers use for the problem, checks what they remember and compares two versions.

Length
25 min
Questions
12
People
12 to 16
Sections
5
Run this study

What this guide finds out

  • The words customers use for the problem, before they see your message.
  • What people remember after one read, and what they think the product does.
  • Which words are unclear and which claims people do not believe.
  • Which of two versions describes the problem better, and which words make the difference.

When to use it

  • You plan a new homepage or a new ad campaign.
  • Visitors arrive on your site but few sign up, and you think the message is not clear.
  • Your team cannot agree between two versions of the headline.

Who to talk to

People in your target market who have not used your product. They read the message as new visitors do. Talk to 12 to 16 people. Each interview takes about 25 minutes.

The discussion guide

Each question has a probe note. The note tells the moderator, a person or an AI, what to do with the answer.

01

Their words

4 min

Capture the language of the customer before any message is shown.

  1. How would you describe the problem you have in this area to a colleague?

    ProbeRecord the exact words. Do not repeat words from your own message.

  2. When you look for a tool like this, which words do you type in the search box?

    ProbeAsk for two or three searches. These are words for your headline and ads.

02

First read

6 min

Test recall and the first understanding.

  1. Read this text once. Now, without looking at it again, what do you remember?

    ProbeShow the first message, then hide it. Note which phrases they recall and which they change.

  2. What do you think this product does?

    ProbeIf the answer is wrong, do not correct it. Ask which words gave them that idea.

03

Clarity and belief

5 min

Find unclear words and claims that people do not believe.

  1. Who do you think this product is for? Is it for someone like you?

    ProbeIf they say no, ask which words made them think so.

  2. Which words or phrases are not clear to you?

    ProbeAsk what they think each unclear word means. Jargon from inside the company shows up here.

  3. Which claim do you believe the least? Why?

    ProbeAsk what proof would make them believe it.

04

Compare two versions

6 min

Find the version that describes the problem better and why.

  1. Now read a second version. Which version describes your problem better?

    ProbeShow the second message. Change the order of the two versions for each person. Ask them to quote the words that made the difference.

  2. Which version would make you more likely to click to learn more? Why?

    ProbeIf the answer differs from the previous question, ask about the difference.

  3. What is missing from both versions that you would need to know?

    ProbeAsk for one piece of information. Price, proof and setup time are common answers.

05

Close

4 min

Get the message back in the words of the customer.

  1. If you told a friend about this product in one sentence, what would you say?

    ProbeRecord the sentence word for word. It is often a better headline than both versions.

  2. In the version you preferred, which words would you change?

    ProbeAsk for the exact words. Thank them and end the interview.

Example finding

ExampleJargon in the headline

Most people did not understand "revenue intelligence" and guessed that the product was an accounting tool.

“Revenue intelligence? I think it does the books, like taxes and invoices. I am not sure.”
In a User Evaluation study report, each claim links to the clip where a participant says it.

Mistakes to avoid

  • Do not show your message before you capture their words. After they read it, they repeat your words back to you.
  • Do not ask "Do you like this headline?" Ask what they remember and what they think it means.
  • Do not test with current customers only. They already know what the product does, so they cannot test clarity.
  • Do not show the two versions in the same order to everyone. The first version sets the frame for the second.

Analyze the answers

Analysis templateThematic Analysis Codebook: Starter Codes for InterviewsUse this codebook as the first pass on interview transcripts about a task or a workflow. The 10 codes describe what people do and why, so themes come from behavior, not from opinions.

Questions

A messaging test shows your product message to people in your target market. It checks what they understand, what they remember and what they believe.

An A/B test shows which version gets more clicks. A messaging test shows why, and gives you the words customers use. Use the interview first, then confirm with an A/B test.

Yes. Text works well for messaging, because people read the message as they would on a website. Voice adds the tone and the first reaction.

Let the AI moderator ask these questions

The AI moderator interviews screened people by voice or text. Each claim in the study report links to its clip. The first 3 interviews are free.

Run this study