Mobile App Feedback Interview: Guide and Questions
Use this guide with people who use your mobile app. It finds where and when they open it and what is hard on a small screen. It also finds which notifications help or annoy them.
- Length
- 25 min
- Questions
- 12
- People
- 10 to 15
- Sections
- 5
What this guide finds out
- Where and when people use the app, and what triggers each session.
- Which screens and actions are hard to use on a phone.
- Which notifications help, which annoy and which people turn off.
- How people split tasks between the app and the website.
When to use it
- Your app store rating drops and the reviews do not say why.
- Many people install the app but stop opening it after the first week.
- You plan a redesign of the main screens of the app.
Who to talk to
People who opened your app at least once in the last 7 days. Talk to 10 to 15 people. Each interview takes about 25 minutes.
The discussion guide
Each question has a probe note. The note tells the moderator, a person or an AI, what to do with the answer.
Context of use
6 minLearn where, when and why people open the app.
Where are you usually when you open the app, and what are you doing at the time?
ProbeAsk about the commute, home, work or a shop. Ask if they use one hand or two.
What made you open the app the last time?
ProbeAsk if it was a notification, a habit, a need or a message from someone.
Do you also use the website or another device for this? When do you choose which one?
ProbeAsk which tasks they keep for a computer, and why.
The last session
6 minRebuild one recent session.
Tell me about the last time you used the app. Start when you opened it and stop when you closed it.
ProbeAsk them to open the app now and follow the same steps while they describe each screen.
Did you finish what you wanted to do? If not, what stopped you?
ProbeAsk if they finished later on another device.
Friction on a small screen
6 minFind what is hard on a phone.
Which screen or action is hard to use on your phone?
ProbeAsk about small buttons, typing, long forms, scrolling and slow loading. Ask them to show the screen.
Has the app ever lost your work, crashed or been slow? What did you do?
ProbeAsk when it happened and on which network. Ask if they tried again.
Which task in the app do you wish took fewer taps?
ProbeAsk them to count the taps out loud while they do it.
Notifications and habits
4 minLearn how notifications affect use.
Which notifications from the app do you find useful? Which ones do you ignore or turn off?
ProbeAsk them to read the last notification from the app, if they can find it. Ask what they did after it.
Where is the app on your phone, and have you ever thought about deleting it?
ProbeIf they thought about deleting it, ask what happened at that time.
Rating and close
3 minGet a rating with a reason and one priority change.
On a scale from 1 to 5, what rating would you give the app in the store today? Why?
ProbeShow the scale on screen. Ask what would move the rating up by one point.
What would make you open the app more often?
ProbeDo not ask a follow-up. Thank them and end the interview.
Example finding
Many users opened the app to check a status, but switched to a laptop for any task that needed typing.
“I check it on the bus. But if I need to change something, I wait until I get home and use the laptop.”
Mistakes to avoid
- Do not test only on new phones and fast networks. Ask about the phone and the network that people use every day.
- Do not ask people to remember screens from memory. Ask them to open the app and describe what they see.
- Do not read app store reviews as the full story. Unhappy users write more reviews than happy ones.
- Do not ignore people who use the website instead. They show what the app does not do well.
Analyze the answers
Analysis templateApp Store Review Analysis: Codebook for App ReviewsUse this codebook on reviews from the App Store and Google Play. It links each problem to an app version, so you can tell a new bug from an old complaint.Questions
Ask about one recent session, then ask them to open the app and describe what they see. The real screen gives better answers than memory.
Yes. A voice-only AI interview in User Evaluation works on a phone. Phones cannot share their screen in the interview, so ask people to describe each screen out loud.
Yes. Code the app store reviews first to find the main topics. Then use the interviews to learn the reasons behind them.
Let the AI moderator ask these questions
The AI moderator interviews screened people by voice or text. Each claim in the study report links to its clip. The first 3 interviews are free.