Internal Tool Adoption Interview: Guide for Employee Research
Use this guide with employees after a new internal tool goes live. It finds which tasks moved to the tool, which stayed in the old way, and why.
- Length
- 30 min
- Questions
- 12
- People
- 10 to 15
- Sections
- 5
What this guide finds out
- Which tasks moved to the new tool and which stayed in the old way.
- The shadow systems that employees still use, such as spreadsheets and chat messages.
- Where the tool is slower than the old way, and why.
- What training and help employees got, and what they needed.
When to use it
- A new internal tool went live, but usage is lower than planned.
- Managers report that teams use the tool, but the data in it is incomplete.
- You plan to roll out the tool to more teams and want to fix problems first.
Who to talk to
Employees who must use the tool for their work, from more than one team and level. Include people who rarely use it. Talk to 10 to 15 people. Each interview takes about 30 minutes.
The discussion guide
Each question has a probe note. The note tells the moderator, a person or an AI, what to do with the answer.
Work before the tool
5 minLearn the old way of working.
What is your role, and which part of your work does the new tool cover?
ProbeAsk for the tasks, not the tool features.
How did you do this work before the tool arrived?
ProbeAsk what worked well in the old way. People keep old ways for a reason.
Introduction and training
6 minLearn how the tool was introduced.
How did you first hear that you had to use the tool, and what did you think?
ProbeAsk if anyone explained why the company chose it. Ask if the reason made sense to them.
What training or help did you get, and how useful was it?
ProbeAsk what they still had to learn alone after the training.
Daily use
8 minFind which tasks moved to the tool and which did not.
Which tasks do you now do in the tool? Which tasks do you still do the old way?
ProbeAsk about spreadsheets, email and chat that they still use. Ask why for each one.
Tell me about the last time you used the tool. What did you do?
ProbeAsk for each step. Ask where they had to wait or enter the same data twice.
Where does the tool slow you down compared with the old way?
ProbeAsk for a specific task and an estimate of the extra time.
Barriers and support
7 minFind what stops full adoption.
What happens if you do not use the tool for a task? Does anyone notice?
ProbeAsk if managers check the tool or ask for reports from other sources.
In general, how do people on your team talk about the tool?
ProbeDo not ask for names. Remind them that the report shows themes, not who said what.
Who do you ask when you are stuck with the tool?
ProbeAsk if it is a person, a help page or the vendor. Ask how fast they get an answer.
Close
4 minFind the changes that would increase adoption.
What would make you use the tool for all of your tasks in this area?
ProbeAsk for one change in the tool and one change in the process.
If you could speak to the team that owns the tool, what would you tell them?
ProbeDo not ask a follow-up. Thank them and end the interview.
Example finding
Field staff kept their own spreadsheet because the tool did not work offline. At the end of the week, they copied the data into the tool.
“There is no signal at the sites. So I write it in my sheet, and on Friday I type it all into the system.”
Mistakes to avoid
- Do not let the manager of the participant run or watch the interview. Employees will not admit that they avoid the tool.
- Do not promise anonymity that you cannot give. Tell people at the start how answers will be reported.
- Do not treat low usage as resistance to change. Look for real costs, such as extra steps or missing data.
- Do not interview only the champions of the tool. Include people who rarely log in.
Analyze the answers
Analysis templateJobs to Be Done Forces of Progress: Codebook for Switch InterviewsUse this codebook on jobs to be done switch interviews. It has two layers: the four forces for and against a switch, and the stages of the switch timeline.Questions
Common reasons are extra steps compared with the old way, poor training and no reason to change. The interview shows which reason applies in your company.
Report themes without names, and tell people this at the start. If people fear their manager will see the answers, they say what the manager wants to hear.
Four to eight weeks after the tool goes live. By then, people have formed habits, but they still remember the old way.
Let the AI moderator ask these questions
The AI moderator interviews screened people by voice or text. Each claim in the study report links to its clip. The first 3 interviews are free.