Phase: Discovery or Development
Summary: Participants keep a log of thoughts and experiences while interacting with a product
What is a Diary Study?
A diary study involves participants keeping a log of the thoughts and experiences they encounter while actively interacting with the product on a day-to-day basis. Diary studies usually take place over a certain period, generally ranging from a few days to a few weeks.
The primary aim of a diary study is to give researchers the opportunity to understand what motivates users to take certain actions while using a product and expose habits and patterns of behaviour over time. They provide a wealth of varied and detailed information, and a good understanding of user pain points to be solved.
Diary studies are considered a “hands-off” and economical way to gather a substantial amount of qualitative data (and some quantitative data) from users.
When to use a Diary Study
Diary studies are best utilized when researchers need an affordable way to observe user behaviour in a real-world setting, and when there is a need to collect data over time rather than only during a single visit. They can be used in the early stages of development to test new products, and at the end of a development cycle to fine-tune details.
Benefits and pitfalls
Benefits
In-depth understanding of a target user group
Uncover topics and pain points missed by other types of research, as user data is collected over a certain length of time vs. a single session
Minimally intrusive and captures naturalistic or in-context data
Can collect data from multiple users during a single time period without having to commit resources to a field study
Pitfalls
Participants may lose interest in recording diary entries or quit the study altogether. One solution to this problem is constant communication between researcher and participant.
Analyzing qualitative diary study data can be time consuming due to sheer volume and is difficult to automate. Workarounds include creating standard diary entry questions and asking participants to use digital tools to record diary entries.
Planning
The first step in planning a diary study is to prepare research questions and define study goals.
To prepare research questions, you can use our “User Interview” guide and User Interviews “Diary Study Launch Kit” to help you prepare https://www.userinterviews.com/launch-kit/user-interview . Diary study questions can be structured or open-ended. Example questions include:
What did you do today?
What did you like most about [task/activity]?
What did you like least about [task/activity]?
How could [task/activity] have been made better for you?
How did you feel about your experience [doing task/activity] today?
Why did you feel that way?
Did anything get in your way?
The next step is to decide on your diary type, structure and frequency.
Diary type
Handwritten
Electronic (voice, video or photos)
Diary structure
Freeform (open-ended questions)
Structured (closed-ended questions/pre-set forms)
Frequency
Interval contingent (completed at specific times)
Signal contingent (completed only when you call/email participant)
Event contingent (completed when pre-discussed event happens - e.g. when it rains)
During the recruitment and onboarding phase, you will want to make sure you include the right participant in your study, train them in advance and set expectations (e.g. timeline, schedule). Researchers may also choose to conduct a pilot study in advance of the main study to ensure all instructions are understood by participants and any technology to be used is working.
Conducting a Diary Study
Once the study begins, it’s important to continuously check on your participants and answer any questions as they come up. You may also need to remind participants to make diary study entries.
After the diary study is complete, review diary entities and prepare a debriefing interview with each participant. During debriefing, you can clarify any unclear comments or experiences and gain additional insights. Try to complete the debrief interview soon after the diary study is complete, so the experience is still fresh for participants.
Analysis
Researchers can utilize several different methods to analyze diary study data. It is good practice to choose a data analysis method in advance so you can tailor your research questions to match the style of data analysis. After data analysis is complete, data will have to be formatted into a manageable and easy to understand layout that can be accessed by all team members and stakeholders to help inform product development.
References
“Design Research Methods: Diary Study.” OUTWIT*LY, 22 Aug. 2021, https://www.outwitly.com/blog/research-methods-diary-study .
“Diary Studies.” User Interviews, https://www.userinterviews.com/ux-research-field-guide-chapter/diary-studies . Retrieved 8 Nov. 2021.
Moran, Kelly. “Diary studies: a quick primer.” UX Collective, 8 May 2018,
https://uxdesign.cc/diary-studies-cd65a61a4f89
Additional Resources
Halsey, Mac. “How to Conduct a Diary Study: A Start-to-Finish Guide.” dscout,
https://dscout.com/people-nerds/diary-study-guide . Retrieved 8 Nov. 2021.
Salazar, Kim. “Diary Studies: Understanding Long-Term User Behavior and Experiences.” Nielsen Norman Group, 5 June 2016,
https://www.nngroup.com/articles/diary-studies/ .
“User Interview Launch Kit.” User Interviews,
https://www.userinterviews.com/launch-kit/user-interview . Retrieved 8 Nov. 2021.