Chapter 5

Qualitative vs. Quantitative UX Research Methods

UX research is a multi-dimensional process that includes different user research methods and techniques. In this chapter, we provide an overview of the qualitative and quantitative research methods and explain why the best solution uses a mix of both methods.

Qualitative UX research methods

Qualitative user research includes research methods like user interviews and field studies and helps you collect qualitative data through the direct observation and study of participants. Qualitative data yields an understanding of the motivations, thoughts, and attitudes of people. This type of research is key to uncovering the ‘why’ behind actions and develop a deep understanding of a topic or problem.

Yuliya Martinavichene, User Experience Researcher at Zinio, compares the process of running a qualitative study to casting a wide lens to identify user behavioral patterns:

There are different qualitative research methods you can employ for your studies, such as user interviews, diary studies, focus groups, usability testing, and more. We explore the most common UX research methods in the next chapter.

Choosing the right user research techniques depends on the project and your research goals. Yuliya explains: 

Yuliya collects qualitative feedback through different methods depending on the goals of the projects. For example, she might conduct walk-throughs with users and asks them to show her around the software she is researching to understand how they currently use the product. Or she may ask research participants to perform everyday tasks to observe their behavior in real-time, such as logging in or out of the platform.

To gather more qualitative insights, Yuliya also checks social media mentions, analyzes blog posts, and reads app store reviews to collect information about the experience users have with the product.

Qualitative research gives you rich insights about the people, product, and the problem you’re researching, and helps you inform decision-making throughout the design and product development process.

Quantitative UX research methods

Quantitative research is used to collect and analyze numerical data, identify patterns, make predictions, and generalize findings about a target audience or topic. The data is collected indirectly, either through a tool that automatically records it, such as Google Analytics or Maze, or manually by measuring and analyzing UX metrics.

Quantitative data provides a foundation for benchmarking and ROI calculations and can help you decide the best performing version of a design or product. 

The most common quantitative data sources are analytics, usability testing data, online surveys, and A/B testing.

Quantitative data aims to answer research questions such as ‘what,’ ‘where,’ or ‘when.’ For example, when collecting usability metrics such as task success rates, time on task, completion rates, clicks, conversion rates, and heatmaps, you can measure how well a design performs and spot issues on a page or in the user flow.

One of the advantages of quantitative research is the ability to run studies with large sample sizes and collect statistically relevant data. As opposed to qualitative feedback, which is interpretable by the researcher and subjective, quantitative research is more objective and representative of a broader audience.

Balancing qualitative and quantitative UX research 

Tip ✨

Employ qualitative research to explore ideas and discover new insights, and then tap into quantitative research methods to test a hypothesis or final solution.

While qualitative and quantitative research yields different data types, they are both essential for conducting effective research and getting actionable insights. Not one method can give you a complete picture, so using both in combination is often the best way to ensure you’re making the right product decisions that fit with your business goals.

Usually, the best solution is built using a combination of insight sources. For example, you can kick-off the discovery phase of a project with qualitative research, and run user interviews to understand people’s needs, preferences, and opinions. 

After this initial batch of research studies, the product and design team can start building an incipient solution, usually in the form of a low-fidelity prototype or mockups. The initial solution is then tested through interviews and surveys, and the feedback gathered can help you iterate on the solution until final.

Lastly, when you’ve arrived at a final product, doing user testing quantitatively will help you ensure your solution is easy to use, usable, and intuitive for the end-users—and there are no significant issues with the design before going into the development phase. This mix and match of methods is the best way to research and test during the entire design process until arriving at a solution.

In the next chapter, we will dive deeper into the most common types of research you can use such as tree testing, usability studies, or card sorting, and help you choose the right one for you.