JournalArrow left Journal
Quantitative vs Qualitative Hero
Design Research

When to apply qualitative and quantitative research

by Foolproof Team
2nd April 2015

User research is a non-negotiable component of experience design

It's what gives us consumer insight which in turn helps us make informed decisions about design.

There are two main types of user research: qualitative and quantitative and of course, there are pros and cons associated with both.

When to deploy either-or depends very much on the design decision you need to make.

What is qualitative research?

Qualitative research methods are used to gather feedback and insights from a relatively small group of users.

In general, qualitative research is answering the; How, When, Where and Why, of user behaviour.

Examples of qualitative methods include: unstructured or semi-structured interviews, ethnography, diary studies, focus groups and co-creation sessions.

Foolproof's qualitative research capabilities
  • Explore or validate concepts/designs with a small sample (approx. 12-50 participants)
  • Observe immediate reactions and emotional responses to an experience, including tone of voice, facial expressions and body language
  • Uncover unexpected pain-points or opportunities to add value in realtime
The limitations of qualitative research
  • Sample size is limited, therefore lacking the confidence of numbers
  • Sample obtained is not (statistically) representative of the entire user population
  • Unstructured methods can lead to inconsistent data capture

What is quantitative research?

Quantitative research methods are also used to gather insights but the size and range of the user group can be expanded.

This type of research focuses more on collecting user “data” as opposed to just insight. In general, quantitative research is answering the “who” and “what” of user behaviour.

Examples of quantitative methods include: structured, unmoderated testing, surveys, and questionnaires.

Foolproof's quantitative research capabilities
  • Explore or validate concepts and designs with a large sample (approx. 50-1000+ participants)
  • Capture behavioural data for task-based research, including task completion times, clickpaths, heatmaps, and success or failure scores
  • Measure satisfaction and usability with standard measures (i.e. System Usability Scale, Net Promoter Score)
The limitations of quantitative research
  • Unable to probe participants in the moment on their responses or observed behaviour
  • Lacks moderation; therefore the stimulus presented must be functional for use without assistance from a moderator

Choosing the right research method to inform design decisions

Research methods are not interchangeable and have specific objectives which they are most suitable for.

Choosing the most applicable method will depend on what design decisions need to be made for the creation or refinement of a design.

As a rule of thumb, use qualitative research methods for exploring ideas, designs, or processes which do not require concrete hypotheses or structured, statistically valid feedback.

We have found that qualitative methods are particularly useful for serendipitous discovery and often provide more in-depth insights.

You can use quantitative research methods such as A/B testing for validating or choosing a design based on user satisfaction scores, perceived usability measures, and/or task performance. You will find the insight will be more superficial, but the data is statistically valid and can be generalised to the entire user population.

A combination of qualitative and quantitative research is typically best for most design projects if budget allows.

By using both methods you can achieve a deeper level of insight through the exploratory nature of the research in addition to statistical evidence to support your design decisions.

Using qualitative and quantitative research together answers to the; Who, What, When, Where, Why, and How, of user behaviours and experiences.


Related articles

View All
What is the difference between Research and Insight?
Illustrated graphic of a globe and paper highlighting design research
Design Research

What is the difference between Research and Insight?

By Peter Ballard

Pete Ballard addresses the differences between research and insight.

Designer and researcher: the new creative partnership
A graphical illustration which highlights iterative design
Design

Designer and researcher: the new creative partnership

By Foolproof Team

Foolproof explore the newfound creative partnership designers and researchers share.

User research and design: Three old chestnuts cracked
Illustrated graphic of a globe and paper highlighting design research
Design Research

User research and design: Three old chestnuts cracked

By Tom Wood

Tom Wood talks design research and why - from a business perspective - research makes sense.