Confirmation Bias: Impact on User Research & Onboarding

Hello! Welcome to our first lesson in Module 3.

Introduction

In our previous modules, we explored the dual-process model of System 1 and System 2 thinking and examined how mental shortcuts, or heuristics, help us navigate a complex world. Now, we'll delve deeper into specific cognitive biases that stem from these processes.

This lesson focuses on confirmation bias, one of the most pervasive and impactful biases in both our personal lives and professional work. Our goal is to explain confirmation bias and analyze its effect on user research and onboarding flows.

We will cover:

1. A clear definition of confirmation bias and its psychological underpinnings.
2. How it shapes the first impressions users form, particularly during onboarding.
3. How it can unconsciously influence you and your team during the user research process.
4. Actionable strategies to mitigate its effects in your design practice.

Given your leadership role in product design and user research, understanding this bias is critical for making objective, user-centered decisions.

1. Defining Confirmation Bias

At its core, confirmation bias is our tendency to seek, interpret, favor, and recall information that confirms or supports our prior beliefs or values. It’s a System 1 process that runs automatically, making us feel more confident in our judgments than we should be.

This simple diagram offers a great visual summary:

To start, let's watch a short clip that defines confirmation bias specifically within the context of UX work.

This bias isn't just a single action; it's a trio of cognitive errors working together. The following article breaks this down nicely.

These three aspects—attention, interpretation, and memory—create a powerful feedback loop. We pay attention to what we expect to see, interpret ambiguous information to fit our beliefs, and remember the "hits" while forgetting the "misses."

2. Confirmation Bias and the Power of First Impressions

Confirmation bias is particularly potent when it comes to first impressions. Once an initial judgment is formed, our brain works to protect it. Psychologists call this the primacy effect: information we receive first disproportionately shapes our subsequent understanding.

In product design, the onboarding flow is where the primacy effect takes hold. It's your product's first impression, setting the user's expectations and beliefs, which confirmation bias will then work to solidify.

Let's explore this connection.

Reflection Point: Think about a user's first interaction with a new app. If they expect it to be complicated, how might the primacy effect and confirmation bias combine to affect their experience of the onboarding tutorial? They might over-interpret minor friction points as proof of complexity while overlooking helpful hints.

3. Analyzing Confirmation Bias in User Research

As a Product Design Lead, one of the most critical areas to manage confirmation bias is within your own user research process. Your team's pre-existing hypotheses, your personal attachment to a design, or stakeholder pressure can all create powerful beliefs that are susceptible to this bias.

This can manifest in several ways:

• Information Seeking: Searching for articles or data that support a chosen design direction while ignoring contradictory evidence.
• Interpretation: Giving more weight to a single user comment that aligns with your hypothesis while dismissing a dozen comments that don't.
• Recall: Remembering the parts of a usability test that went well and forgetting the parts where users struggled.

The following resources detail how this bias seeps into the research cycle and, importantly, how to counteract it.

Techniques like affinity diagramming force you to confront all the data equally, while methods like the Six Thinking Hats institutionalize the search for alternative viewpoints. Asking open-ended, non-leading questions and triangulating data (e.g., comparing interview findings with analytics) are also crucial defenses.

4. Analyzing Confirmation Bias in Onboarding Flows

Now let's flip the perspective and analyze how confirmation bias affects the user during onboarding. As we discussed with the primacy effect, the onboarding flow establishes the user's initial belief about your product.

• If a user comes in thinking, "This is going to be another complicated business tool," they will selectively attend to every complex-looking form field or piece of jargon.
• If they believe, "This app will finally solve my problem," they might interpret a loading spinner not as a flaw but as the system "working hard" for them.

Your goal in designing an onboarding flow is to establish a positive initial belief and then guide the user through an experience that consistently confirms it.

The Octet Design article gives a clear example of this in action.

Analysis Task:

Consider an onboarding flow you've worked on.

1. From the user's perspective: What pre-existing beliefs might a new user bring? (e.g., beliefs based on your marketing, their experience with competitors, or the general product category). How might the first few screens of your onboarding either confirm or challenge those beliefs?
2. From your team's perspective: What were your team's core beliefs about the users or the product when you designed that flow? Looking back with the Toptal author's experience in mind, can you identify any moments where the team might have been biased, perhaps prioritizing a "cool" feature showcase over addressing a fundamental user uncertainty?

This dual analysis—of both the user's bias and your own—is essential for creating onboarding that is not only usable but also genuinely persuasive and reassuring.

Conclusion

In this lesson, we've unpacked the powerful influence of confirmation bias.

Key Takeaways:

• Confirmation Bias is the tendency to seek, interpret, and remember information that confirms our existing beliefs. It operates through selective attention, interpretation, and memory.
• It has a profound impact on user research, where it can cause designers to ask leading questions, misinterpret data, and prioritize evidence that supports their own hypotheses.
• In onboarding flows, it works alongside the primacy effect. The user's first impression creates a belief that confirmation bias then works to defend, coloring the rest of their experience.
• Mitigation is not about eliminating bias (an impossible goal) but about building processes and awareness to counteract it. This includes using structured analysis methods, seeking diverse perspectives, and asking open-ended questions.

By consciously accounting for confirmation bias in yourself and your users, you can move from designing what you believe is right to designing what you can demonstrate is effective.

In our next lesson, we will examine loss aversion and the endowment effect, two closely related biases that are fundamental to how users perceive value, especially in free trials and subscription models.