The consolidated module reading that walks through the full controlled user testing workflow, beginning with experimental design foundations and the decisions a research team makes before any participant touches a prototype, serving as the main study text for the module.
Topics
This module covers 8 topics. Open a topic to see its subtopics.
Module Content
27 items.
-
-
A lesson on experimental design fundamentals for usability studies, covering research questions, independent and dependent variables, controls, and threats to study validity, used as the conceptual groundwork before planning a test.
-
A lesson on selecting and recruiting usability test participants, explaining how user profiles, screening, and representativeness determine whether the resulting data is meaningful, used when planning who to include in a study.
-
A lesson on writing task scenarios that place participants in realistic, motivating situations without leading them, contrasting well-constructed and flawed scenarios so learners can draft their own test scripts.
-
A lesson on the think-aloud protocol, explaining how asking participants to narrate thoughts in real time reveals cognitive processes that post-hoc surveys miss, and how to facilitate it during sessions.
-
A lesson on quantitative usability metrics such as task completion counts, time on task, error rates, and frequency measures, showing learners how to capture numbers that support comparison and benchmarking.
-
A lesson on qualitative data collection that explains how observations, quotes, and behavioral notes reveal why users struggle, complementing numerical metrics during analysis.
-
A lesson on facilitating live user testing sessions — in person or remote — covering how to run the session, manage participants, and capture data once all the preparation is complete.
-
A lesson on turning raw session material (timing spreadsheets, observation notes, recordings, transcripts, questionnaire scores) into structured, analyzable findings and reportable insights.
-
This reading introduces core experimental design concepts for usability studies, covering how to define research questions, select variables, choose study structures, and make the key decisions needed before testing begins, serving as foundational theory for the module.
-
This reading explains how to identify, screen, and recruit appropriate test participants, covering sampling strategies, screener design, and why participant representativeness is critical to the validity of usability study findings.
-
This reading covers how to write effective task scenarios for usability tests, explaining what makes a scenario realistic and motivating, common scripting pitfalls to avoid, and how scenario quality directly affects the behavioral data collected.
-
This reading describes the think-aloud protocol method, explaining how to instruct participants to verbalize their thoughts during tasks, the difference between concurrent and retrospective approaches, and how facilitators use it to capture real-time user reasoning.
-
This reading covers quantitative data collection in usability testing, explaining what numerical metrics such as task completion rates, time-on-task, and error counts measure, how to record them consistently, and how they are used to compare and benchmark interface performance.
-
This reading explains qualitative data collection methods in usability testing, covering observational note-taking, verbal data capture, and how these techniques reveal the reasons behind user behavior to complement numerical metrics.
-
This reading guides facilitators through running live usability test sessions, covering session structure, facilitator conduct, how to manage participants without biasing results, and practical considerations for both in-person and remote testing contexts.
-
This reading explains how to organize and structure raw usability test data — including notes, metrics, transcripts, and questionnaire scores — into formats suitable for systematic analysis, covering data cleaning, categorization, and preparation techniques.
-
This reading explains how to organize and structure raw usability test data — including notes, metrics, transcripts, and questionnaire scores — into formats suitable for systematic analysis, covering data cleaning, categorization, and preparation techniques.
-
A reading that introduces experimental design principles for usability testing — independent and dependent variables, controls, and between- versus within-subjects comparisons — so learners can plan a study that supports valid claims about which interface performs better.
-
A lesson on defining target users, writing screening criteria, recruiting and screening participants, and obtaining consent, used by learners to assemble a sample whose results actually represent the intended audience.
-
A guide to writing realistic, non-leading task scenarios with clear success criteria, which learners use to draft the tasks participants will attempt during a usability session.
-
An explanation of the think-aloud protocol, including how to instruct participants to verbalize their reasoning, when to prompt, and the method's strengths and limits, for learners facilitating sessions that reveal why users struggle.
-
A reading on capturing numeric usability measures — task completion, time on task, error counts, subjective difficulty ratings, and standardized instruments like SUS — so learners can collect comparable, reportable metrics.
-
A lesson on gathering non-numeric evidence such as think-aloud comments, hesitations, workarounds, observed reactions, and post-test interview responses, helping learners explain the reasons behind quantitative results.
-
A practical guide to running live test sessions, covering facilitator and note-taker roles, room or video setup, recording and timing logistics, the opening script, and how to handle problems mid-session.
-
A reading on turning raw session notes, tallies, recordings, quotes, and timings into organized results by participant and task, preparing learners to produce findings a design team can act on.
-
The combined module page compiling all lesson readings on controlled user testing — from experimental design and recruitment through task scripting, think-aloud, data collection, session facilitation, and results compilation — for continuous review or printing.