Human Factors and Usability Evaluation

#Study the whole working situation

Human factors considers how people interact with tools, tasks, environments and other people. Usability is one part of this wider picture: whether intended users can complete intended tasks effectively and with reasonable effort. A design that looks clear in a demonstration may become confusing under time pressure or interruption.

Start with the tasks that matter, especially those where misunderstanding could cause harm. Describe who performs them, what information they need and the conditions in which they work. Include lighting, noise, device placement, accessibility and competing demands where relevant, rather than treating the interface as separate from its environment.

#Observe representative people doing tasks

Task-based evaluation asks participants to complete realistic activities while observers examine what happens. Participants should reflect relevant user differences, such as experience, professional role, language needs or disability. Staff who helped design a system may understand it unusually well and should not be treated as substitutes for all intended users.

Observe task completion, misunderstandings, delays and the assistance people need. Satisfaction questionnaires can add context, but liking a tool does not establish safe or effective use. Early tests may use simulated cases to explore problems without exposing patients to unnecessary risk, while recognising that simulation cannot reproduce every real-world condition.

#Learn from errors and retest changes

A use error is not automatically evidence that someone was careless or needs more training. Examine whether labels, defaults, feedback or task demands contributed to it. Look for situations where an action seems reasonable to the user but produces an unexpected result. Pay particular attention to whether errors are detectable and recoverable.

Prioritise findings by their potential consequences and likelihood in the intended setting. Revise the design or process and test again, including possible new problems introduced by changes. Document remaining limitations and support needs. Usability findings contribute to safety assessment but do not, on their own, establish clinical effectiveness.

#Common misunderstandings

Human factors evaluation is not simply a check that instructions are readable or that people like a design. A tool can feel convenient yet still make an important step easy to miss. Satisfaction surveys can add useful information, but they do not establish whether people can use something safely.

Another misunderstanding is that errors mainly reflect carelessness or inadequate training. Confusing labels, unclear feedback, interruptions and competing demands can all contribute. Training may help, but it does not remove the need to improve a design that repeatedly causes difficulty.

Successful testing also does not mean a product is safe in every setting. Findings depend on who took part, which activities were assessed and how closely the conditions reflected actual use. Rare problems may not appear during a study. Evaluation provides evidence about particular uses and circumstances, rather than a guarantee that nothing will go wrong.

#Questions worth asking a clinician

• How will you test whether people can use this device safely during realistic tasks, including interruptions, time pressure and poor lighting?
• How will you include intended users with different levels of experience and different vision, hearing, mobility or cognitive accessibility needs?
• How will you assess whether instructions, labels and controls help users complete safety-critical tasks without assistance?
• When a user makes an error, how will you investigate whether the design, task demands or working conditions contributed?
• After changing the design to address a safety problem, how will you retest it with intended users under realistic working conditions?