Traditional usability testing occurs in a very controlled environment and can offer significant insights into the design process. However when the desired target audience is geographically far flung or particularly exclusive – costs of usability testing can be high and logistically challenging. Remote testing offers some interesting alternatives to “the lab” approach – providing test moderators and participants a more flexible, and often, more natural browsing experience.
NLC is participating in this year’s IA Summit. We’ll be in Miami absorbing the sunshine and the wisdom of many of the best website planning minds in the industry between April 10 – 14. Throughout the week, we’ll be sharing some of their insights via this blog (but sadly we can’t share any of the Miami sun – sorry Ottawa!) Yesterday, I participated in the “Remote Usability Testing” Pre-conference Workshop run by Dick Horst & Dustin Chambers of UserWorks based out of Washington, DC.
The workshop explored some of the situations in which remote testing might be relevant and the gamut of tools and tactics available for running an effective test.
Advantages of remote usability testing
- Tests are freed from the constraints of the lab
In the case of a moderated test, web conferencing software can be used to connect the test moderator, participant(s) and even quiet observers. - Participants can partake in the tests in their own environment
Because participants can access the test from anywhere with a web connection, they may be more at ease connecting from home or their office… they no longer have to suffer the indignity and associated pressures of completing tasks with a facilitator and observers peering over their shoulder. This flexibility also makes it easier when it comes to recruiting certain users – especially those with busy schedules or faraway locations - The setup is minimal and relatively inexpensive
The hardware needed for such a test is basic and several viable software solutions are readily available… including UserVue by TechSmith which was designed specifically for remote usability testing. - Results are comparable to in-person testing
Horst & Chambers both specialize in this type of testing and had not found any major discrepancies in the results – barriers to usability were still clearly identifiable as a result of the process.
Disadvantages of remote usability testing
- You can’t perform any physical activities (sketching, sorting, tasks where users had to evaluated devices, move around etc)
(Although Horst & Chambers proposed a few ideas for emulating these activities online) - Physical reactions are lost – facial expressions, gestures and other non-verbal cues cannot be read
It may also be difficult to establish a rapport with participants. - Technology setup barriers may pose a challenge
Because there is generally some setup required on the part of the participant, there is a risk that some aspect of the setup may fail. Web sharing applets may not install, browser configurations may block key instructions, dropped connections etc. Horst & Chambers also mentioned that some participants they had encountered were suspicious of the technology.
A few tools of the trade
Moderated Remote Usability Testing
Web Recording Tools
Stay tuned for more from the Summit!
A few of my other posts from the IA Summit: