Usability Testing

In this study, we will conduct usability tests with individuals with cognitive disabilities to learn about user interface designs that would be meaningful and understandable for this population. Individuals with traumatic brain injury, mental retardation and multiple sclerosis will be provided with a variety of user interfaces to determine the appropriateness of different modalities for providing information to the user. Researchers will sit with each subject in a private room on campus for these usability tests. Subjects will be using devices either sitting in a chair or walking around in the room. Researchers will be in the room with subjects at all times.

We will use two types of devices: cell phones and personal digital assistants (PDAs). These devices are commonly available consumer-grade products. Subjects will be asked to complete three different sets of procedures.

First, subjects will be asked to use the devices with original software. For example, we will ask a subject to use the Palm operating system or the Nokia cell phone interface. See the attached list of sample usability questions. The purpose of this task will be to set a baseline for performance with commonly used consumer devices. Initially, subjects will be asked to perform the tasks without training to determine whether the device interfaces are intuitive and usable. Tasks will be administered within the context of a specific scenario. For example, “Imagine you wanted to look up your parents' phone number. Show me how you would you do that using this device.” Subjects will be asked to explore the device to see if they can figure out how to perform a task. If they perform the task without trouble, we will move on to the next task. If subjects struggle to complete a task, we will use a method of least prompts until the subject is able to perform the task. This type of training will be familiar to most of our subjects and should not cause undue stress. Subjects will be asked to discuss what is easy and what is hard about each task.

Second, subjects will use the same devices with adapted software. The adapted software will include modified interfaces that are intended to simplify the usability of the device. For example, menus may be shortened, text may be simplified, visual clutter may be removed, and alternative access may be added (such as spoken menus). Subjects will be asked to use these modified interfaces and discuss whether they simplify the task or make it more difficult. As with the first set of procedures, subjects will first perform the task without training and then, if necessary, with training.

Third, subjects will use the same devices with software that provides procedural directions. The directions will be provided in multiple modalities, including auditory and visual, and different levels of complexity (e.g., extended text versus single words, maps versus simple graphics, long verbal descriptions versus short verbal descriptions). The directions will require movement within the room. For example, subjects might be asked to take two steps forward, turn left, walk three steps, turn right and walk to the wall. (If the subject is in a wheelchair, the directions will be adapted appropriately.) Subjects will never leave the room. Subjects will again perform first without training and then with. They will again discuss what is difficult or easy about the task.

During these usability tests, subjects will be digitally videotaped with a focus on the individual's hands and the device they are holding. Researchers will also take field notes during the session. We will not record information about the specific functional needs of subjects. Based on the findings from these sessions, new interfaces will be developed and subjects will be asked to work with iterations of these designs. The digital videotape will be erased at the conclusion of this study.

Status

This study is currently under review by the University of Washington Human Subjects Committee.