Tobii Customer Case Usabiltytesting Catalyst 050609 Eng Web

eye tracking research Usability testing

”Adding eye tracking to our research projects allows us to provide our clients with deeper insights into how users respond to their website or application. In turn, we are able to provide more precise design recommendations to assist our clients and help our own designers to create more effective interfaces.”



Peter Hughes, Founder & Principal Consultant , Catalyst Group

Many “Web 2.0” and social networking sites provide the ability to connect through your existing network with people you either already know or want to get to know.

The purpose Despite the broad relevance and significance of the friends list, different social networking sites offer very different versions of this design element. Catalyst Group wanted to evaluate the most effective display factor for this type of information. Two prototypes were created inspired by the two leading social networking sites, Facebook and LinkedIn.

job titles from each other, easily find the information they needed to look at given the particular task. In the 3-Column Layout, participants were overwhelmed by the amount of information displayed, that made it difficult to focus on the information they needed to complete the task.

As a result, the page containing the list of friends or connections is a crucial step in the usage of these sites. Catalyst Group conducted an eye tracking study to compare the usability of the layout of two popular ‘friends lists’. They determined that one of the designs was clearly more effective for accurately accomplishing key networking goals.

Left: 1-Column (Facebook-inspired) Layout Right: 3-Column (LinkedIn-inspired) Layout

Heat map visualizations. Left: The 1-Column Layout. Right: The 3-Column Layout

The tasks

Eye tracking data also revealed that virtually all participants scanned the 1-Column Layout the same way and there was very little hesitation or exploration at the start of the task. Users were able to dive right into scanning without having to experiment with different scanning strategies (a phenomenon observed with the 3-Column Layout).

To mimic the act of scanning a list for someone you recognize without knowing specifically who they are, two ‘real world’ tasks were created; a Name Recognition Task and a Title /Description Recognition Task (searching for a design professional).

The results Overall, the Facebook-inspired / 1-Column Layout was a much more effective and enjoyable way of presenting the tested information. This preference was clearly articulated by users during the RTA (retrospective think aloud) sessions, and supported by the eye tracking data. It was easy to read the single column of names straight down during the Name Recognition Task, and users were able to ignore the adjacent column containing information irrelevant to the current task. Similarly, users scanned vertically down the title/description column when searching for a design professional to work with. In the 1-Column Layout, participants could segregate names, pictures, and

Visualizations from two of the participants studying the1-Column Layout. All users scanned the information vertically. While there were occasional glances at pictures or names (depending on the assigned task) users followed the same general pattern of reading down the page as they scrolled.

W Leading Eye Tracking technology

©TOBII . All other trademarks are the property of their respective owners. ®

Usability testing

Page fold.

Representative gaze plots of the 3-Column Layout. The effect of the ‘page fold’ line. Some users opted to scan everything in view first, before scrolling to view the rest of the page. Others attempted to scan all the way to the bottom of the page and then scroll back to the top. A few used their mouse as a guide as they read from one block of text to the next. Notably, some users were observed to change their reading strategy once they started to scroll (image).

Eye tracking of the 3-Column Layout revealed that the participants did not adopt a consistent scanning strategy for this design. Moreover, most participants had to begin by experimenting with different scanning strategies before deciding which one to use. This uncertainty was exacerbated by the need to scroll the page in order to see the full 3-column list. Many participants found that they had lost their place on the page after scrolling and had to backtrack up the page.

The study

Why eye tracking

In order to isolate the specific function that Catalyst Group was interested in, the testing prototypes of the two friends list layouts did not contain any navigation or design elements. The content of each prototype was identical in terms of the number of names and descriptions listed – with the one exception that the Facebook-inspired interface included pictures of the individuals and the LinkedIn-inspired design only listed names and titles. The participant pool consisted of 13 participants, all members of at least one social networking site (e.g. Facebook, LinkedIn, MySpace, or Twitter). The two tasks created were: • Name Recognition Task For this task, the participants were told that the lists contained zero or more names of U.S. presidents and asked them to scan the list and count the number of presidents they found. • Title / Description Recognition Task The participants were asked to find a design professional to assist them with a project. A Tobii T60 Eye Tracker was used for the study. Catalyst Group presented each participant with both tasks and both layouts. Participants were eye tracked during their task completion attempts and the eye tracking session was then followed by qualitative retrospective think aloud discussions to explore their experiences in greater detail. The presentation of each layout and task was rotated in order to prevent order bias.

North America Tobii Technology, Inc. 510 N. Washington Street Suite 200 - Falls Church, VA 22046 - USA +1-703-738-1300 Phone +1-888-898-6244 Phone +1-703-738-1313 Fax [email protected]

Why Tobii

“When we were researching which system to buy, Tobii’s name kept coming up. We now have a Tobii T60 Eye Tracker and use it heavily. Tobii is very committed to their product – it shows in their customer support and the fact that they are continually improving their systems.“ Peter Hughes, Founder & Principal Consultant

About Catalyst Group

Catalyst Group is a user-centered research and design firm dedicated to helping companies connect their business objectives to the needs and expectations of their customers. Catalyst is based in New York City. www.catalystnyc.com

To find out how Eye Tracking can improve your business, please visit www.tobii.com or contact one of our offices.

As a result of this research, Catalyst Group recommend that sites that rely on networking functionality consider using a version of the 1-Column Layout in order to better facilitate scanning, and create a more fluid and comfortable user experience.

EMEA Tobii Technology AB Karlsrovägen 2D S-182 53 Danderyd Sweden +46 8 663 69 90 Phone +46 8 30 14 00 Fax [email protected]

“We have noticed at Catalyst that we get more insightful and precise responses from users since we adopted an eye tracking/ RTA approach. Users find the research process more engaging. When they can see not only what they did but what they actually looked at it really helps them to focus on what is important. From my perspective as a usability researcher, eye tracking/RTA has made it much easier to surface the most significant issues as well as more subtle ones.” Peter Hughes, Founder & Principal Consultant

Tobii_CustomerCase_UsabiltyTesting_Catalyst_050609_ENG_Web

The LinkedIn / 3-Column Layout was thought by most participants to be more cumbersome and overwhelming in its design – more “tiring” according to one participant. Also, participants felt much less confident that they had successfully completed the tasks with the 3-Column Layout. In other words, they did not feel certain that they had seen all the names.

ASIA Tobii Technology, Ltd. 3-4-13 Takanawa, Minato-ku Tokyo 108-0074 Japan +81-3-5793-3316 Phone +81-3-5793-3317 Fax [email protected]

central Europe Tobii Technology GmbH Niedenau 45 D-60325 Frankfurt am Main Germany +49 69 24 75 03 40 Phone +49 69 24 75 03 429 Fax [email protected]

www.tobii.com