This is the continuation of yesterday's post from "Jakob Nielsen's 1997 article" To measure the effect of some of the content guidelines we had identified, we developed five different versions of the same website (same basic information; different wording; same site navigation). We then had users perform the same tasks with the different sites. As shown in the table, measured usability was dramatically higher for the concise version (58% better) and for the scannable version (47% better). And when we combined three ideas for improved writing style into a single site, the result was truly stellar: 124% better usability. | Site Version | Sample Paragraph | Usability Improvement (relative to control condition) |
|---|
Promotional writing (control condition) using the "marketese" found on many commercial websites | Nebraska is filled with internationally recognized attractions that draw large crowds of people every year, without fail. In 1996, some of the most popular places were Fort Robinson State Park (355,000 visitors), Scotts Bluff National Monument (132,166), Arbor Lodge State Historical Park & Museum (100,000), Carhenge (86,598), Stuhr Museum of the Prairie Pioneer (60,002), and Buffalo Bill Ranch State Historical Park (28,446). | 0% (by definition) | Concise text with about half the word count as the control condition | In 1996, six of the best-attended attractions in Nebraska were Fort Robinson State Park, Scotts Bluff National Monument, Arbor Lodge State Historical Park & Museum, Carhenge, Stuhr Museum of the Prairie Pioneer, and Buffalo Bill Ranch State Historical Park. | 58% | Scannable layout using the same text as the control condition in a layout that facilitated scanning | Nebraska is filled with internationally recognized attractions that draw large crowds of people every year, without fail. In 1996, some of the most popular places were: - Fort Robinson State Park (355,000 visitors)
- Scotts Bluff National Monument (132,166)
- Arbor Lodge State Historical Park & Museum (100,000)
- Carhenge (86,598)
- Stuhr Museum of the Prairie Pioneer (60,002)
- Buffalo Bill Ranch State Historical Park (28,446).
| 47% | Objective language using neutral rather than subjective, boastful, or exaggerated language (otherwise the same as the control condition) | Nebraska has several attractions. In 1996, some of the most-visited places were Fort Robinson State Park (355,000 visitors), Scotts Bluff National Monument (132,166), Arbor Lodge State Historical Park & Museum (100,000), Carhenge (86,598), Stuhr Museum of the Prairie Pioneer (60,002), and Buffalo Bill Ranch State Historical Park (28,446). | 27% | Combined version using all three improvements in writing style together: concise, scannable, and objective | In 1996, six of the most-visited places in Nebraska were: - Fort Robinson State Park
- Scotts Bluff National Monument
- Arbor Lodge State Historical Park & Museum
- Carhenge
- Stuhr Museum of the Prairie Pioneer
- Buffalo Bill Ranch State Historical Park
| 124% |
It was somewhat surprising to us that usability was improved by a good deal in the objective language version (27% better). We had expected that users would like this version better than the promotional site (as indeed they did), but we thought that the performance metrics would have been the same for both kinds of language. As it turned out, our four performance measures (time, errors, memory, and site structure) were also better for the objective version than for the promotional version. Our conjecture to explain this finding is that promotional language imposes a cognitive burden on users who have to spend resources on filtering out the hyperbole to get at the facts. When people read a paragraph that starts "Nebraska is filled with internationally recognized attractions," their first reaction is no, it's not, and this thought slows them down and distracts them from using the site. |