Content on this page requires a newer version of Adobe Flash Player.

Get Adobe Flash player

High Performance Web Sites That Do More & Cost Less!
Custom Site Designs

A look and feel that is
unique to you
designed to your specifications
with all the power of the
GS System

CLICK HERE...  

Template Sites

A Low Cost Option
Your site will be set up for FREE
ready for you to add your
content

CLICK HERE...  

Search Optimization

Get Found
on Major Search Engines

Take our Search Engine Seminar and/or schedule a
1-on-1 consultation

CLICK HERE...  

Content Formatting

Upgrade the look and functionality of your web site by having your content professionally formatted

CLICK HERE...  

Blog Home - Blog Archive

Measuring the Effect of Improved Web Writing Wednesday, August 15, 2007

This is the continuation of yesterday's post from "Jakob Nielsen's 1997 article"

To measure the effect of some of the content guidelines we had identified, we developed five different versions of the same website (same basic information; different wording; same site navigation). We then had users perform the same tasks with the different sites. As shown in the table, measured usability was dramatically higher for the concise version (58% better) and for the scannable version (47% better). And when we combined three ideas for improved writing style into a single site, the result was truly stellar: 124% better usability.

Site VersionSample ParagraphUsability Improvement
(relative to control condition)
Promotional writing (control condition)
using the "marketese" found on many commercial websites
Nebraska is filled with internationally recognized attractions that draw large crowds of people every year, without fail. In 1996, some of the most popular places were Fort Robinson State Park (355,000 visitors), Scotts Bluff National Monument (132,166), Arbor Lodge State Historical Park & Museum (100,000), Carhenge (86,598), Stuhr Museum of the Prairie Pioneer (60,002), and Buffalo Bill Ranch State Historical Park (28,446).0%
(by definition)
Concise text
with about half the word count as the control condition
In 1996, six of the best-attended attractions in Nebraska were Fort Robinson State Park, Scotts Bluff National Monument, Arbor Lodge State Historical Park & Museum, Carhenge, Stuhr Museum of the Prairie Pioneer, and Buffalo Bill Ranch State Historical Park.58%
Scannable layout
using the same text as the control condition in a layout that facilitated scanning
Nebraska is filled with internationally recognized attractions that draw large crowds of people every year, without fail. In 1996, some of the most popular places were:
  • Fort Robinson State Park (355,000 visitors)
  • Scotts Bluff National Monument (132,166)
  • Arbor Lodge State Historical Park & Museum (100,000)
  • Carhenge (86,598)
  • Stuhr Museum of the Prairie Pioneer (60,002)
  • Buffalo Bill Ranch State Historical Park (28,446).
47%
Objective language
using neutral rather than subjective, boastful, or exaggerated language (otherwise the same as the control condition)
Nebraska has several attractions. In 1996, some of the most-visited places were Fort Robinson State Park (355,000 visitors), Scotts Bluff National Monument (132,166), Arbor Lodge State Historical Park & Museum (100,000), Carhenge (86,598), Stuhr Museum of the Prairie Pioneer (60,002), and Buffalo Bill Ranch State Historical Park (28,446).27%
Combined version
using all three improvements in writing style together: concise, scannable, and objective
In 1996, six of the most-visited places in Nebraska were:
  • Fort Robinson State Park
  • Scotts Bluff National Monument
  • Arbor Lodge State Historical Park & Museum
  • Carhenge
  • Stuhr Museum of the Prairie Pioneer
  • Buffalo Bill Ranch State Historical Park
124%

It was somewhat surprising to us that usability was improved by a good deal in the objective language version (27% better). We had expected that users would like this version better than the promotional site (as indeed they did), but we thought that the performance metrics would have been the same for both kinds of language. As it turned out, our four performance measures (time, errors, memory, and site structure) were also better for the objective version than for the promotional version. Our conjecture to explain this finding is that promotional language imposes a cognitive burden on users who have to spend resources on filtering out the hyperbole to get at the facts. When people read a paragraph that starts "Nebraska is filled with internationally recognized attractions," their first reaction is no, it's not, and this thought slows them down and distracts them from using the site.

 


posted by Bob Nelson at 4:18 pm

0 comments - Add comment