For more info on a specific newsletter, click the title. Details will be displayed in a new window.
Subscribe to
Computerworld 40 years of the most authoritative source of news and information for IT leaders.
Users Begin to Demand Software Usability Tests
or
Other Software Development Stories
|
|
|
|
November 25, 2002 (Computerworld) -- WASHINGTON -- The Boeing Co. is changing the way it buys software and is making a product's usability—the ease with which end users can be trained on and operate the product—a fundamental purchasing criterion. It's a move the aerospace giant sees as an essential means of controlling IT costs.
"We simply can't afford to pay for products that cost us a lot of overhead anymore," said Keith Butler, a technical fellow at Boeing's Phantom Works research and development arm. When thousands of end users are involved, design flaws can cost millions of dollars in lost time and productivity, he said.
What's helping Boeing change its purchasing approach is the recent development of a standard for comparing product usability that was spearheaded by the National Institute of Standards and Technology.
Called the Common Industry Format for Usability Test Reports, the standard outlines a format for reporting test conditions and results and gives user companies enough information about a test to replicate it. It's a means for objectively evaluating software, say its backers.
Next month, NIST intends to seek international standards recognition. The standard has already received American National Standards Institute certification.
CIF's success as a purchasing tool depends on whether other companies follow Boeing and make usability a "peer," as Boeing officials put it, of such traditional purchasing criteria as a product's functionality, price and system requirements. If that happens, users say, the standard could have a far-reaching effect in improving the usability of software.
"The real value of CIF, quite honestly, is that if vendors know we are expecting it, meaning large software purchasers, they will focus their attention on usability and hopefully make their products better before they ever come out the door," said Jack Means, superintendent of usability at State Farm Insurance Cos. in Bloomington, Ill.
Boeing played a lead role in the development of CIF after its experience and internal studies showed that usability played a significant role in total cost of ownership. In one pilot of the CIF standard on a widely deployed productivity application, the Chicago-based company said improved product usability had a cost benefit of about $45 million.
Butler said it's much better to have vendors refine an interface design "than to have thousands of end users doing it involuntarily on top of their jobs and then just feeling frustrated."
Spotting Problems Early
Doug Francisco, director of IS architecture at Boeing's commercial airplane division, maintains that CIF will improve the ability of the IT department to spot problems before a product is rolled out to employees. The company has looked at usability in purchasing, "but sometimes we wouldn't discover the inefficiencies of a software product until we brought it in-house," he said.
Microsoft Corp., in its capacity as a CIF development participant, has incorporated the usability testing it conducted on its Windows XP, Windows ME and Windows 2000 operating systems into the CIF format, said Kent Sullivan, Microsoft's usability lead for the Windows client.
Sullivan said Microsoft is prepared to use CIF but noted that its adoption will depend on customer demand. Microsoft typically doesn't receive questions about usability from customers, so when users do ask about it, he said, "it indicates that they are ahead of the curve a little bit."
In the past year, interest in CIF has grown from about 50 firms taking part in the NIST effort to more than 150, including PeopleSoft Inc., Oracle Corp. and Eastman Kodak Co.
The CIF format will also be adapted for hardware testing, said Emile Morse, who heads the effort for NIST. Morse said she believes CIF makes it possible for vendors and users to discuss usability as a science rather than marketing hype. "I think CIF gives a lot of credibility to the practice of usability," she said.
Factors that determine a software product’s usability include:
How much time it takes to complete a task
How much training is needed
Whether the product motivates people to use it
CIF FAQ
Most vendors conduct usability testing. The Common Industry Format for Usability Test Reports (CIF) provides an objective means for evaluating testing data.
WHAT IS USABILITY TESTING?
It broadly measures task-completion rates. Test subjects are monitored as they use software.
WHO BENEFITS?
Large user companies with usability experts on staff who can interpret test results.
WHAT CAN USER COMPANIES DO?
When purchasing software, they can ask vendors for CIF reports to compare product usability. They can also replicate tests.
WHERE DOES CIF STAND?
If large user companies ask vendors to produce usability tests in the CIF format, the standard could win wide acceptance. Its future is up to users.
More technical information on CIF and a list of companies participating in its development are available at http://zing.ncsl.nist.gov/iusr/info/list-lname.shtml.
|
Print this Story |
|
Send Us Feedback |
|
E-mail this Story |
|
Digg this Story |
|
Slashdot this Story |
|
|
|
|
|
|
 |
|
All Zones Application Performance Zone Enterprise-Class Security Zone Enterprise Solutions Zone The File Data Management Zone Grid Computing on Windows Zone Security Management Zone ITIL Best Practices Zone The SAS Zone Storage Virtualization Zone The Data Center Management Zone |
 See your link here
|
 |
||||||||
| ||||||||
| ||||||||
| ||||||||
|
Download this Computerworld report, free for a limited time, compliments of HP.
Download this white paper, free, compliments of Citrix. 
Why SaaS is Vital to Email and Web Security
Read up on the latest ideas and technologies from companies that sell hardware, software and services.
- Microsoft: Don't misunderstand UAC, other Vista features
- HP confirms XP SP3 endless reboot snafu, promises patch
- Microsoft pulls Windows Home Server backup feature
- More top stories
| XenServer FREE trial Citrix XenServer is the simplest and most effective way to virtualize and provision servers. XenServer combines comprehensive server virtualization capabilities with unparalleled scalability, performance, economics, and ease-of-use. Based on the open source Xen hypervisor, XenServer delivers fast performance, easy management, and advanced features such as live migration. |
| Detect, identify, and locate RF interference in 802.11 WLANs. AnalyzeAir software provides IT network professionals with the vision they need into the hidden world of RF, providing them with the ability to see the spectrum in a visible and intelligible format. AnalyzeAir software lets you see, monitor, analyze, and manage all the RF sources and wireless devices that influence your Wi-Fi network's performance and security, even if those devices are unauthorized or transient. AnalyzeAir Trial Software v3.1 highlights the features found in AnalyzeAir Software using a set of saved spectrum files. Replay the data and experience the visibility that AnalyzeAir Wi-Fi Spectrum Analyzer provides. Note: The trial software is limited to a player version only. It does not communicate with an AnalyzeAir PC card so it does not collect actual spectrum data. Register for this trial now.
|
CIO
Computerworld
CSO
DEMO
GamePro
Games.net
IDG Connect
IDG World Expo
Infoworld
The Industry Standard
ITworld
JavaWorld
LinuxWorld
MacUser
Macworld
Network World
PC World
Playlist
Copyright © 2008 Computerworld Inc. All
rights reserved. Reproduction in whole or in part in any form or medium
without express written permission of Computerworld Inc. is prohibited.
Computerworld and Computerworld.com and the respective logos are
trademarks of International Data Group Inc.
|
