copyright 1997
by Sensory Access Foundation.
Abstract
Access for blind individuals to the graphical user interface
(GUI) continues to generate great discussion and research.
Although many GUI screen-reading software programs can access
individual aspects of Windows 95 applications, there still exists
the issue of sufficient access to perform complete sets of tasks
instead of individual tasks. The following article compares
three GUI screen-readers through some of the most common sets of
tasks an individual needs to perform.
Editor
[Note: Special thanks go to Barbara Manipod for her dedicated
and undaunted assistance with the evaluations and follow-up
work.]
After gaining access to the most common aspects and controls of
the graphical user interface (GUI), the most critical hurdle lies
in the ability to perform sets of tasks needed to organize,
control, and complete whole projects. Many GUI screen-reader
developers are working hard to develop this extent of access, and
the blind community is anxiously awaiting their results.
This article attempts to objectively compare some Windows 95
screen-readers, in an effort to demonstrate some of the access
blind individuals can expect when performing certain common
tasks. This comparison should not be construed as a supplement
to requesting demonstration copies of the products from the
vendors, nor should the reader gauge the evaluation of any
product on its general scoring.
A product may prove effective in one application and less
effective in another. One product may be effective in Microsoft
Word while another product is more effective in Microsoft Excel.
Although the average performance of the products may appear
similar, it is crucial for the reader to note which product is
most effective for them in their specific working environment.
This article is the first of two articles in this series, and
evaluates three GUI screen-readers. This article contains the
following sections:
1. GUI Vendors.
2. Set-up.
3. Scoring.
4. Evaluation.
5. Results.
6. Summary.
1. GUI Vendors.
There were six GUI screen-readers chosen for evaluation. Three
of these products are represented in this article, and the
remaining three will be compared in part two of this series which
will appear in the Fall issue of ACCESS REVIEW. In alphabetical
order, the three screen-readers represented in this issue are:
ASAW v1.2b by MicroTalk
HAL95 v1.2 by Dolphin Systems
Window-Eyes v2.0-Beta52 (pre-2.1 release) by GW Micro
There are constant changes and new developments being made by
screen-reader vendors. It is important to note that each of the
vendors will have most likely released versions by the time the
reader reviews this article. Dolphin Systems has indicated that
additional aspects have been addressed in HAL95 v1.3, especially
regarding MS/Excel. MicroTalk has stated that they have
addressed some additional issues in ASAW v1.2c, and GW Micro
states that they have progressed significantly in their
Window-Eyes v2.1. SAF thanks all of the vendors sincerely for
their willingness to participate in our research, the loan of
their products, and their honesty.
2. Set-up.
All GUI screen-readers were evaluated on identical 200 megahertz
Pentium platforms with 32 megabytes of RAM. Each product was
evaluated twice, and all vendors were consulted after the
evaluation to ensure that the evaluation was accurate with no
error due to evaluator oversight. The evaluators were blind,
with minimal sighted assistance for confirming screen layout.
Aside from Windows 95, the applications in which each
screen-reader was evaluated included Microsoft Word v7, Microsoft
Excel v7, Microsoft Internet Explorer v3, and Netscape Navigator
v3. The tasks were selected through a brief survey of which
tasks individuals might need to perform. Most tasks include
several steps, and we have included these steps since there are
so many manners by which to perform similar tasks in Windows 95.
3. Scoring.
SAF implemented its own scoring system for these evaluations.
Each GUI screen-reader was scored with a value of zero to 4. The
values are defined as follows:
(0) the GUI screen-reader failed to accomplish the task;
(1) the GUI screen-reader failed to accomplish the task but spoke
some relevant items;
(2) the GUI screen-reader accomplished the task with difficulty
and/or numerous keystrokes that would generally discourage
frequent use of the screen-reader for the task;
(3) the GUI screen-reader accomplished the task with little
difficulty, moderate verbosity, and few steps or keystrokes;
(4) the GUI screen-reader accomplished the task with no
difficulty, single/few keystrokes, and little verbosity.
4. Evaluation.
Thirty-three tasks were performed during the evaluation, and the
following details the results.
Windows 95
1. Install screen-readers. (Note: This task assumes that the
user has no W95 screen-reader, and that they will be installing
their GUI screen-reader from DOS with a DOS screen-reader.)
ASAW: 2
Comments: Manual not clear, and refers to installation from
Windows only; user needs to review multiple files to find DOS
command-line installation instructions, but ASAW does not specify
a clear distinction between "asawinst.bat" and "maninst.bat";
very verbose, but verbalized items are not relevant for the user
interface.
HAL95: 4
Comments: Clear instructions, and prompts user before any action
is taken; audio cassette instructions can walk the user
step-by-step through the installation if the user has no
screen-reader at all.
Window-Eyes: 4
Comments: Clear instructions, and prompts user before any action
is taken.
2. Tab over the Desktop: CTRL-ESC, ESC, tab.
ASAW: 2
Comments: Denotes Start button as "property sheet"; lists Task
bar items when the user is on either the Task bar or Start
button; cursoring works in Desktop, but does not indicate that
"My Computer" is selected when space bar is pressed; speak title
key says "Program Manager Desktop"; does not speak when using
left and right arrow keys on the Task bar; speaks nothing when
CTRL-ESC (Start Menu) is depressed.
HAL95: 2
Comments: Read Start button and Desktop, but called the Desktop
"Program Manager"; did not indicate Task bar, but did read items
on Task bar other than HAL95; arrowing left and right on the Task
bar spoke inconsistently.
Window-Eyes: 4
Comments: None.
3. Copy Audio short-cut from Programs sub-menu to the Start
Menu: CTRL-ESC, ESC, Shift-F10, O, P, return, press "A" until
you reach Audio, CTRL-C, ALT-F4, CTRL-V, ALT-F4.
ASAW: 2
Comments: Long 20-25 second delay when acknowledging when item
is pasted; does not actually say that the item has been pasted.
HAL95: 2
Comments: No indication when item was copied or pasted.
Window-Eyes: 4
Comments: Indicates that item is copied or pasted by repeating
the selected item name.
4. Create a short-cut and a short-cut key for MS/Word:
CTRL-ESC, S, T, CTRL-tab, return, ALT-R, Shift-tab, M, return, W,
return, W, return, return, arrow up, return, type in MS/Word,
return, ALT-F4. CTRL-ESC, ESC, Shift-F10, O, M, ALT-return,
CTRL-tab, tab twice, M, tab to OK, return, ALT-F4.
ASAW: 4
Comments: Double-speaks in the "Customize Start Menu" tab.
HAL95: 4
Comments: Worked well, and spoke short-cut key when keystroke
was entered.
Window-Eyes: 4
Comments: None.
5. Set time and date: CTRL-ESC, S, return, D, return, tab
through dialogue, return, ALT-F4.
ASAW: 2
Comments: Repeated control type and spoke seconds constantly,
although not in the "seconds" field; no interruptibility or
silencing capability.
HAL95: 3
Comments: Worked well, but did not speak field names for edit
fields; read each second when in seconds edit field.
Window-Eyes: 3
Comments: Worked well, but did not speak field names for edit
fields.
6. Change color palette from 16-color to 256-color: CTRL-ESC,
S, return, D, D, return, CTRL-Shift-tab, down-arrow, return,
ALT-F4.
ASAW: 0
Comments: Ceased speaking in the display options.
HAL95: 3
Comments: Worked well, but did not speak Settings tab
automatically; user had to tab/shift-tab to find out tab name.
Window-Eyes: 4
Comments: None.
7. Change video resolution to highest possible: CTRL-ESC, S,
return, D, D, return, CTRL-Shift-tab, tab, right-arrow, return,
return, Y, ALT-F4.
ASAW: 0
Comments: Ceased speaking in the display options.
HAL95: 0
Comments: Did not speak track bar, so user could not set any
resolution; numpad-* did not indicate resolution.
Window-Eyes: 3
Comments: Indicated that the user was in a track bar for
adjusting video resolution and spoke increments as indices; did
not speak actual resolution.
8. Copy noncontiguous files "file1.doc, file3.doc, file4.doc"
from C:\SAF1 to C:\SAF2 via Windows Explorer. Then select all
files from SAF2 and delete them: CTRL-ESC, p, w, RETURN, S,
return, HOME, select contiguous files, CTRL-C, back-space, S, S,
return, CTRL-V, CTRL-A, DEL, Y, back-space, ALT-F4.
ASAW: 2
Comments: Did not speak file names or selections consistently;
did not speak pointed to file until selected with space bar; did
not speak proper file names when selecting all files with CTRL-A;
speaks status of how many files have been pasted from clipboard.
HAL95: 2
Comments: Worked except that there was no indication that files
were copied; repeats selected file name whether or not it is
actually selected; repeats first file name pasted to indicate
files pasted; would be good if stated how many files were pasted.
Window-Eyes: 3
Comments: Indicates files copied by stating last selected file;
pasted files are acknowledged by speaking the top file name; does
not repeat all pasted files, but would be good if stated how many
files were pasted.
9. Format a disk: CTRL-ESC, ALT-M, space, return, space, ALT-F,
M, ALT-L, type "SUMMER97", ALT-S, ALT-F4, ALT-F4.
ASAW: 3
Comments: Very interactive, except that ASAW did not speak "My
Computer" when selected; automatically informed the user that the
format was complete and displayed the status results.
HAL95: 3
Comments: Worked well and spoke format results; did not speak
"My Computer" when selected.
Window-Eyes: 4
Comments: None.
10. Diskcopy a disk: CTRL-ESC, ALT-M, space, return, space,
ALT-F, Y, return, ALT-C.
ASAW: 3
Comments: Does not speak the entire diskcopy dialogue box at
first, but speaks edit fields and results well.
HAL95: 4
Comments: Identifies diskcopy complete by saying "close".
Window-Eyes: 3
Comments: Notified user to insert target disk, but did not
inform user when diskcopy was complete.
MS/Word (MS Office 95)
11. Retrieve C:\SAF1\DRESSLER.DOC: CTRL-O, type
"C:\SAF1\DRESSLER.DOC", return.
ASAW: 4
Comments: None.
HAL95: 4
Comments: Speaks first line of document when document is
retrieved.
Window-Eyes: 4
Comments: None.
12. Does your program have a read-to-end feature?
ASAW: 4
Comments: None.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 4
Comments: None.
13. Read an entire screen or document and have your program
notify you where font style, font size, and attribute changes
occur; since this relates to rapid proofing of a document; using
arrow keys is not preferable.
ASAW: 1
Comments: Could not notify user of changes while reading a
screen; point size inaccurate when using arrow keys, and failed
to indicate when attribute is turned off.
HAL95: 3
Comments: Could not identify underlined text, but indicated an
attribute change, as well as when the attribute was turned off;
indicated incorrect point size.
Window-Eyes: 3
Comments: Reads any attribute changes while reading a screen,
but indicates a larger point size than is actually there.
14. Determine whether the title of the document is centered.
ASAW: 0
Comments: Could not determine if title was centered.
HAL95: 0
Comments: Could not determine if title was centered.
Window-Eyes: 4
Comments: Use ALT-J; speaks active justification.
15. Replace all cases of the name, "Murdock" with "Stern":
CTRL-home, CTRL-H, type in "Murdock", tab, type IN "Stern",
ALT-A, RETURN, ESC.
ASAW: 4
Comments: None.
HAL95: 4
Comments: None.
Window-Eyes: 4
Comments: Read summary and indicated task completion.
16. Perform a spell-check: Use F7.
ASAW: 4
Comments: None.
HAL95: 1
Comments: Reads suggested word only.
Window-Eyes: 4
Comments: None.
17. Re-read the misspelled word.
ASAW: 0
Comments: Does not currently support this feature.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 4
Comments: Use CTRL-W.
18. Read the misspelled word in context.
ASAW: 0
Comments: Does not currently support this feature.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 4
Comments: Use CTRL-Shift-L.
19. Complete a resume template: ALT-F, N, CTRL-Shift-tab, arrow
right 3 times, return 5 times, ALT-F.
ASAW: 1
Comments: Read contents of dialogue boxes once, but could not
read field names in dialogue boxes; could not read series of
check-boxes that list resume headings; spoke field names when
pressing F11 to jump from one heading to another.
HAL95: 3
Comments: Must read dialogue contents manually; reads entire
descriptions for resume formats; reads field names with F11, but
does spell each field name.
Window-Eyes: 2
Comments: Needed to read dialogue boxes and field names manually
since program could not read either of them automatically; Did
not read field names automatically with F11.
MS/Excel (MS Office 95)
20. Retrieve the file "nannies.xl": CTRL-O, type "Nannies",
return.
ASAW: 1
Comments: Extremely verbose; closed MS/Excel involuntarily on
first 2 attempts to retrieve file; retrieved file using run
command on Start Menu.
HAL95: 4
Comments: Spoke the three conversion dialogue boxes when
retrieving file.
Window-Eyes: 3
Comments: Spoke first of the three conversion dialogue boxes,
but not the second or third.
21. Place highlight on cell G-16 by using the arrow keys.
ASAW: 0
Comments: Could not confirm location except by counting rows and
columns; did not speak cell coordinates while moving arrow keys.
HAL95: 0
Comments: Did not speak cell coordinates; says "blank line" when
cursoring up or down.
Window-Eyes: 4
Comments: Read coordinates with every move of the arrow keys.
22. Read the current cell coordinates with reading keys only.
ASAW: 0
Comments: Does not currently support this feature.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 4
Comments: ALT-C reads cell coordinates.
23. Read the current cell contents with reading keys only.
ASAW: 0
Comments: Does not currently support this feature.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 4
Comments: ALT-D reads CELL contents; ALT-C reads cell
coordinates and cell contents.
24. Read current heading with a read key.
ASAW: 0
Comments: Does not currently support this feature.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 3
Comments: Used CTRL-ALT-C to speak column letter and heading,
but read all fields vertically from the heading to the highlight.
25. Read heading while cursoring left or right.
ASAW: 0
Comments: Does not currently support this feature.
HAL95: 0
Comments: Does not currently support this feature.
Window-Eyes: 3
Comments: Read headings well, but truncated cell contents; used
ALT-D to read full cell contents.
26. Press F5 (Go to) and go to cell A-47. Does your program
notify you that you have completed the task?
ASAW: 0
Comments: Did not acknowledge arrival.
HAL95: 4
Comments: Reads cell contents upon arrival.
Window-Eyes: 4
Comments: Reads cell contents upon arrival.
27. Bold cell A-47: CTRL-1, arrow twice, tab twice, arrow down
twice, return.
ASAW: 0
Comments: Could not read format dialogue box; pressed numpad-/
for current location and landed on W95 Task bar.
HAL95: 1
Comments: Could not read font style selections in the "format
cell" dialogue box.
Window-Eyes: 3
Comments: Read dialogue boxes, but had some difficulty reading
font style lists; needed to use Shift-tab and tab to read font
style selections in the "format cells" dialogue box.
MS/Internet Explorer
28. Connect to the Washington Post (www.washingtonpost.com).
Does your program read the home page automatically?
ASAW: 1
Comments: Spoke non-sensible characters; tremendous delay made
it impossible to determine whether home pages had been found.
HAL95: 2
Comments: Read, but had poor silencing; spoke extraneous words
from prior pages from which the program was launched.
Window-Eyes: 3
Comments: Read pages automatically, but user needs to tap
control key to prevent the prior page from being read.
29. Does your program read columns automatically?
ASAW: 0
Comments: Could not read columns.
HAL95: 3
Comments: Some double-speaking.
Window-Eyes: 4
Comments: None.
30. Go to www.yahoo.com, enter the edit field for a search, and
enter: blind employment. How many matches were found?
ASAW: 0
Comments: Spoke unintelligible words and could not get to edit
field.
HAL95: 3
Comments: Did not read results automatically; used numpad
asterisk to read results; somewhat verbose.
Window-Eyes: 4
Comments: None.
Netscape Navigator
31. Connect to the Washington Post (www.washingtonpost.com).
Does your program read the home page automatically?
ASAW: 2
Comments: Poor silencing and interruptibility; long delays and
much repetition.
HAL95: 0
Comments: Did not read home pages automatically.
Window-Eyes: 4
Comments: None.
32. Does your program read columns automatically?
ASAW: 0
Comments: Could not get to link with columns.
HAL95: 1
Comments: Did not read columns accurately.
Window-Eyes: 4
Comments: None.
33. Go to www.yahoo.com, enter the edit field for a search, and
enter: blind employment. How many matches were found?
ASAW: 0
Comments: No response from ASAW.
HAL95: 0
Comments: Could not find edit field for search.
Window-Eyes: 4
Comments: None.
5. Results.
The following is a compilation of all of the screen-reader scores
for the thirty-three tasks. Each screen-reader is listed below
with their total score over the points possible, as well as a
percentage. Careful note should be taken that the percentage and
difficulty of tasks is mutually exclusive; one program may have
performed better in a more difficult task, while another
performed better in an easier or less important task.
MicroTalk ASAW
42/132
32%
Dolphin Systems HAL95
60/132
46%
GW Micro Window-Eyes
120/132
91%
6. Summary.
It is important to remember that each of the products evaluated
are evolving constantly. As you read this article, new versions
and utilities are being developed and released. In the Fall
issue, we will evaluate three additional GUI screen-readers, and,
in the not-too-distant future, we will be evaluating these
programs in MS Office 97, Memphis (Windows 98), and Windows NT.
--
End of Document
--
Jamal Mazrui empower@smart.net
ACCESS REVIEW is published quarterly in regular print, large print, audio cassette and 3-1/2" PC diskette by Sensory Access Foundation.
One year subscriptions are $35 for individuals and $55 for organizations and companies. Outside the United States, Canada and Mexico subscription rates are $50 for individuals and $70 for organizations and companies.
Full contents copyrighted 1997 by Sensory Access Foundation. Reproduction by any means, without written permission of the publisher, is expressly prohibited. Direct all correspondence to:
Kenneth Frasse, Editor
Access Review
c/o Sensory Access Foundation
385 Sherman Ave., Suite #2
Palo Alto, CA 94306
Tel: 1-650-329-0430
Fax: 1-650-323-1062
E-mail: safinr@sensoryaccess.com
URL: http://www.sensoryaccess.com