Tests for gathering the general UA and AT behavior for img elements with and without the alt attribute.

by Leif Halvard Silli. Per 7th of August 2012, this document was still being worked on.

Background, purpose and results of these tests follows below. Otherwise, to take the test, just start reading the following two tables with your favorite assistive technology, graphical user agent or text browser. PS: Webkit browser users might benefit from reading a small note before takinging the test.

By the way: This document contains everything — tests, texts and results. If you plan to take these tests thoroughly — and not just read it to get the conclusions etc, then I have a dedicated page with just tests, so you avoid all text. Also, if you would like a score paper, to register your findings, then you can go to the empty results page.

Tests without the title attribute
#attribute combinationA: Default testsB: Bogus src testsC: CSS repair tests
1alt=∅Test 1 A begins. Test 1 A is over. Test 1 B begins. Test 1 B is over. Test 1 C begins. Test 1 C is over.
2alt=∅   role=imgTest 2 A begins. Test 2 A is over. Test 2 B begins. Test 2 B is over. Test 2 C begins. Test 2 C is over.
3no alt & no roleTest 3 A begins. Test 3 A is over. Test 3 B begins. Test 3 B is over. Test 3 C begins. Test 3 C is over.
4          role=imgTest 4 A begins. Test 4 A is over. Test 4 B begins. Test 4 B is over. Test 4 C begins. Test 4 C is over.
5alt=text role=img Test 5 A begins. An alternative is key! Test 5 A is over. Test 5 B begins. An alternative is key! Test 5 B is over. Test 5 C begins. An alternative is key! Test 5 C is over.
6alt=text Test 6 A begins. An alternative is key! Test 6 A is over. Test 6 B begins. An alternative is key! Test 6 B is over. Test 6 C begins. An alternative is key! Test 6 C is over.
Tests with the title attribute
#attribute combinationA: Default testsB: Bogus src testsC: CSS repair tests
1alt=∅Test 1 A begins. Test 1 A is over. Test 1 B begins. Test 1 B is over. Test 1 C begins. Test 1 C is over.
2alt=∅   role=imgTest 2 A begins. Test 2 A is over. Test 2 B begins. Test 2 B is over. Test 2 C begins. Test 2 C is over.
3no alt & no roleTest 3 A begins. Test 3 A is over. Test 3 B begins. Test 3 B is over. Test 3 C begins. Test 3 C is over.
4          role=imgTest 4 A begins. Test 4 A is over. Test 4 B begins. Test 4 B is over. Test 4 C begins. Test 4 C is over.
5alt=text role=img Test 5 A begins. An alternative is key! Test 5 A is over. Test 5 B begins. An alternative is key! Test 5 B is over. Test 5 C begins. An alternative is key! Test 5 C is over.
6alt=text Test 6 A begins. An alternative is key! Test 6 A is over. Test 6 B begins. An alternative is key! Test 6 B is over. Test 6 C begins. An alternative is key! Test 6 C is over.

Results

Results are given in words, in screenshot and soundclips and finally in two big tables which uses the classification descibed below.

Results in words

The purpose of these tests was to collect data with regard to
what AT/UAs do when there is no alt
whether the title attribute is used — or affects the interpretation — when there is no alt
whether presence of role=img affects the handling of the img element
alternative text repair with CSS generated content (Opera, Safari, Chrome)
The following was not tested
HTML5’s aria-* prefixed attributes and how they interact with these tests, were not looked at
HTML5’s role="presentation" was not tested
HTML5’s img without alt inside figure element was not tested
White space as the value of the alt attribute was not tested
The tests might be extended with those tests later on.
Classification of the results (i.e. of the UA/ATs’ behaviors)
[empty]: No default notification about the image
(dummy): Short announcement — “image”, “graphic”, aurally or visually, about the presence of an image. The “image did not load” icons also fits in here.
(filename): Content of src attribute presented as alternative text.
(title): Content of title attribute presented as alternative text
[alt]: Content of alt attribute presented as alternative text
 graphic: Graphical user agent displays the original image.
 ÷ (Not crucial!) When added to (filename), (title) or [alt], then the ÷ signifies that alternative text presentaion is not accompanied with any short “image”/“graphic” announcment (similar to the dummy, see above)
Key findings
Text browsers tend to always issue some kind of image notification. Exception: Lynx respect the empty string of the alt attribute.
GUI browsers when the graphic of an img with an empty alt is lacking: Some (Firefox/Opera) fall back to the empty string . Others (Safari/Chrome/IE) display an icon to indicate that the graphic is lacking.
When there is no alt: Opera generates alt repair which says “image”. Firefox “disappears” the image. Safari/Chrome/IE display a dummy icon. Screenreaders tend to treat it like the empty string.
alt="non-empty" is treated as expected. (Note: the effect of role=presentation not tested)
When alt is empty, then role="img" does not affect the interpretation. Exception: VoiceOver+Safari.
The title attribute has good support as a fallback for when there is no alt. Exception: VoiceOver+Safari 6 went for the file name instead – seems like a general problem.
The no alt images are most often treated as a presentational images. Common exception: But when the image as well has a non-empty title attribute, then the image is recognized and the title is used as alternative text – this is the common trend.
Surprises
When I started this work, I was under heavy influence of VoiceOver ...

Results in screenshots and soundclips

This section contains screenshots of browsers taking the above tests — as well as recordings of screenreaders taking the above tests.

Screenshots of Web browsers

— To be added —

Results in tables

The results in words are based on the findings in these tables. The first table does not include the title attribute. The second table includes the title attribute on every image.

Result tableimg elements without title attribute
# attribute combination A: Default tests B: Bogus src tests C: CSS repair tests
1 alt=∅
[empty]
NVDA/FF14/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
(dummy):
Elinks
W3m
Netrik
(filename):
Links
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Firefox 14
Opera 12
(dummy):
Elinks
W3m
Netrik
IE8/9/10
Safari 6
Chrome 21
(filename):
Links
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Firefox 14
Opera 12
Safari 6
Chrome 21
(dummy):
Elinks
W3m
Netrik
IE8/9/10
(filename):
Links
2 alt=∅ role=img
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
Lynx
(dummy):
VO/Safari5/10.5
Elinks
W3m
Netrik
(filename):
VO/Safari6/10.7
Links
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
Lynx
Firefox 14
Opera 12
(dummy):
VO/Safari5/10.5
Elinks
W3M
Netrik
IE8/9/10
Safari 6
Chrome 21
(filename):
VO/Safari6/10.7
Links
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
Lynx
Firefox 14
(dummy):
VO/Safari5/10.5
Elinks
W3M
Netrik
IE8/9/10
(filename):
VO/Safari6/10.7
Links
Opera 12
Safari 6
Chrome 21
3 no alt & no role
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
VO/FFnightly
(dummy):
ChromeVox/OSX
VO/Safari5/10.5
Elinks
W3M
Netrik
(filename):
VO/Safari6/10.7
Lynx
Links
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
VO/FFnightly
VO/Safari5/10.5
Firefox 14
(dummy):
ChromeVox/OSX
VO/Safari6/10.7
Elinks
W3M
Netrik
IE8/9/10
Opera 12
Safari 6
Chrome 21
(filename):
VO/Safari6/10.7
Lynx
Links
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
VO/FFnightly
Firefox 14
(dummy):
ChromeVox/OSX
Elinks
W3M
Netrik
(filename):
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Links
Opera 12
Safari 6
Chrome 21
4 role=img
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
VO/FFnightly
(dummy):
ChromeVox/OSX
VO/Safari5/10.5
Elinks
W3M
Netrik
(filename):
VO/Safari6/10.7
Lynx
Links
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
VO/FFnightly
Firefox 14
(dummy):
ChromeVox/OSX
VO/Safari5/10.5
Elinks
W3M
Netrik
IE8/9/10
Opera 12
Safari 6
Chrome 21
(filename):
VO/Safari6/10.7
Lynx
Links
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
VO/FFnightly
Firefox 14
(dummy):
ChromeVox/OSX
VO/Safari5/10.5
Elinks
W3M
Netrik
(filename):
VO/Safari6/10.7
Links
Opera 12
Safari 6
Chrome 21
5 alt=text role=img
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
6 alt=text
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
Result tableimg elements with title attribute
# attribute combination A: Default tests B: Bogus src tests C: CSS repair tests
1 alt=∅
[empty]
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
(title)
NVDA/FF/Win7
VO/FFnightly
(dummy):
Elinks
W3M
Netrik
(filename):
Links
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Firefox 14
Opera 12
(title)
VO/FFnightly
(dummy):
Elinks
W3M
Netrik
IE8/9/10
Safari 6
Chrome 21
(filename):
Links
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
Lynx
Firefox 14
(title)
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Opera 12
Safari 6
Chrome 21
(dummy):
Elinks
W3M
Netrik
IE8/9/10
(filename):
Links
2 alt=∅ role=img
[empty]
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
Lynx
(title)
NVDA/FF/Win7
VO/Safari5/10.5
(dummy):
Elinks
W3M
Netrik
(filename):
VO/Safari6/10.7
Links
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
Lynx
Firefox 14
Opera 12
(title)
VO/FFnightly
VO/Safari5/10.5
(dummy):
Elinks
W3M
Netrik
IE8/9/10
Safari 6
Chrome 21
(filename):
VO/Safari6/10.7
Links
[empty]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
Lynx
Firefox 14
(title)
VO/FFnightly
VO/Safari5/10.5
Opera 12
Safari 6
Chrome 21
(dummy):
Elinks
W3M
Netrik
IE8/9/10
(filename):
VO/Safari6/10.7
Links
3 no alt & no role
(title)
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari5/10.5
Lynx
Links
(dummy):
W3M
Netrik
(filename) – src
VO/Safari6/10.7
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
Jaws13/FF/W7
VO/Safari6/10.7
VO/Safari5/10.5
Firefox 14
(title)
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
VO/FFnightly
Lynx
Links
Safari 6
Chrome 21
(dummy):
W3M
Netrik
IE8/9/10
Opera 12
[empty]
NVDA/FF/Win7
Jaws13/FF/W7
Firefox 14
(title)
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Links
Opera 12
Safari 6
Chrome 21
(dummy):
W3M
Netrik
IE8/9/10
4 role=img
(title)
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari5/10.5
Lynx
Elinks
Links
(filename):
VO/Safari6/10.7
(dummy):
W3M
Netrik
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[empty]
NVDA/FF/Win7
Jaws13/FF/W7
Firefox 14
(title)
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari5/10.5
Lynx
Elinks
Links
Safari 6
Chrome 21
(filename):
VO/Safari6/10.7
(dummy):
W3M
Netrik
IE8/9/10
Opera 12
[empty]
NVDA/FF/Win7
Jaws13/FF/W7
Firefox 14
(title)
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari5/10.5
Lynx
Elinks
Links
Opera 12
Safari 6
Chrome 21
(filename):
VO/Safari6/10.7
(dummy):
W3M
Netrik
IE8/9/10
5 alt=text role=img
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6 ÷
Chrome 21 ÷
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6 ÷
Chrome 21 ÷
6 alt=text
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
graphic
IE8/9/10
Firefox 14
Opera 12
Safari 6
Chrome 21
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6 ÷
Chrome 21 ÷
[alt]
NVDA/FF/Win7
NVDA/IE9/Win7
Jaws13/FF/XP
Jaws13/IE8/XP
Jaws13/IE9/W7
Jaws13/FF/W7
ChromeVox/OSX
VO/FFnightly
VO/Safari6/10.7
VO/Safari5/10.5
Lynx
Elinks
Links
W3M
Netrik
IE8/9/10
Firefox 14
Opera 12
Safari 6 ÷
Chrome 21 ÷