AIR Judging Criteria

These are the items that the judges use to evaluate sites for the AIR competitions.

Core Accessibility Items

These are items that are found on virtually all web sites and most web pages. These items apply to sites in the Formula One and Stock Car categories. Scoring is a maximum of 10 points per item.

Images and Animations

Criteria

Use the alt attribute to provide text equivalents for visuals. Use alt="" for images that do not convey important information or convey redundant information.

Judging Instructions

Judge by image instance - each <img> or input of type image without appropriate alt-text is an error. Alt for image map areas - Accessible Technologies

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Hypertext Links

Criteria

Use descriptive link text, not just "click here" to ensure that each link makes sense when it is read out of context. Make sure that links with same text on the same page go to same place.

Judging Instructions

Judge by anchor instance - each <a> without appropriate on-screen text is an error. Bad alt-text on an image link only counts as one error and may be deducted in either the Images and Animations Item or the Hypertext Link section but not both.

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Correct Markup

Criteria

Use structural markup to properly represent the structure of the document and not simply to achieve particular visual effects.

Judging Instructions

Judge by instance. Improper use of structure tag or lack of structure tag is an error.

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Skip to Main Content

Criteria

Where appropriate, provide methods for skipping over navigation links (or skip to content) to get to main content of page. If navigation area follows main content in natural reading order, provide skip to navigation.

Judging Instructions

If fewer than 5 links precede main content then site passes and full points should be awarded.

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Relative units

Criteria

Where possible use relative rather than absolute units in markup language attribute values (table width) and style sheet property values (font-size, line-height, etc.).

Judging Instructions

Judge by page, scale fonts, scale window size, check for text re-flow.

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Cascading Style Sheets

Criteria

Control presentation with style sheets (CSS) rather than presentation elements and attributes, but do not make Web page readability dependent on style sheets. Hint: If you use a strict DTD and validate your site, these errors will be caught.

Judging Instructions

If CSS, but local presentation markup (FONT, BGCOLOR, etc.) is used, then score as 0. The page must be readable with style sheets turned off.

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Color & Contrast

Criteria

Ensure that all information conveyed with color is also conveyed in the absence of color and that the contrast is sufficient in images.

Judging Instructions

Judge by image instance for contrast. If information is conveyed by color alone, 0 points.

Points Awarded

0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Accessible Technologies

Some but not all of these items will be found on most websites but most items will not be found on every page in most websites. These items are judged as a primary item for Formula One websites and as a bonus item for Stock Car websites Please note the scoring differences between Formula 1 and Stock Car We recommend that sites including three or more of these items compete in the Formula One category while sites including less than three of these items compete in the Stock Car category

Forms

Criteria

Associate labels with form elements. Hint: use Label, Title, Fieldset/Legend and Optgroup as appropriate.

Judging Instructions

Judge by form control instance. No programmatic labeling is an error. No points awarded for Formula One sites if "Search" is the only form.

Formula One Points Awarded

Points for attempt = 7
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Image Maps

Criteria

Use client-side image maps with proper alt-text for associated areas (hot spots). If you use server-side maps, provide equivalent text links.

Judging Instructions

Each <area ...> without appropriate "alt" text is an error. Server-side map without text equivalents scores 0. Not applicable if no image maps.

Formula One Points Awarded

Points for attempt = 4
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Data Tables

Criteria

For tabular data, use the CAPTION element and/or the summary attribute. Use the TH element with the SCOPE attribute for all row and column header cells. For tables with complex row and column headers, use ID's on header cells and the HEADERS attribute on data cells.

Judging Instructions

Judge by tabular data table instance, error for no caption, no summary, no TH, no headers-tables with 2 or more header levels. Not applicable if no data tables.

Formula One Points Awarded

Points for attempt = 3
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Graphs, charts, maps, other complex images

Criteria

A summary of each graph or chart should appear on the same page or be included as a link, LONGDESC attribute, or d-link.

Judging Instructions

Judge by image instance-each <img ...> without Longdesc or "d" is an error. Not Applicable if no graphs or charts.

Formula One Points Awarded

Points for attempt = 3
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Multimedia (Audio, Video)

Criteria

For video with soundtrack, provide synchronized captions; include synchronized audio descriptions if soundtrack alone is not sufficient to understand video. Provide transcripts for audio-only files and descriptions for video without sound.

Judging Instructions

Transcripts and descriptions must be in HTML format to receive points. Each instance of inadequate accommodation is an error. Not applicable if no multimedia.

Formula One Points Awarded

Points for attempt = 10
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Client Side Scripts

Criteria

Provide content for scripts which is keyboard accessible. If the content is not accessible, provide an alternative.

Judging Instructions

Judge by script instance, no keyboard alternative or text content is an error. Not applicable if no scripts.

Formula One Points Awarded

Points for attempt = 5
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Frames

Criteria

Provide meaningful title attributes for each FRAME element and give each frame page a meaningful title (attribute).

Judging Instructions

Judge by frame instance -each frame without appropriate name and title is an error. Not applicable if no frames.

Formula One Points Awarded

Points for attempt = 0
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Applets and Plug-ins (Like Flash, Java Applets)

Criteria

Provide alternate content for applets or plug-ins which are not accessible.

Judging Instructions

Judge by instance. No link for plug-in, plug-in download page or plug-in inaccessible, no alternative content is an error. Not applicable if no applets or plug-ins.

Formula One Points Awarded

Points for attempt = 8
0 Errors = 10 points
1 Error Occurrence = 5 points
2 Error Occurrences = 1 point
3 or More Error Occurrences = 0 points

Stock Car Points Awarded

0 Errors = 3 points
1 or More Errors = 0 points
Points for attempt = 0

Things To Avoid

These are items that detract from accessibility and usability of websites.

Blinking, Moving or Flickering Content

Criteria

Avoid causing content to blink, flicker, or move.

Judging Instructions

Animations should automatically stop after a very short period of time or a simple and obvious method to disable the animation must be provided. There should be no blinking or flickering content.

Points Awarded

0 Errors = 5 Points
1 or More Errors = 0 points

Pop-ups and New Browser Windows

Criteria

Do not use advertising-style pop-up windows that load automatically. When it is necessary to display information in a new browser window, inform the user in advance and provide a method for closing and resizing the new window.

Judging Instructions

Any advertising-style pop-up window is 0 points. Any page where information is displayed in a new browser window and advance notice is not provided is 0 points. Any such window without a method for closing or resizing the window is 0 points.

Points Awarded

0 Errors = 5 Points
1 or More Errors = 0 points

Usability

3 points per item, 10 items 30 points total for this section.

Spelling is Correct

Criteria

All words are spelled correctly on all pages.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Graphics load properly.

Criteria

No missing or broken images. All images have HEIGHT and WIDTH attributes to ensure correct positioning of images and text on the page.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

All hyperlinks function correctly.

Criteria

No broken internal or external links on any page.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

The site has a consistent navigation scheme.

Criteria

Navigation is consistent and clearly understandable throughout the site.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Forms

Criteria

In addition to an HTML form, site offers alternative ways of submitting information, like a contact phone number.

Judging Instructions

If no forms or search is only form then 0 points.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

All pages have appropriate titles

Criteria

Page title must provide meaningful information about the content of the page.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

A description of features of the site is provided

Criteria

Provide a site map, and include an explanation of access keys or other accessibility features. The accessibility features must include a link to the Knowbility site to receive these points.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

An accessible search engine is available

Criteria

The search form must be easy to find. Must have <label> or title for points.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Email and/or contact information is provided.

Criteria

Email and contact information must be easy to find.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Update notice

Criteria

Update notice or other means to inform users of the timeliness of content is provided. (This page last updated....) at least on (home page).

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Bonus Section

3 points x 8 questions (+ 10 exemplary bonus) = 34 points available.

Abbreviations and Acronyms

Criteria

Specify the expansion of each abbreviation or acronym in a document where it first occurs.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Identify Language

Criteria

Identify the primary natural language of a document and language changes.

Judging Instructions

If language changes within page but no supporting language markup score 0 points.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

No Layout Tables

Criteria

Create the site without using tables for layout. (Use CSS to control layout.)

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Access Keys

Criteria

Provide keyboard shortcuts (access keys) to important links (including those in client-side image maps), form controls, and groups of form controls. Do not override the functionality of the operating system, the browser, or the assistive technology. Include an obvious method for site users to learn about the access keys.

Judging Instructions

Test for conflicts with Operating System, Browser and Assistive technology. If access keys override functionality score 0 and deduct 5 points.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points
Override functionality = -5 points

Link Markup

Criteria

Include non-link, printable characters (surrounded by spaces) between adjacent links or place links in appropriately marked up lists.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Table Headings

Criteria

When tabular data tables are used, provide abbreviations for header labels for long rows and columns or complex tables.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

XHTML

Criteria

Use XHTML with a strict DTD and validate your pages using the W3C validator.

Judging Instructions

Test homepage and at least three other pages for XHTML validation.

Points Awarded

0 Errors = 3 Points
1 or More Errors = 0 points

Exemplary EFFORT!

Criteria

Clever things that provide for accessibility.

Points Awarded

Up to 10 points at the Judge's Discretion

Judges Discretionary Items

Appropriateness

Criteria

How well does this site reflect the nature of the organization it represents? Consider language, images and graphics, and other content. Is the organization's mission clear? Is the site structured to allow for maintenance and growth?

Judging Instructions

Judges are encouraged to consult with the client Non Profit Organization prior to awarding points in this section.

Points Awarded

Up to 20 points possible. Average site should be 10 points.

Aesthetics

Criteria

How enjoyable, overall, is the experience of using and navigating this site? Is the overall look and feel attractive? Do colors, graphics, backgrounds, icons, fonts, etc., contribute to the ability to easily read and understand the content. Are graphics and text descriptors (including ALT and LONGDESC attributes) meaningful and purposeful? Does the site provide a coherent auditory experience for people using screen readers and talking browsers?

Points Awarded

Up to 20 points possible. Average site should be 10 points.

Judges Adjustment for Inaccessible Content

Criteria

Judges may subtract points beyond giving "no credit" for a checkpoint for grievous use of inaccessible coding or content. Examples: Major use of inaccessible multimedia, objects (Flash, JAVA), navigation.

Judging Instructions

Judge in consultation with 2 other judges is required to document instances, state reasons for points deducted, and determine appropriate deduction.

Points Deducted

Unlimited.