ETSI HF STF 286 Access symbols for use with video content and ICT devices

ETSI STF 286 - Design & Testing 1

ETSI HF STF 286 Access symbols for use with

video content and ICT devices

Symbol design & testingRichard Hodgkinson, TecAccess.net

http://portal.etsi.org/stfs/hf/STF286.asp


What is ETSI?

European Telecommunications Standards Institute One of three recognised European standards

development organisations CEN/ISSS – European Committee for

Standardisation/Information Society Standardisation System CENELEC – European Committee for Electrotechnical

standardisation

Funded by member organisations (e.g. BT, Siemens, IBM, HP, etc) and the EU.

Produces Standards, Technical Reports, etc that address Information & Communication Technologies

ETSI standards are free and available electronically from www.etsi.org



Why ETSI HF STF 286?

Supports the “eEurope 2005 Action Plan” to achieve an “Information Society for All”, and provide everyone the opportunity to participate in the global information society.

Access services: Overcome cultural and social differences, Renders content in alternative formats, Provides access to all.

Team members: Wally Mellors – Team leader (ANEC), Richard Hodgkinson (TecAccess), Clive Miller (ANEC).



What is ETSI HF STF 286?

ETSI Standard (ES) 202 432, addresses five access symbols/icons for use with video content and ICT devices: Subtitling: Superimposed text transcript of spoken dialogue. Audio description: Additional audio dialogue describing

significant visual content. Signing: Sign language used for conveying significant

audible content. Speech output: Communication from the device using

spoken language. Spoken command: Ability of the device to accept spoken

commands for the user.

ETSI Technical Report (TR) HF 00094 describes the development and evaluation of the symbols.


What is ETSI HF STF 286?

Access symbols can be used for: Identifying buttons on hardware controls, Way-finding signs in cinemas and theatres, Packaging of DVDs and Videotapes (printed and tactile), Printed media, e.g. TV magazines, newspapers, Interactive media, e.g. TV and computer displays

(icons).

Investigating tactile and auditory versions of a subset of symbols.

Submission of final symbols for ISO adoption and registration.

Final Standard and Report will be published electronically in early 2007, and will provide symbols in .pdf, .gif and .ico formats.


First, collect your symbols…

Search for existing symbols…


Then, collect some more symbols…

Search for existing

symbols…


Then more symbols…

Brainstorm new symbols…


Then even more symbols…

Commission new symbols…


Collected symbols




Symbol testing - ISO 9186

ISO 9186:2001 – Test methods for judged comprehensibility and for comprehension.

Judged Comprehensibility “What percentage of the population expected to understand

the meaning of the symbol?” Where results are inconclusive, perform the comprehension

test: “What do you think this symbol means?” and judge the results.

Comprehension responses:1. Correct understanding is certain,

2. Correct understanding is very probable,

3. Correct understanding is probable,

4. Understanding is opposite of what is intended,

5. Any other response,

6. Response is “I don’t know”,

7. No response given.


Judged comprehensibility


Comprehension test

You may see this symbol in association with a telephone.

What do you think this symbol means? Make louder

If you cannot guess the meaning, please answer "Don't know".

Do not worry if you give the same answer to more than one symbol.


Symbol testing – ETSI TR 0070

ETSI TR 0070 – The Multiple Index Approach (MIA) for the evaluation of pictograms1. The hit rate: Number of correct associations between the

referent and pictogram,

2. The false alarm rate: Number of associations with the wrong referent.

3. Missing values: No answer.

4. Subjective certainty: Certainty of association between pictogram and referent.

5. Subjective suitability: Impression of how well a pictogram represents its referent.

6. Pictogram preference: Which of the pictograms for a referent represents best the referent in question.

7. Pictogram set preference: Which set is preferred on aesthetic grounds.


Symbol testing

Web Site 1 created for initial filtering by ETSI Human Factors Committee members to reduce candidate symbols to 6 for each function.

Web Site 2 created for testing: Test to ISO 9186 - both Comprehension and

Comprehensibility...respondents see only one test, Symbol order changed with each test, Available in French, German, Italian, Spanish, Italian

and Greek. ETSI 0070 MIA data extracted from ISO 9186

Comprehension test results; 1, 2 & 3 (Correct understanding) provided hit rate, 4 & 5 (Opposite or Other) provided false alarm rate, 6 & 7 (No response) provided missing values, 1, 2 & 3 provided subjective certainty, Pictogram set preference not addressed.


Test results to date

Test circulated to “Stakeholder” list of over 80 individuals, disability and user organisations.

1999 accesses to the Web site. 964 tests completed from 30 countries. Cultural groups (completed tests):

UK & Ireland (183), Scandinavia (282), Southern Europe (148), Central Europe (115), Mediterranean (51), Eastern Europe (5), Plus USA, Japan, Australia, UAE, Canada, Argentina,

Azerbaijan, Greenland, Philippines, etc. Data also collected on respondents ages, education,

occupations, disabilities and time taken.


Candidate symbols - 1


Candidate symbols - 2


Comprehensibility results - Judging


Comprehensibility results - Judging


Comprehensibility results – “Balancing”


Successful symbols


Test analysis - 1


Test analysis - 2


Symbol testing problems

Inability to control the display resolution. Inability to select and control respondents. Respondents biased by age and education.

More results sought from: Central Europe (Austria, Belgium, Germany,

Luxembourg, Netherlands & Switzerland). Eastern Europe (so far only Bulgaria, Czech Republic,

Estonia & Poland) Mediterranean countries (so far France, Greece, Italy,

Cyprus)


ISO Registration

Symbols tested in accordance with ISO 9186:2001 -Graphical symbols – Test methods for judged comprehensibility and for comprehension.

Symbols drafted in accordance with IEC 80416-1:2001 – Basic principles for graphical symbols for use on equipment – Creation of symbol originals Provides layout grid and design rules, Provides process for assessment by ISO TC 145 –

Graphical Symbols and IEC SC3C – Graphical symbols for use on equipment,

Final symbols included on ISO 7000/IEC 60417 database.

NOTE: ISO 80416-4:2005 provides “Guidelines for the adaptation of graphical symbols for use on screens and displays”.


Other modalities being investigated

Tactile symbols: Designed by the RNIB National Centre for Tactile

Diagrams (NCTD). Symbols for:

• Audio description,

• Speech output,

• Spoken command.

Testing at “Sight Village” in July Audio symbols:

Symbols for;

• Audio description,

• Speech output,

• Spoken command.


Documents

ETSI HF STF 286 Access symbols for use with video content and ICT devices