Embed Size (px)
Citation preview
Research MethodologyEvaluation Techniques
Evaluators Evaluation of
Findings
1.Automated Testing
• ACHECHER
• ASTEC
•13 pages • No. of accessibility error
• Level of conformance
2.User Testing
• 8 blind users*
• 8 sighted users
•13 pages•9 tasks
• Rating of difficulty• Time spent on each
task
RESEARCH QUESTION 1Question: What percentage of selected Thailand Cyber
University’s web pages submitted for automated evaluation complied with Web Content Accessibility Guidelines 2.0 for all types of errors?
Finding: None of the selected web pages complied with WCAG 2.0.
Discussion: There were substantial discrepancies between the two automated tools.
Recommendation: To include other types of web accessibility evaluation for more consistent results.
RESEARCH QUESTION 2Question: How did totally blind users rate the degree of
difficulty in accessing selected Thailand Cyber University’s web pages and completing pre-defined tasks?
Finding : The blind users gave different ratings between accessing information and completing a task on the same web page.
Discussion: The ratings of difficulty on usability were found to be higher than accessibility.
Recommendation: To focus on improving usability of the web site.
RESEARCH QUESTION 3Question: What was the correlation between
automated evaluation and blind user evaluation for accessibility of selected Thailand Cyber University’s web pages?
Finding : Only one page found a relationship between the conformance level and the blind users’ rating.
Discussion: The automated tool and the blind user judged the pages based on different criteria.
Recommendation: Require further investigation on this area of the study.
RESEARCH QUESTION 4Question: What was the correlation between blind and sighted
users’ ratings of difficulty when completing pre-defined tasks?
Finding : There was a correlation between ratings from the blind and sighted user groups. On eight out of 22 tasks, both groups agreed on the rating. However, the time that they took to complete each task varied.
Discussion: Blind people access web content in different ways compared to sighted users.
Recommendation: To employ universal design principles to improve usability of a web site.
THANK YOU!QUESTION AND COMMENT
