Dynamic keyboard generation

Dynamic Keyboard Generation for Single Switch Users

Aramys Miranda [email protected] http://accessibility.yahoo.com

Who’s that guy?OMG a prototyper!Tackling design, user interface and

interaction problemsPresent speedy implementations of ideas Prove a concept, design or interaction

before applying full production resources to a project

Provide functional code which is a direct representation of a concept, design or interaction for decision making

Dynamic Keyboard Generation for Single Switch UsersAramys Miranda [email protected]

http://accessibility.yahoo.com

Accessibility at Yahoo!



Victor Tsaran

Alan Brightman

On-screen Keyboards What are They Good For?

Representation of traditional keyboard input device

Provide additional controls normally provided by a mouse

Provide shortcuts to applications, keystroke combinations and input gestures

Empower users with limited mobility



On-screen Keyboards in the World Wild Web

One size fits allContent and context agnosticMany keystrokes required to access

links and other elements on the pageTargeting small elements with mouse

emulation is difficultTabbing through elements is slowNot the way the web was meant to be

navigated◦No hover◦No clickDynamic Keyboard Generation for Single Switch Users








What’s the problem?One size doesn’t fit allUsing a keyboard as a mouseKeyboards are for typingInput is the priority not consumptionContent and context are ignored

unless explicitly accounted for by the user

Indirect manipulation of dataNo standard cross-platform solutionCost can be a factor



Web Semantics to the RescueHTML5 elements have meaning

◦ <nav>◦ <article>◦ <section>

Aria roles and tabindex◦ <a href=“#” role=“button”>Button</a>◦ <a href=“#” tabindex=“1”>Home</a>

Context can be derived and applied to content

Markup is never guaranteed to be valid, semantic or in line with best practices



kinda

Real World Applications



Real World Applications



Leveraging SemanticsUse markup to derive context where

possibleIncrease productivity by directly

manipulating elementsRemove the middlemen

◦Keyboard◦Mouse

Create a keyboard which is aware of context

Apply known context to selected contentDynamic Keyboard Generation for Single Switch Users


Live Demo Time!



Let’s hope pray this works!

Looking ForwardThe average

American spends more than 60 hours a month online. This is the equivalent of 30 straight days a year.



Looking ForwardWeb applications in direct

competition with desktop applications◦Yahoo! Mail◦Google Docs◦Facebook◦Twitter◦Mint.com

Cloud based services◦Dropbox



Looking ForwardWeb technology based operating

systems◦JavaScript, HTML5 and CSS3 based

application framework



Dynamic Keyboard Generation for Single

Switch Users

Resources

Yahoo! Accessibilityhttp://

accessibility.yahoo.com

Switch XShttp://

www.assistiveware.com

YUI3http://

developer.yahoo.com/yui/3/


Special Thanks

Victor [email protected]

Alan [email protected]

Nate Ebrahimoonnebrahim@yahoo-

inc.com

Aramys [email protected]

Technology

Dynamic keyboard generation