If you can't read please download the document
Upload
dissemination-cloud4all
View
991
Download
4
Embed Size (px)
Citation preview
The General Public Inclusive Infrastructure (GPII) for
Auto-Personalisation of Accessibility
Christophe Strobbe (HdM)Javier Hernndez (Emergya)
GPII Goals (1)
Enable accessibility by:adapting software to fit the user's needs
operating system settings: Windows, Linux GNOME, Android
assistive technology (AT) settings: Orca, on-screen keyboard,
browsers and web applications: Firefox,
third-party apps, e.g. Mobile Accessibility for Android (Code Factory)
GPII Goals (2)
Delivering AT that fits the user's needs
Finding alternative versions of content
e.g. captioned versions of video
Adapting embedded systems
ticketing machines, TV
Orca logoAccessibility logoNVDA logo
GPII = Infrastructure
"Global Public Inclusive Infrastructure"We don't build new AT
AT and other softwaregets adapted to connect to GPII
can then adapt to the user's settings
We build the framework to enable this
Contributing Projects
Led by Raising the Floor InternationalStarted by Prof. Gregg Vanderheiden
Cloud4all: EU-funded project, Nov 2011 Oct 2015
24 partners, including Trace Center (Wisconsin, US) & IDRC (Toronto, Ca)
Fluid & FLOE (Canada)
Research to Reality (US)
Preferences for Global Access (US DoE)
Major Components of GPII
Will something help me? What?
Getting access automatically, anywhere, on
any device
Tools to make it easier, lower-cost to create & market new solutions
User Awareness
Needs & PrefsDiscovery Aid
GPII Unified Listing& Marketplace
Prefs & PermServer
Real TimeMatching
DevelopersSpace
Users find out something existsfor them.
Users can find out
which types of
things help them
Find all solutions, AT
& Mainstreamdevice / feature / service
User needs & prefs stored securely andavailable anywhere
Prefs and context used to determine best fit; here, now.
User can call up any assistance anywhere
Free & commercialparts to speed dev,and lower costs
Consumers & ExpertsConnection
Experts, consumers,
testers etc to help
new developers
Delivery/Launch Management
Built-in + AT are auto-adjusted andlaunched, anywhere
ShoppingAid
Users can use their
profile to find just
what helps them
Micro-FinanceMicro-PaymentInfrastructure
Mechanism for Financing R&D and Service Del
GPII Unified Listing & Marketplace
Developers can
quickly, efficiently
market worldwide
ServiceCreation Tools
To make it easy to
Create AOD, Media,& Material service
Needs & Prefs Storage
Users can store
needs & preferences
info for later use
Assistance on Demand (AOD)
Media & Materials
Auto- augmentationtransformation and/or replacement
Cloud4all
US Dept of Ed
Updated by kasper: Jan 12, 2012
Will something help me? What?
User Awareness - Users find out something exists for them.
Needs & Preference Identification Tool (NAPIT) Wizard - users can find out which types of things help them.
Needs & Preference Profile - Users can store need and preference info for later use.
GPII Unified Listing and Marketplace (Master list and Basic list) - find all existing solutions, at once, commercial and free.
Shopping Aide (matching done before purchase of AT/mainstream prod) - Users can use profile to find just what helps them.
Getting access automatically, anywhere, on any device.
Preference and Permission Server - Securely stored and available anywhere
Real Time Matching (includes preference transformations) Preferences, permissions and context used to determine best fit
Delivery/Launch Management (anywhere/any time/any device) (and user real-time micro adjust) - built in + AT are auto adjusted and delivered anywhere
Media & Mtls (Augmentation/Transformation/Replacement) Automatic media augmentation, transformation and replacement
Assistance on Demand (commercial and volunteer) - User can call any assistance anywhere.
Tools to make it easier, lower-cost, to create and market new solutions.
Developers Space (parts, tools, bases, resources) Free & commercial parts to speed dev. and lower costs
Rich Expertise Resource for developers (Consumers, Experts, and materials) - Experts, consumers, testers etc to help new developers
Assistance on Demand Service Infrastructure - Infrastructure to make it easy to provide AOD service.
GPII Unified Listing & Marketplace - Developers can quickly, efficiently, market worldwide.
Demo: Transfer Adaptations
A set of preferences is created on Linux
User moves to Windows
Preferences are used to adapt Windows
Sammy (magnification & inverted colours):http://localhost:8081/user/sammy/login
http://localhost:8081/user/sammy/logout
Mikel Vargas (on-screen keyboard)http://localhost:8081/user/MikelVargas/login
http://localhost:8081/user/MikelVargas/logout
Demo: Android
Using Anode: Android port of Node.js
Customising settings is harder
Requires rooted phone!
Currently only:Settings system API, e.g. font size
Launch applications, Talkback screenreader
Good NFC support for logging in & out
Sensors for context-based adaptation
Architecture
Architecture diagram: The Flow Manager in the middle controls the flow between the following components: the User Listener, the Preferences Server, the Device Reporter, the Matchmaker (which consults the Solutions Registry) and the Lifecycle Manager, which uses the Lifecycle Handlers and the Settings Handlers.
User Listeners
user presents a "key"
using a USB drive
using an NFC tag
typing a special string on the keyboard
...
User Listener detects the key and sends it to the Flow Manager
NFC logoUSB keyQR code for mobile version of Wikipedia
Preferences
Flow Manager fetches preferences from Preference Server
Format = JSON
{ "http://registry.gpii.net/common/language": [ { "value": "fr-ca" } ], "http://registry.gpii.net/common/speechRate": [ { "value": 100 } ], "http://registry.gpii.net/common/repeatKeysRepeatRate": [ { "value": 0.5 } ], "http://registry.gpii.net/comon/repeatKeysAutomaticDelay": [ { "value": true } ]}
Device & Context Information
The device tells the Flow Manager
what operating system it is running
what assistive technologies are available
"context information" (ambient light, ambient noise)-> automatically adapt contrast depending on light
-> automatically increase sound or switch on captions depending on noise
early work on Android
Matchmaker & Solutions Registry
Flow Manager sends preferences and device info to the Matchmaker
Matchmaker infers settings for "new" OS or software
Matchmaker consults Solutions Registry for info on assistive technologies etc.
Launching and Stopping Solutions
Flow Manager sends settings to Lifecycle Manager
Snapshot of current settings
Set each application's settings
Launch application(s)
When user "logs out", restore original settings
More Info?
Project: www.cloud4all.info
GPII & contributing projects: www.gpii.net
Screenshot of the Cloud4all website
See Our Work?
Wiki: http://wiki.gpii.net/
Screenshot of the GPII wiki showing the page with installation instructions for the real-time framework
Want to Contribute?
Fork our code: http://github.com/GPII
Screenshot of the GPII repository on GitHub.com
Click to edit the title text format