Cloud platforms Lead to Open and Universal access for people with Disabilities and for All

www.cloud4all.info

Cloud4all Technical OverviewGregg Vanderheiden Ph.D.

Raising the Floor – International

1. To test the concept of Auto-Personalization from Preferences• Does it work – for users – and across technologies• Can it be built in a scalable fashion

2. To build the first draft of essential GPII components• The Overall Architecture and run time components• The Semantic components (Ontologies, et al)• The Basic Data Sets required ( Registries and Databases ) • The Data Maintenance and User Tools• The Standards

3. To create demonstration/test implementations• Across technologies (Windows, Linux, Android etc)• Across Application domains (PCs, Mobile, Web, Closed, Appliances, etc)

2Cloud4all Objectives

Will something help me? What?

Getting access automatically, anywhere, onany device

Tools to make it easier, lower-cost to create & market new solutions

3

User Awareness

Needs & PrefsDiscovery Aid

GPII Unified Listing& Marketplace

Prefs & PermServer

Real TimeMatching

Developers’Space

Users find out something exists

for them.

Users can find out which types of

things help them

Find all solutions, AT

& Mainstreamdevice / feature / service

User needs & prefs stored securely andavailable anywhere

Prefs and context used to determine best fit; here, now.

User can call up any assistance

anywhere

Free & commercialparts to speed dev,

and lower costs

Consumers & Experts

Connection

Experts, consumers,testers etc to helpnew developers

Delivery/Launch Management

Built-in + AT are auto-adjusted and

launched, anywhere

ShoppingAid

Users can use their profile to find just what helps them

Micro-FinanceMicro-PaymentInfrastructure

Mechanism for Financing R&D and Service Del

GPII Unified Listing & Marketplace

Developers can quickly, efficientlymarket worldwide

ServiceCreation Tools

To make it easy to Create AOD, Media,& Material service

Needs & Prefs Storage

Users can storeneeds & preferences

info for later use

Assistance on Demand (AOD)

Media & Materials

Auto- augmentationtransformation

and/or replacement

Cloud4allUS Dept of Ed

Major Components of GPII

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

Basic Architecture Limited Intelligence

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

N&P Ontology

Solutions Ontology

Adding Context and Semantics Allows

Increased Matchmaking Intelligence

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

A Personal Control Panel Allows users

real time control of

their settings

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Which can also (if the user chooses)

change their stored

preferences for this context

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

The Matchmaker can offer options

to the user – – – –

The user can also make decisions on how it wants the matchmaker to

operate

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Now where did that Solutions Registry come from ?

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

But Cloud4all/GPII will also match users and different Media and Materials

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources

N&P Ontology

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

And we need tools to maintain the metadata (semantics) for all of these.

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

We also need a way to create

(and edit) User Needs &

Preferences Sets

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

And, as is true anytime you want many entities to

communicate effectively – we need

a common vocabulary.

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

Service Synth Tool

Synthesized

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

Service Synth Tool

Synthesized

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

Service Synth Tool

Synthesized

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Management Options

Spinal Matchmaker

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

Service Synth Tool

Synthesized

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Spinal Matchmaker

Management Options

Flow Manager

Solutions

User Listeners

Lifecycle Manager

Lifecycle Handlers

Settings Handlers

Installed

Preferences Server

Device Reporter

(local Solutions registry)

Match Makers

Transformer

Real-time Components Environment Reporter

Legend: User Interfaces Not Cloud4all Funded GPII project but not Cloud4allArrows show general information flow.

Context rules

Network & download

Global Solution Registry

(Unified Listing)(AT + Mainstream)

N&P Ontology

Solutions Ontology

EASTIN+ Federation

(AT only )Global Solution

Registry(Unified Listing)(AT + Mainstream)

Other DBs

Mainstream

AT

GARI Phone DB

(Mainstream)

EASTIN GROUP DBs

Solutions

Federated Search &

Delivery ofMM&R Metadata

Media, Materials & Resources Semantic Tools

Service Synth Tool

Synthesized

N&P Ontology

Other Ontologies

Materials Ontology

Mainstream Data Maintenance

Metadata Auto-Generation Tools

Manual Metadata Generation Tools

AT Data Maintenance

Solutions Ontology

Common Terms Registry

Common Terms

Viewer/Editor

Personal Control Panel(includes Options /Suggestions UI and

ability to launch NP Editor)

Spinal Matchmaker

Management OptionsKind of like a car.

It takes a lot of pieces to make a car simple to operate.

Kind of like a car.

It takes a lot of pieces to make a car simple to operate.