29
Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos and John Soldatos Athens Information Technology 19,5 Km Markopoulou Ave. Peania, GR 19002 +30 2106682759 e-mail: {ndim, lcp, jsol}@ait.edu.gr http://www.ait.gr/research/RG1/overview.asp

Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Embed Size (px)

Citation preview

Page 1: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Enhancing Learning Experiences through Context-Aware Collaborative Services: Software

Architecture and Prototype System

Nikolaos Dimakis, Lazaros Polymenakos and John SoldatosAthens Information Technology

19,5 Km Markopoulou Ave.Peania, GR 19002+30 2106682759

e-mail: {ndim, lcp, jsol}@ait.edu.grhttp://www.ait.gr/research/RG1/overview.asp

Page 2: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Introduction

• Introduction / Motivation

• Software Architecture for e-learning– Sensors and Actuators– Context-Acquisition– Service tier

• The `Memory Jog’ Service– Applicable to e-learning

• Evaluation results

Page 3: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Introduction

• Introduction / Motivation

• Software Architecture for e-learning– Sensors and Actuators– Context-Acquisition– Service tier

• The `Memory Jog’ Service– Applicable to e-learning

• Evaluation results

Page 4: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Pervasive-Ubiquitous Computing Vision• Vision:

– Transform physical spaces into computationally active and intelligent environments

– Human-Centric services offered transparently regardless of time and end-users location

• Technology Trends - Enablers:– Broadband/ Wireless Networks – Web Services - Top Layer

Interoperability– PDA’s, Mobile Phones– Cheap Multi-Purpose Sensors– Recognition Algorithms– Adaptivity & User Profiling

Technologies

Page 5: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Main application areas

• Smart house

• Smart office

• Health care - telemedicine

• Ambient assisted living

• Security

• E-learning

Page 6: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Major Challenges

• High Distribution• Context-Awareness• Transparency• Heterogeneity

– Software / Hardware– Sensors, Terminals, Devices

• Mobility• Personalization• Autonomy• Dynamism

Page 7: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

CHIL – Computers in the Human Interaction Loop

• EU FP6 Integrated Project (IP 506909) • Coordinators: Universität Karlsruhe

(TH) Fraunhofer Institute IITB• Duration: 36 months• Total Project costs: Over 24M€• Goal: Create environments in which

computers serve humans who focus on interacting with other humans as opposed to having to attend to and being preoccupied with the machines themselves

• Key Research Areas:– Perceptual Technologies– Human-Centric Pervasive

Services– Software Infrastructure

Page 8: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

… a little more technical

• Introduction / Motivation

• Software Architecture for e-learning– Sensors and Actuators– Context-Acquisition– Service tier

• The `Memory Jog’ Service– Applicable to e-learning

• Evaluation results

Page 9: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Software Architecture

• 3 tier approach– Sensors and Actuators tier

• Cameras, microphones, Targeted Audio, Projectors, Displays, etc.

– Context-Acquisition tier• Body Tracker, Face Identification, Audio Source

Localization, Speech Activity Detection, etc.

– Service tier• JADE Agent Framework.

Page 10: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Context-awareness

• Dey & Abowd (1999)– Context is: “any information that can be used to

characterise the situation of an entity, where an entity can be a person, place, physical or computational object”

• Context-awareness human-centric ubiquitous computing

• “Smart Learning Spaces” a realization of the ubiquitous computing paradigm

Page 11: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Non-obtrusive interaction

• Sensors– Cameras– Microphones– No wearable computers, no RFID tags

Page 12: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Context-Acquisition tier

• a.k.a. Perceptual Components tier.

• Exploits sensor signals to extract elementary context.– Locations of people– Identities of people– Speaker location

• Fusion of PCs Situation Recognition

Page 13: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Examples

Page 14: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Situation Model for a lecture

Page 15: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Service tier

• Following the JADE Framework for distributed agents.

• Each service extends ServiceAgent– Basic functionalities are ensured: Communication,

Message extraction, Database Querying etc.• Situation modeling

– Enables situation recognition, situation model tracking and event notification

• Sensor and actuator control• KnowledgeBase and Database interfacing.• Each user is managed by PersonalAgent

Page 16: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Agent-hierarchy

Page 17: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Knowledge Base

• Directory mechanism, leveraging a knowledge base– “yellow pages” for students, courses, research etc

• Registration repository for existing components

• “Smart queries”– “Which camera faces the door?”

Page 18: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Specialized Middleware

• Glue two conceptually different ends together – IBM’s CHILiX– NIST SmartFlow

• Significantly boost distribution

Page 19: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Architectural snapshot

Page 20: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

… The Memory Jog service

• Introduction / Motivation

• Software Architecture for e-learning– Sensors and Actuators– Context-Acquisition– Service tier

• The `Memory Jog’ Service– Applicable to e-learning

• Evaluation results

Page 21: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

The Memory Jog

• A lecture, meeting support service. It provides:– Pertinent information to participants– Interfacing with Databases for past event querying– Preferred features, such as:

• Agenda tracking

• Intelligent Video Recording

• Handles mobile participants (PDAs)

Page 22: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

The Memory Jog (cont.)

• It exploits:– The whole range of the sensors and actuators– All registered Perceptual Components– Databases for information retrieval and

Knowledgebases for high level reasoning• Both are controlled by specialized agent-members of

the service-tier.

Page 23: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

The Memory Jog (cont..)

• It looks like:

Page 24: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Memory Jog features for e-learning

• The Memory Jog features:– Intelligent Video Recording.– Contextual database search.– Automated notification using Targeted Audio.– Etc.

Page 25: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Intelligent Video Recording

Page 26: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Results

• Introduction / Motivation

• Software Architecture for e-learning– Sensors and Actuators– Context-Acquisition– Service tier

• The `Memory Jog’ Service– Applicable to e-learning

• Evaluation results

Page 27: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

Focus Groups Evaluation

• 25 people participated– Students

– Engineers

– Management Personnel

– Faculty

Feature Approval Percent

Intelligent Recording 100%Agenda tracking 56%What happened while I was away?

72%

Participants Biography 68%Search past events 84%

Page 28: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

AIT’s Smart Learning Space

Page 29: Enhancing Learning Experiences through Context-Aware Collaborative Services: Software Architecture and Prototype System Nikolaos Dimakis, Lazaros Polymenakos

The End

• Questions?