51
Autonomamente: a Autonomamente: a multimodal multimodal Autonomamente: a Autonomamente: a multimodal multimodal domotic domotic application and a social application and a social network to support network to support autonomous living of persons with autonomous living of persons with autonomous living of persons with autonomous living of persons with cognitive cognitive disabilities disabilities Thimoty Barbieri , Piero Fraternali, Antonio Bianchi, Clarissa Tacchella, Assunta Peluso Politecnico di Milano, Polo Regionale di Como Associazione So.La.Re. – Social Lario Rete Associazione C.E.Re.S. Cooperativa Mosaico – Segrate Associazione Primavera onlus - Albavilla With the support of Fondazione Cariplo And of Rotary Club Como Baradello www autonomamenteinrete it www .autonomamenteinrete.it

Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Autonomamente: a Autonomamente: a multimodalmultimodalAutonomamente: a Autonomamente: a multimodalmultimodaldomoticdomotic application and a social application and a social network to supportnetwork to supportautonomous living of persons withautonomous living of persons withautonomous living of persons withautonomous living of persons withcognitive cognitive disabilitiesdisabilitiesggThimoty Barbieri, Piero Fraternali, Antonio Bianchi, Clarissa Tacchella, Assunta Peluso

Politecnico di Milano, Polo Regionale di Como, gAssociazione So.La.Re. – Social Lario ReteAssociazione C.E.Re.S. Cooperativa Mosaico – SegrateAssociazione Primavera onlus - Albavilla

With the support of Fondazione CariploAnd of Rotary Club Como Baradello

www autonomamenteinrete itwww.autonomamenteinrete.it

Page 2: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Project Project GoalsGoalsProject Project GoalsGoals

Support autonomous living of people with Support autonomous living of people with cognitive disabilities using simple software and hardware. Give the software in open source for peverybody to use and / or improve it.U t h l f i l i d t Use technology for inclusion and not seclusionCreate a network between users, parents, caregivers to support use and caregivers to support use and communication

Page 3: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

“Autonomamente”“Autonomamente”AutonomamenteAutonomamente2 years project completed now2 years project completed, nowdissemination and looking for next 2-years stintyears stintBuilt four apartments near caregivinginstitutions with software and domoticinstitutions,with software and domoticappliancesTwo apartments for assisted residency Two apartments for assisted residency, Two dedicated to a “Laboratory ofAutonomy” for end users and theirAutonomy for end users and theirparents

www.autonomamenteinrete.it

Page 4: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

ApartmentsApartments forfor AutonomousAutonomous LivingLivingApartmentsApartments forfor AutonomousAutonomous LivingLiving

www.autonomamenteinrete.it

Page 5: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

ApartmentsApartments forfor AutonomousAutonomous LivingLivingApartmentsApartments forfor AutonomousAutonomous LivingLiving

www.autonomamenteinrete.it

Page 6: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

ApartmentsApartments forfor AutonomousAutonomous LivingLivingApartmentsApartments forfor AutonomousAutonomous LivingLiving

www.autonomamenteinrete.it

Page 7: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

FlatsFlats builtbuilt nearnear caregivingcaregivinginstitutionsinstitutions or or dayday centerscenters

Page 8: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

UsersUsers movemove in or “in or “rolerole play” play” duringduringscheduledscheduled daysdays

Page 9: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

ResidentialityResidentialityResidentialityResidentialityremotelyremotelyyymanagedmanaged bybyparticipatingparticipatinginstitutionsinstitutionsinstitutionsinstitutions ––lookinglooking forfor a a ggscaleablescaleablecaregivingcaregivingmodelmodelmodelmodel

Page 10: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

The SoftwareThe SoftwareThe SoftwareThe Software

With the software you can:With the software you can:◦ Call friends and write/read e-mails◦ Schedule your time and appointments◦ Manage your finances and savings (Am I spending too

h?)much?)◦ Check if your home is safe (Oven? Doorlocks?

Windows?)Windows?)The institution nearby can monitor the flat for ready interventioninterventionIt uses icons, text, speech (Multimodality)It is configurable in real time to the needs and abilities It is configurable in real time to the needs and abilities of the specific user

Page 11: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Can I Can I safelysafely go go toto bedbed? “? “QuietQuietHouse” House” ConfigurableConfigurable RuleRule BasedBasedHouse House –– ConfigurableConfigurable RuleRule BasedBasedSystemSystemyy

OVEN?LIGHTS?LIGHTS?FRONT DOOR?DOOR?WINDOWS?MOVEMENT?MOVEMENT?NOTIFICATIONS

AT NIGHTAT NIGHTDURING THE DAYDAYREMOTELY

Page 12: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

C t fi th i f “ i t” h l t d t ti f th d dCustom configure the meaning of “quiet” house related to time of the day, dayof the week, person profile, available sensors. (By use of Declarative Rules)

Page 13: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

TraditionalTraditional floorplanfloorplan remote remote monitoringmonitoring

Light1

Oven TVD Wi d Oven TVDoor Window

Click to switch on/off

www.autonomamenteinrete.it

(only within trusted VPN)

Page 14: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

CommunicationCommunication, , AppointmentsAppointments, , Money and “Money and “QuietQuiet House”House”

www.autonomamenteinrete.it

Page 15: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Use consistently lateral multimodal reinforcement.

Page 16: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Provide customization of visual-level communications

Page 17: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Provideassisted, ,symbolic or numeric userinput forquantities

Page 18: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 19: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 20: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 21: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Represent face-value quantities in concrete ways.Show relationship between time and money.

Page 22: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Alternative way to show time / money balance.Concrete and accessible assessment.

Page 23: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 24: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 25: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Control the population / sequencing trade-off of the interface;trade attention for short memory and vice-versa

Page 26: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 27: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Provide simultaneous different means ofexpressionexpression

Page 28: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Use Keyboard Editor Tool to create yourtailor-made kb: make keystailor made kb: make keyssmaller/BIGGER, change layout&color, add word or sentence keys

Page 29: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 30: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Change the wayyou want to representtime

Page 31: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 32: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 33: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 34: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Represent abstract concepts (distance in time) in different concrete ways

Page 35: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 36: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Provide an ubiquitousaccess system to allow near-access system to allow nearreal time riconfiguration ofdata, content, options, and interface.interface.

Provide means to make the interface grow with the gspecific user’s confidenceand abilities

Growing abilities = Growinginterface, keep the userchallenged, give a sense oflearning and progress

Page 37: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 38: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 39: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

E t fl ibilitExtreme flexibilityled to complexityat operator/tutor level need to relevel, need to re-engineer / profilescenarios here

Page 40: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 41: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 42: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 43: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 44: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 45: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 46: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 47: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive
Page 48: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

Training: Training: stepstep byby stepstep learnlearn toto do do more and more and more and more and adaptadapt the the more and more and more and more and adaptadapt the the interfaceinterface

www.autonomamenteinrete.it

Page 49: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

EvaluationEvaluation and impact so farand impact so farEvaluationEvaluation and impact so farand impact so farUsers with mild cognitive disabilities (aged 20-60)

4 d h d l fl S M l I l4 persons moved in the two residential flats in Segrate, Milano, Italy

2 groups of 4 persons each for “laboratory of autonomy” in Albavilla, Como, Italy. (formal eval activities under way)Albavilla, Como, Italy. (formal eval activities under way)

Initial interest high - Laboratory sessions livelyNeed of continuous training and support for IT Need of continuous training and support for IT maintenanceResidents privilege phone call applicationp g p ppInstitutions’ interest ‘skewed’ to the domotic partTutor support crucial to keep Residents’ system pp p yupdated with useful information (money, appointments) but so far discontinuousMultimodality offers reinforcements: users learn and improve their skills

Page 50: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

ConclusionsConclusionsConclusionsConclusionsCrucial to combine social aspects withCrucial to combine social aspects withtechnology: build awareness and consenusbetween caregivers, parents and usersI ’ ( ll) b “D i ” ’ bIt’s not (all) about “Domotics”: it’s abouthelping doing everyday stuff – buy things, callpeople, decide how to organize your time, go topeople, decide how to organize your time, go tobed without worryingTechnology mature: Open source model viableFuture: create a service around thisprototype, making it even simpler – makepackages that can be taken personalisedpackages that can be taken, personalisedand used, with the assistance of parentsand/or local institutions

www.autonomamenteinrete.it

Page 51: Autonomamente: a multimodal domoticdomotic application and ...autonomamente.como.polimi.it/images/stories/am_aaate09_ppt.pdf · Evaluation and impact so far yUsers with mild cognitive

GetGet in in touchtouch and help and help improvingimproving::GetGet in in touchtouch and help and help improvingimproving::Progetto AutonomamenteProgetto AutonomamenteggWeb Site (soon software downloadable):

www autonomamenteinrete [email protected]@Direct contact: [email protected]

Or: COME AND VISIT IN ALBAVILLA, COMO, ITALYOr: COME AND VISIT IN ALBAVILLA, COMO, ITALY

Thimoty Barbieri, Antonio Bianchi, Marco Brambilla Paolo Castiglioni, Piero Fraternali, Shu Gong, Virginia Monaco, Daniel Negri, Nadia Parachini, Assunta g g gPeluso, Claudio Rainoldi, Andrea Rapisarda, Matteo Ronchi, Clarissa Tacchella, Luca Tettamanti, Alberto Turinetti, i ragazzi dei centri di Segrate, Albavilla.

www.autonomamenteinrete.it