Upload
aalforum
View
493
Download
0
Embed Size (px)
Citation preview
TrackLab: a solution for indoor and outdoor tracking and movement analysis
Hans Theuws Ben LokeAndrew J. Spink
AAL Forum 2015, Ghent, Belgium, 24 September 2015
TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects
Content
Noldus Information Technology●Developer of innovative software, hardware and integrated solutions for behavioral research●Established in 1989●Headquarters in The Netherlands, 125 employees worldwide●Offices in France, Germany, Spain, Hungary, USA, China●Products used by > 7,000 organizations in 85 countries
Introduction: Company profile
Introduction: Core activities
Product development●Software applications●Hardware instruments and devicesSystem integration●Noldus software and hardware●Computer hardware●Video and multimedia components●Eye trackers and DAQ systems●Integrated behavior research labsServices●Training●Consulting●Measuring Behavior conferences
Introduction: Noldus InnovationWorks
● Research and innovation laboratory of Noldus Information Technology
● Cutting-edge technologies, novel concepts and product prototypes for innovative AAL solutions
● In collaboration with partners in industry and academia
● Innovation Themes:● Automated behavior recognition● Complex event processing and reasoning● Mobile sensing, tracking and user experience
measurement● Integrated systems and solutions
TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects
Content
● End-to end solution for analysis and visualization of spatial behavior
● Interactive: Send out real-time events for integration with other solutions
● Works with any kind of sensor (GPS, RFID, UWB, WiFi, video, etc.)
TrackLab™ Indoor and outdoor movement tracking and analysis
TrackLab: indoor and outdoor tracking
Sensors● GPS in specialized sensors and smartphones● Ultra wide-band (Ubisense)● Network of stereo video sensors (EagleGrid)● Multi-camera video tracking (PeopleTracker)● Tracking data enhanced by accelerometers and
inertial sensorsMaps● OpenStreetMap for outdoor tracks● Calibrated bitmaps for indoor tracksMode● Live or offline
EagleEye
● Stereo camera sensors● Ceiling mounted ● No tags/markers needed● Identification: yes● Re-identification: no● Accuracy: +/- 50cm (depends on conditions)● Trackable area: app 13m2 at 3m camera height● Indoor tracking when wearing tags is not possible
Stereo camera sensors
Ubisense
● Ultra Wide Band● Wall mounted● Unique tag worn by test subject● Identification: yes● Re-identification: yes● Accuracy: 30cm in real life situations● Trackable area: 40x40m with 4 sensors● Indoor/outdoor tracking when using tags is
possible
UWB Sensors and tags
PeopleTracker
● Multiple video cameras● Under development ● No tag needed● Identification: yes● Re-identification: yes● Trackable area: depends on number of cameras● Tracking up to 10 people simultaneously
without markers or tags
Markerless people tracking
TrackLab™
Track multiple persons, inside or outside
TrackLab™
Define regions of interest on your own map
TrackLab™
Tracking with calibrated bitmap
TrackLab™
Track analysis (1)
TrackLab™
Track analysis (2)
TrackLab™
Movement Classification
Behavior detectionWho is doing what and where?
● Movement analysis based on speed (e.g. walking, running) or accelerometer data
● Detect mode of transportation (e.g. train, bus, bike, by foot)
TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects
Content
Application examplesFor Ambient Assisted Living
● Assessing both positive and negative aspects of a person’s location and movement
● Monitor exercise taken by the subject, reports can be used to give feedback to patients and caregiver
● Integration with other software makes it possible to send an alarm signal to caregivers, for instance if an Alzheimer’s patient strays outside of the grounds of where they live
● Detect if a person hasn’t moved for a while, which can trigger an alarm
● Research tool in development of in-store navigation systems
● Navigation assistance● Personalized advice● Driven by tracking and behavior
detection software
Application examplesE-coaching apps for in-store navigation
Application examplesE-coaching apps: pilot study - 1
● Group of older subjects (average age 72) were asked to locate 15 products on a shopping list in a simulated shop
● Tracked with TrackLab software● Input ultra-wideband tracking system from Ubisense● The participants were given instructions for finding
recipe ingredients using 5 different navigational methods:
● No help● Voice guidance● Floor plan● Haptic feedback system● Navigational arrows on a smartphone
Application examplesE-coaching apps: pilot study - 1
● Analysis:● Path distance● Time until reaching food’s location● Meander until reaching food’s location● Time standing still
● Conclusion: ● Map easiest and most efficient manner to navigate● Build on familiar methods when designing new tools
Application examplesE-coaching apps: pilot study - 2
● Group of older subjects (60-80 years) make a shopping list with 8 products using the app
● Use the navigation section to walk to the store● Check home status before leaving● Do the groceries using the path the smartphone shows● Call taxi
Application examplesE-coaching apps: pilot study - 2
● Tracking using foot sensors
Application examplesE-coaching apps: pilot study - 2
● Results:● All participants would use a device if
it helps them● Suggestions by family members,
informal or professional caregivers appear less important
● Concerns: technical difficulty, privacy, safety
● People are willing to pay (€5-25 / month)
TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects
Content
FaceReader®
Automatic analysis of facial expressions
● Detect basic emotion, head orientation, facial gestures● Real-time feedback about emotional state to other applications● Works with standard webcams, smartphones and tablets
Tactile feedbackUsing the Elitac Science Suit
Tactile displays● Vibration electronics integrated in wearable textile● For communication, alarming and conditioning● Wireless connection ● Controlled by TrackLab™
Applications● Navigation support● Real-time warnings● Geo-fencing
Background● Spin-off from University of Twente, Enschede, NL● Specialized in wireless sensor networking with main focus on
motion sensing
Motion sensing● Magnetic, Accelerometer and Gyroscope sensors● Applied in sports, healthcare and industrial sectors● Estimate orientation, velocity and displacement, rate of rotation
Motion sensingFrom Inertia Technology
TrackLab: a solution for indoor and outdoor tracking and movement analysis●Introduction●What is TrackLab?●Applications in AAL●Tools to integrate with●Collaboration projects
Content
AAL Projects
● Outdoor and indoor localization and mobility services for elderly people with sensory and cognitive impairments
● Website: www.emosion-project.eu ● Partners:
● Development of a virtual assistant (avatar) supporting elderly in their daily activities
● Website: www.cameli.eu ● Partners:
AAL Projects
● Workflow technologies for older nurses by supplying real-time context-aware tools for guiding them in their daily tasks
● Website: http://www.letitflow-project.com/● Partners:
AAL Projects
● Real-time response of a virtual assistant (avatar) to the emotional state of an elderly person
● Website: www.miraculous-life.eu ● Partners:
Other collaboration projects
● What tracking techniques are acceptable (accuracy/privacy)?
● Who will invest in large scale implementation?
Discussion
● Questions: [email protected]
● Request a trial: http://www.noldus.com/innovationworks/products/tracklab
More information