Embed Size (px)
Citation preview
ART OF NEUROSCIENCE 2015
Live visualization of EEG data
in Virtual Reality
Robin de Lange
Hack the Brain
Universiteit Leiden
www.robindelange.com
Hack the Brain - ProgramPublic debate
• Lectures by Pim Haselager, Victor Lamme and Arnon
Grunberg
Hackathon
• 45 programmers, designers, artists and scientists
• Teams with own projects
• EEG scanners & FabLab facilities
• Researchers from TNO and Donders Institute
Universiteit Leiden
www.robindelange.com
Hack the Brain – Brain Computer
InterfacesA bit skeptical about BCIs
1. Many projects and devices tend to oversell
• Really hard to measure mental events like emotions or
thoughts
2. Many projects that detect electrical activity associated
with moving a part of your body
• Useful for physically disabled people
• For others: why not use the native input and output
modules?Universiteit Leiden
www.robindelange.com
Hack the Brain - Output
Universiteit Leiden
www.robindelange.com
Hack the Brain - Output
Universiteit Leiden
www.robindelange.com
Hack the Brain - Media
Universiteit Leiden
www.robindelange.com
Project Brainstorm
Universiteit Leiden
www.robindelange.com
Project Brainstorm – Technical
realization
Universiteit Leiden
www.robindelange.com
Project Brainstorm – Technical
realization
Universiteit Leiden
www.robindelange.com
Project Brainstorm – Technical
realization
Universiteit Leiden
www.robindelange.com
Project Brainstorm – Technical
realization
Universiteit Leiden
www.robindelange.com
Challenges:
1. Understand the nature of the data and types of
brain waves
2. Transform the data to be interpreted in different
programming environments
Universiteit Leiden
www.robindelange.com
Project Brainstorm – Technical
realization
Project Brainstorm – Technical
realization
Universiteit Leiden
www.robindelange.com
• Matlab + Buffer BCI
• Output: stream of
amplitude of alpha waves
per channel
• In Unity3D read out
amplitudes and link them
to the intensity of the
visual effects
Project Brainstorm – Experience
Universiteit Leiden
www.robindelange.com
DEMO
Project Brainstorm – Further
development
Universiteit Leiden
www.robindelange.com
Project created in three days, by people with little
experience
How to extend this project?
Project Brainstorm – Further
development
Universiteit Leiden
www.robindelange.com
• Potential of immersive data visualization
• EEG data in form that is hard to understand for
humans
• Data visualization makes data easier to understand
• Immersive data visualization uses 3D navigation
skills
Project Brainstorm – Further
development
Universiteit Leiden
www.robindelange.com
Create a complete VR interface for studying EEG
data
• Improve data analysis and visualization
• Selecting different brain waves
• Interaction to optimize visualization
My research
Universiteit Leiden
www.robindelange.com
Exploring how Augmented and Virtual Reality
technologies can help us in understanding complex
problems
Generate ideas for applications of VR in different
fields Elective: creating a VR prototype
Question
s
Universiteit Leiden
www.robindelange.com
?
