View
50
Download
1
Category
Preview:
Citation preview
BRAIN-COMPUTER INTERFACE
MICHAEL ARGYRIS – N8342113LUCAS NIELSEN – N8591733 THOMAS PARKER – N8584095BEB801 – SEM 1 2016SUPERVISOR – FREDERIC MAIRE
PRIOR WORK
• Vacation Research Project from 2014• Aim was to test classifier on Gaming Peripheral EEG Headset• Emotive EPOC combined with python scripting
INVESTIGATION INTO PRIOR WORK• 3 Separate tests (involving cubes and movement)• 3 main subjects• 2 Stage test (initial condition, final condition)• Using all 14 channels• Separate Classifier (separate script for analysis of recordings)• Linear Classifiers – Failed• Non-Linear Classifiers – Passed (barely)• Poor Channel Quality
PROJECT DEFINITION - EXPERIMENTS• Group Experiment
• Human motor control (such as lifting an arm) with respect to visualisation of the same motor control (visualisation of lifting that arm)
• Individual Experiment 1• Conducted by Lucas Nielsen• Analysing the effect of brain activity with respect to directional movement cues
• Individual Experiment 2 • Conducted by Thomas Parker• Analysing the effect of brain activity with respect to musical tunes
• Individual Experiment 3• Conducted by Michael Argyris• Analysing the effect of brain activity with respect to colour and shapes
PROJECT DEFINITION – GROUP EXPERIMENT• Hypothesis
• Visualisation of motor control and actualising motor control both produce EEG readings which are distinguishable and are able to be discretely analysed to determine what specific motor control was performed
• Variables• Individuals with varying socioeconomic status and varying passions and
hobbies• Time of day test taken• Subjects dominant hand (left or right handed)• Type of input (physical or imaginary)• Different movement types (throw, catch, wave, handshakes)
PROJECT DEFINITION – INDIVIDUAL EXPERIMENT 1• Hypothesis
• Emotiv EPOC system is able to accurately detect and successfully identify features associated with particular brain activity when a given a subject demonstrates the ability to respond to directional movement cues
• A Scenario• Observing a static black arrow directed upward • Observing a static black arrow directed downward • Observing a static black arrow directed towards the right • Observing a static black arrow directed towards the left • Repeat 1 to 4 for observing a moving black arrow
PROJECT DEFINITION – INDIVIDUAL EXPERIMENT 2• Hypothesis
• Emotiv EPOC system is able to accurately detect and successfully identify the difference between an “earworm” or the ability of Audiation as opposed to actually listening to music.
• A Scenario• Listen to song prior to experiment several times• Playback of song whilst wearing EEG Headset & Recording Data• Attempt recall of chorus or major section of song and ask to record which part
of song was recalled• Test for correlations between both sets of data
PROJECT DEFINITION – INDIVIDUAL EXPERIMENT 3
• Hypothesis• The Emotiv EPOC system is able to accurately detect and successfully identify the
difference between shapes and colours when visualised.
• A Scenario• Part 1 involves looking at uniquely coloured shapes will generate highly
distinguishable readings
• Part 2 involves having three unique shapes of the same colour
• Part 3 involves having three identical shapes of different unique colours
METHODOLOGY - PRECAUTIONS• Reasonably lit room with minimal sound to reduce any possible external
influence to noise generation.• Five (5) minutes per subject to relax and stabilise energy levels to reduce
possible unwanted noise• Ensure the subject is fully aware of the steps and time involved in
completing the experiment• Clean sensors, lubricate thoroughly and position correctly on subjects head• Each experiment is to be completed by multiple subjects (Approx. 6)
METHODOLOGY – EQUIPMENT REQUIRED• Emotiv EPOC headset and dongle• A computer containing the software required for performing the test
• Both of these are being sourced personally as the EPOC has been provided by QUT to perform the experiments required.
METHODOLOGY - PROCEDURE• Software Setup:
• Software provided previously (EmoKit found on GitHub) is downloaded and installed on a windows based computer
• Emotiv EPOC control panel is opened and the headset with Bluetooth dongle is initialised.
• The application requires two inputs before EEG recording can start:• Name for the excel file of which recorded data is exported to • Time (in seconds) for the particular recording to be run.
METHODOLOGY - PROCEDURE• Environment Setup:
• Setup the headset by applying the saline solution to each sensor • Attaching the sensors to the headset itself• Position the EPOC headset and sensors on the subject’s head and achieve strong
signal readings (indicated by green lights on each sensor point on the control panel diagram)
• Load the experiment stimulus material onto the laptop• Sit the test subject with eye level in line with the screen• Proceed to start the experiment and collect data
METHODOLOGY - PROCEDURE• Data Collection (Single Experiment):
1. Perform software and environment setup2. Determine which experiment scenario is to be carried out3. Enter a name for the recorded data file to be exported as and enter the duration of
the sampling time (in seconds) for the particular recording to be run4. Start the application to begin recording simultaneously to initiating the stimulus
software5. An excel document is generated containing this test data6. Repeat steps 3 to 5 to collect additional samples of the same test if required7. Once all required samples are recorded proceed to process the data as detailed in
the next slide8. Repeat steps 2 to 7 for each experiment scenario
METHODOLOGY - PROCEDURE• Data Processing:
Load raw sample data
Concatenate data samples
Extract the 14 sensor
channels
Average the samples
Normalise the resulting sample
Divide sample into a training set (80%) and
a trial set (20%)
Feature extraction and
selection
Train classifier (using training
dataset)
Test the trained
classifier (using trial dataset)
PROGRESS• Updating Python code from outdated version to be compatible with the
latest drivers and OS in use• Python 3.3+ significant changes required• High Performance version• Real time Feasibility• EPOC Firmware research• Emotiv SDK and Trivial applications for self study
DIFFICULTIES THUS FAR
• Illness during late semester• EPOC is Outdated• EPOC suffers from corrosion• Compatibilities with current technologies
RESULTS, ANALYSIS & FINDINGS
• Delayed due to code updates required to run code and to use both original data and new classifiers• Findings from prior research• Findings from use cases conducted thus far
WHAT’S NEXT? – PROJECT PLAN
THANK YOU – ANY QUESTIONS?
Recommended