• Home

  • Data & Analytics

  • Learning representations from EEG with Deep Recurrent Convolutional neural networks
13
Learning representations from EEG with deep recurrent-convolutional neural networks ICLR 2016 Bashivan, Pouya, Irina Rish, Mohammed Yeasin, and Noel Codella Slides by Alberto Bozal ReadAI Reading Group 6th March, 2017

Learning representations from EEG with Deep Recurrent Convolutional neural networks

Embed Size (px)

Citation preview

Page 1: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Learning representations from EEG with deep recurrent-convolutional neural networks

ICLR 2016

Bashivan, Pouya, Irina Rish, Mohammed Yeasin, and Noel Codella

Slides by Alberto BozalReadAI Reading Group

6th March, 2017

https://github.com/imatge-upc/readai/blob/master/README.md
https://github.com/imatge-upc/readai/blob/master/README.md
Page 2: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Index1. Introduction2. EEG data3. Images from EEG time-series4. Architecture5. Training6. Experiments on an EEG Dataset7. Results

Page 3: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Introduction

● EEG Electroencephalogram - Noninvasive method

● Deep belief network and ConvNets for fMRI and EEG

Page 4: Learning representations from EEG with Deep Recurrent Convolutional neural networks

EEG data

● Measuring charges in electrical voltage

● Seems multi-channel “speech” from the electrodes

Page 5: Learning representations from EEG with Deep Recurrent Convolutional neural networks

EEG data

● Multiples bands meaning○ Gamma○ Beta○ Alpha○ Theta○ Delta

● Oscillatory cortical activity○ Theta(4-7Hz)○ Alpha(8-13Hz)○ Beta(13-30Hz)

Page 6: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Images from EEG time-series

● EEG normal experiments○ Time○ Frequency

● Approach representation EEG○ Adding Space domine

+

Page 7: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Images from EEG time-series

● Azimuthal Equidistant Projection - Polar Projection

● Toche Scheme - interpolation

For each frequency band

Page 8: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Architecture

● Single-Frame Approach○ ConvNet - Based VGG○ FFT - All trial duration(3.5 s)

Page 9: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Architecture

● Multi-Frame Approach○ C = 7-layers ConvNet - Based VGG○ max = maxpool○ FC = Fully Connected○ SM = Softmax○ L =LSTM

LSTM Equations:

Page 10: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Training

● Optimizing the cross-entropy loss function● Adam algorithm● Batch size 20● VGG few epoch

○ Large number of parameters in our model■ Many epoch -> overfitting

● Dropout

Page 11: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Experiments on an EEG Dataset

● 5 Chars shown○ Each for 0.5 s

● 1 TEST char at the end

● 2670 samples from 13/15 subjects

Page 12: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Results

● Single-Frame Approach

Page 13: Learning representations from EEG with Deep Recurrent Convolutional neural networks

Results

● Multi-Frame Approach


Convolutional Networks for EEG Signal Classification in

Convolutional Networks for EEG Signal Classification in

Documents
Using a deep recurrent neural network with EEG signal to

Using a deep recurrent neural network with EEG signal to

Documents
Bidirectional Recurrent Convolutional Networks for …papers.nips.cc/paper/5778-bidirectional-recurrent-convolutional... · Bidirectional Recurrent Convolutional Networks for Multi-Frame

Bidirectional Recurrent Convolutional Networks for …papers.nips.cc/paper/5778-bidirectional-recurrent-convolutional... · Bidirectional Recurrent Convolutional Networks for Multi-Frame

Documents
Diffusion Convolutional Recurrent Neural Network: Data

Diffusion Convolutional Recurrent Neural Network: Data

Documents
Deep Recurrent and Convolutional Neural Networks for ... · PDF fileDeep Recurrent and Convolutional Neural Networks for Automated Behavior Classification ... This thesis focuses

Deep Recurrent and Convolutional Neural Networks for ... · PDF fileDeep Recurrent and Convolutional Neural Networks for Automated Behavior Classification ... This thesis focuses

Documents
Convolutional Recurrent Neural Networks for Polyphonic Sound … · 1 Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection Emre C¸akır, Giambattista Parascandolo,

Convolutional Recurrent Neural Networks for Polyphonic Sound … · 1 Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection Emre C¸akır, Giambattista Parascandolo,

Documents
Identification of Epileptic EEG Signals Using Convolutional

Identification of Epileptic EEG Signals Using Convolutional

Documents
Making Convolutional Networks Recurrent for Visual ... - …xiaodongyang.org/publications/papers/prernn-cvpr18.pdf · Making Convolutional Networks Recurrent for Visual Sequence Learning

Making Convolutional Networks Recurrent for Visual ... - …xiaodongyang.org/publications/papers/prernn-cvpr18.pdf · Making Convolutional Networks Recurrent for Visual Sequence Learning

Documents
Long-term Recurrent Convolutional Networks for Visual

Long-term Recurrent Convolutional Networks for Visual

Documents
Ionospheric activity prediction using convolutional recurrent … · Preprint - Under submission at IEEE transactions on Big Data Ionospheric activity prediction using convolutional

Ionospheric activity prediction using convolutional recurrent … · Preprint - Under submission at IEEE transactions on Big Data Ionospheric activity prediction using convolutional

Documents
Convolutional Recurrent Neural Networks for … Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection Emre C¸akır, Giambattista Parascandolo, Toni Heittola,

Convolutional Recurrent Neural Networks for … Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection Emre C¸akır, Giambattista Parascandolo, Toni Heittola,

Documents
Learning Long-term Dependencies in Recurrent Neural Networks · Application of Recurrent Networks in Sequence Learning Sequence Classification Classification of EEG signals (Forney

Learning Long-term Dependencies in Recurrent Neural Networks · Application of Recurrent Networks in Sequence Learning Sequence Classification Classification of EEG signals (Forney

Documents
Speech Emotion Recognition Using Deep Convolutional ...Index Terms—Convolutional Neural Network, Speech Emotion Recognition, Simple Recurrent Unit I. INTRODUCTION anguage, as one

Speech Emotion Recognition Using Deep Convolutional ...Index Terms—Convolutional Neural Network, Speech Emotion Recognition, Simple Recurrent Unit I. INTRODUCTION anguage, as one

Documents
Task-Driven Convolutional Recurrent Models of the Visual ... · Task-Driven Convolutional Recurrent Models of the Visual System Aran Nayebi1,*, Daniel Bear2,*, ... local recurrence

Task-Driven Convolutional Recurrent Models of the Visual ... · Task-Driven Convolutional Recurrent Models of the Visual System Aran Nayebi1,*, Daniel Bear2,*, ... local recurrence

Documents
EEG using a convolutional neural networkEEG Grade Filter, Segmentation EEG Data Two -Step Voting EEG Grade Fig. 1: Proposed HIE grading system for term infant EEG. of disagreement,

EEG using a convolutional neural networkEEG Grade Filter, Segmentation EEG Data Two -Step Voting EEG Grade Fig. 1: Proposed HIE grading system for term infant EEG. of disagreement,

Documents
Bidirectional Recurrent Convolutional Networks for Multi ......Bidirectional Recurrent Convolutional Networks for Multi-Frame Super-Resolution Yan Huang 1Wei Wang Liang Wang;2 1Center

Bidirectional Recurrent Convolutional Networks for Multi ......Bidirectional Recurrent Convolutional Networks for Multi-Frame Super-Resolution Yan Huang 1Wei Wang Liang Wang;2 1Center

Documents
Stable EEG Biometrics Using Convolutional Neural Networks

Stable EEG Biometrics Using Convolutional Neural Networks

Documents
An Empirical Evaluation of Generic Convolutional and … · An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling substantially longer memory,

An Empirical Evaluation of Generic Convolutional and … · An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling substantially longer memory,

Documents
Spatially Supervised Recurrent Convolutional Neural ... · Spatially Supervised Recurrent Convolutional Neural Networks for ... Department of Electrical and Computer ... we propose

Spatially Supervised Recurrent Convolutional Neural ... · Spatially Supervised Recurrent Convolutional Neural Networks for ... Department of Electrical and Computer ... we propose

Documents
Decoding EEG Brain Signals using Recurrent Neural …mediatum.ub.tum.de/doc/1422453/552605125571.pdf · Decoding of EEG Brain Signals Using Recurrent Neural Network s ... As EEG is

Decoding EEG Brain Signals using Recurrent Neural …mediatum.ub.tum.de/doc/1422453/552605125571.pdf · Decoding of EEG Brain Signals Using Recurrent Neural Network s ... As EEG is

Documents
Detecting Gender and Assessing Pathology from EEG with ......thomas.jochmann@tu-ilmenau.de Detecting Gender and Assessing Pathology from EEG with Convolutional Neural Networks Thomas

Detecting Gender and Assessing Pathology from EEG with [email protected] Detecting Gender and Assessing Pathology from EEG with Convolutional Neural Networks Thomas

Documents
1 Long-term Recurrent Convolutional Networks for Visual ... · of architectures for visual recognition and description which combines convolutional layers and long-range temporal

1 Long-term Recurrent Convolutional Networks for Visual ... · of architectures for visual recognition and description which combines convolutional layers and long-range temporal

Documents
Recurrent Fully Convolutional Neural Networks for …...Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation Rudra P K Poudel, Pablo Lamata and Giovanni

Recurrent Fully Convolutional Neural Networks for …...Recurrent Fully Convolutional Neural Networks for Multi-slice MRI Cardiac Segmentation Rudra P K Poudel, Pablo Lamata and Giovanni

Documents
Video Compression Using Recurrent Convolutional …cs231n.stanford.edu/reports/2017/pdfs/423.pdfVideo Compression Using Recurrent Convolutional Neural Networks Cedric Yue Sik Kin Electrical

Video Compression Using Recurrent Convolutional …cs231n.stanford.edu/reports/2017/pdfs/423.pdfVideo Compression Using Recurrent Convolutional Neural Networks Cedric Yue Sik Kin Electrical

Documents
Stock Market Trend Prediction Using Recurrent Convolutional Neural …tcci.ccf.org.cn/conference/2018/papers/145.pdf · 2018-08-16 · Stock Market Trend Prediction Using Recurrent

Stock Market Trend Prediction Using Recurrent Convolutional Neural …tcci.ccf.org.cn/conference/2018/papers/145.pdf · 2018-08-16 · Stock Market Trend Prediction Using Recurrent

Documents
Super-resolution recurrent convolutional neural networks

Super-resolution recurrent convolutional neural networks

Documents
CONVOLUTIONAL-RECURRENT NEURAL NETWORKS ...hzhao1/papers/ICASSP2018/...tional recurrent neural networks (BRNN) that have recurrent connections in both directions. The output of the

CONVOLUTIONAL-RECURRENT NEURAL NETWORKS ...hzhao1/papers/ICASSP2018/...tional recurrent neural networks (BRNN) that have recurrent connections in both directions. The output of the

Documents
SUPERRESOLUTION RECURRENT CONVOLUTIONAL NEURAL NETWORKS

SUPERRESOLUTION RECURRENT CONVOLUTIONAL NEURAL NETWORKS

Documents
SqueezeSeg: Convolutional Neural Nets with Recurrent … · SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloud

SqueezeSeg: Convolutional Neural Nets with Recurrent … · SqueezeSeg: Convolutional Neural Nets with Recurrent CRF for Real-Time Road-Object Segmentation from 3D LiDAR Point Cloud

Documents
Convolutional Recurrent Neural Networks for Dynamic MR ... · 1 Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction Chen Qin*y, Jo Schlemper*, Jose Caballero,

Convolutional Recurrent Neural Networks for Dynamic MR ... · 1 Convolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction Chen Qin*y, Jo Schlemper*, Jose Caballero,

Documents