34
AN SSVEP-ACTUATED BRAIN COMPUTER INTERFACE USING PHASE-TAGGED FLICKERING SEQUENCES: A CURSOR SYSTEM Chairman Dr. Hung-Chi Yang Presenter HSUAN-CHIA KUO Adviser Dr. Shih-Chung Chen Date 2013/12/25 PO-LEI LEE, JYUN-JIE SIE, YU-JU LIU, CHI-HSUN WU, MING-HUAN LEE, CHIH- HUNG SHU,PO-HUNG LI, CHIA-WEI SUN, and KUO-KAI SHYU Annals of Biomedical Engineering, Vol. 38, No. 7, July 2010 (© 2010) pp. 2383–2397

A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

Embed Size (px)

Citation preview

Page 1: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

AN SSVEP-ACTUATED BRAIN COMPUTER INTERFACE USING PHASE-TAGGED

FLICKERING SEQUENCES: A CURSOR SYSTEM

Chairman : Dr. Hung-Chi Yang

Presenter: HSUAN-CHIA KUO

Adviser : Dr. Shih-Chung Chen

Date : 2013/12/25

PO-LEI LEE, JYUN-JIE SIE, YU-JU LIU, CHI-HSUN WU, MING-HUAN LEE, CHIH-HUNG SHU,PO-HUNG LI, CHIA-WEI SUN, and KUO-KAI SHYU

Annals of Biomedical Engineering, Vol. 38, No. 7, July 2010 (© 2010) pp. 2383–2397

Page 2: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

OUTLINE

INTRODUCTION MATERIALS AND METHODS RESULTS CONCLUSIONS REFERENCES

Page 3: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

INTRODUCTION

Patients suffering from severe motor disabilities, such as amyotrophic lateral scleroses (ALS)

Novel techniques allow users to control external devices or express their intentions independent of peripheral neuromuscular functions

Page 4: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

INTRODUCTION

Among those proposed solutions, one promising technique, called brain computer interface (BCI)

This paper proposes a new SSVEP usesonly one Oz EEG channel for SSVEP recordings and employs a simple architecture for SSVEP extraction.

Page 5: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Seven volunteers (Six males and one female), ages from 24 to 32 years.

Page 6: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Application study I

Control Study Application Study

Page 7: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Application study I

Came back 6 months later

Page 8: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Application study II

More complicated application study !

Page 9: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

CONTROL STUDY

Phase difference the predicted phase delay the detected phase lags

In the induced SSVEPs using averages of different epoch lengths.

Page 10: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

APPLICATION STUDIES

Aimed to demonstrate the feasibility of the proposed system by inputting command sequences.

Page 11: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Subject I

1-h experience

Visual stimulation

Other

Naïve subjects

Page 12: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Six months later…

Page 13: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Subject I and II

1.5-h experience

Other

0.5-h experience

Page 14: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

MATERIALS AND METHODS

Pic 1. The schematic diagram of the proposed SSVEP-actuated BCI system

Page 15: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

APPLICATION TASK I

Produce a sequence of eight cursor commands

ON

BL BR

OFF

Pic 2. Flickering LEDs

Page 16: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

APPLICATION TASK II

ON

BL BR

OFF

3

Pic 3. Flickering LEDs

Page 17: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

EEG RECORDINGS

Used only one bipolar EEG channel

One electrode (oz(+)) and (oz(−))

A ground electrode

Bandpass, 0.5–50 hz

Pic 4. Electrode Position

Page 18: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

VISUAL STIMULI

Square wave Oscillating at 31.25 Hz

(32 ms duration for each ON–OFF cycle)

ON

BL BR

OFF

Pic 5. Flickering LEDs

Page 19: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

VISUAL STIMULI

The ith LED flicker (LEDi) was set as:

θi = (i − 1) * 45°

Full-phase cycle (360°) with a ±22.5° phase margin.

Page 20: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

VISUAL STIMULI

The flickering frequency is known as 31.25 Hz

The phase delay can be controlled by setting a time delay on the square wave generation:

Page 21: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

VISUAL STIMULI

Pic 6. Visual Stimuli

Page 22: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

SIGNAL PROCESSING OF SSVEP

SSVEP-based BCI

The flickering sequences: Set at 31.25 Hz Tagged with distinct phases

The Oz EEG signals: Band-Pass-Filtered between 29.25 and 33.25 Hz

Page 23: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

SIGNAL PROCESSING OF SSVEP

LED1: Estimate the subject-specific phase lag

SSVEP ref The induced SSVEP from LED1 Averaging the epochs in the 1-min recording for

each subject

SSVEP gaze Epochs induced from each LED flicker Excluding LED1 Were averaged over 60 epochs No overlaps

Page 24: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

SIGNAL PROCESSING OF SSVEP

Tref The latency of the maximum amplitude peak

Accomplished recognition of user’s gazed-target by: The phase lag between SSVEPgaze and the

SSVEPref

Page 25: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

GAZED-TARGET IDENTIFICATION

Tpeak The latency of maximum amplitude peak in

SSVEPgaze Time lag (td):

Td = tpeak − tref

Θdetected:

Θd:

Page 26: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

GAZED-TARGET IDENTIFICATION

Di:

The ith LED (flicker LEDi) with minimum angle distance Di is recognized as the gazed-target.

Page 27: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

Pic 7. Oz EEG RECORDINGS

Page 28: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

RESULTS

Pic 8. SSVEP-Based BCI Suing Phase Encoded Flickering Sequences

Page 29: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

Pic 9. LEE

Page 30: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

Pic 9. LEE et al

Page 31: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

CONCLUSIONS

This work proposes a SSVEP-based BCI using phase-tagged flickering sequence to produce cursor commands for communication purposes.

Subjects shift their gazes at different LED flickers and phase information of the induced SSVEP is extracted for recognizing the gazed-targets.

Page 32: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

CONCLUSIONS-FEATURES

SSVEP: Stable Reliable Noise can be removed by simply Bandpass Filter

Only one flickering frequency

Avoid interferences from low-frequency noise A more comfortable visualization.

Page 33: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter

REFERENCES [1] Basar, E. Brain functions and oscillation. In: Cross-

Modality Experiments on the Cat Brain, edited byE. Basar, T. Demiralp, M. Schurmann, and C. Basar-Eroglu. Berlin: Springer-Verlag, 1999, pp. 27–59.

[2] Baseler, H. A., E. E. Sutter, S. A. Klein, and T. Carney.The topography of visual evoked response propertiesacross the visual field. Electroencephalogr. Clin. Neurophysiol.90:65–81, 1994.

[3] Birbaumer, N., H. Flor, N. Ghanayim, T. Hinterberger,I. Iverson, E. Taub, B. Kotchoubey, A. Kubler, andJ. Perelmouter. A spelling device for the paralyzed. Nature398:297–298, 1999.

[4] Brown, B., and M. Z. Yu. Variation of topographic visuallyevoked potentials across the visual field. Ophthal.Physl. Opt. 17:25–31, 1997.

Page 34: A N SSVEP-A CTUATED B RAIN C OMPUTER I NTERFACE U SING P HASE -T AGGED F LICKERING S EQUENCES : A C URSOR S YSTEM Chairman : Dr. Hung-Chi Yang Presenter