21
German University in Cairo –Spring 2018 TUTORIAL-1: INTRO TO BCI – HUMAN BRAIN I DMET 1058: BRAIN COMPUTER INTERFACES Eng. Eslam Osama Dr. Wael Abouelsaadat

DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: [email protected] •Office Location: C6–305 •Official

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

German University in Cairo –Spring 2018

T U T O R I A L - 1 : I N T R O T O B C I – H U M A N B R A I N I

DMET 1058: BRAIN COMPUTER INTERFACES

Eng. Eslam OsamaDr. Wael Abouelsaadat

Page 2: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

SESSION AGENDA

1. Course Grading Schema 2. Contact Info3. What’s BCI?4. BCI Applications5. Generic BCI Architecture6. Human Brain7. Brain waves8. Practice Assignment 1

2

Page 3: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

1. COURSE GRADING SCHEMA

• 3 Quizzes (best 2) 20%

• Project 30%

• Final Exam 50%

3

Page 4: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

2. CONTACT INFO

• Dr. Wael Abouelsaadat• Email: [email protected]• Office Location: C7–208

• Eng. Eslam Osama• Email: [email protected]• Office Location: C6–305• Official Office Hours: 1 Slots –TBA (according to your

schedule)• Extra office hours can be requested by mail or proposed by

me on MET Announcement page.

4

Page 5: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

2. CONTACT INFO –CONT’D

• Dr. Hisham Othman• Email: [email protected]• Office Location: C7–308

• Eng. Yasmine Azzazi• Email: [email protected]• Office Location: C3–205• Official Office Hours: 1 Slots –TBA (according to your

schedule)• Extra office hours can be requested by mail or proposed by

me on MET Announcement page.

5

Page 6: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

3. WHAT’S BCI?

• Current Human Computer Interaction (HCI): Human controls virtual or physical objects using muscular activity.

• Examples- Mouse à Hand/Finger movements- Keyboard à Hand/Finger movements- Joystick à Hand/Arm movements- Steering wheel, buttons, and pedals ….

6

Page 7: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

3. WHAT’S BCI? –CONT’D

• Brain-Computer Interface (BCI): A device that utilizes brain activity for direct control of physical or virtual objects without using muscular activity or body movements.

7

Page 8: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

4. BCI APPLICATIONS

• Quadruple Paraplegic Users:① BCI speller• using ERPs (P300)• slow (noticeable)

②BCI Prosthetics Controller• using brain signals• ex. Wheelchairs, arms …etc.

8

Page 9: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

4. BCI APPLICATIONS –CONT’D

• Gaming§ Moving in-game character

• Detecting mental state

9

Page 10: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

5. GENERIC BCI ARCHITECTURE

10

• The following is a generic BCI that aims to translate brain activity into control commands for a device.

Page 11: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

5. GENERIC BCI ARCHITECTURE –CONT’D

11

• The process involves….- Brain Recording: Acquiring brain signals via invasive/non-

invasive recording techniques

- Signal Processing: Pre-processing the raw signals by applying filters (ex. Bandpass filter), and artifact reduction/feature extraction techniques

- Pattern recognition and ML: This stage generates a control signal based on patterns in the input, typically using machine-learning techniques

- Sensory Feedback: The control signal from the BCI causes a change in the environment

Page 12: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

6. HUMAN BRAIN

12

• Gray Matter• Contains most of the brain's neural cells.

• Includes regions of the brain involved in muscle control, and sensory perception such as seeing and hearing, memory, emotions, speech, decision making, and self-control.

Page 13: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

6. HUMAN BRAIN –CONT’D

13

• Neurons- The workhorse of the brain- A complex electrochemical device that receives

information from hundreds of other neurons, processes this information, and conveys its output to hundreds of other neurons.

Page 14: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

6. HUMAN BRAIN –CONT’D

14

• Neurons – How they work?

Page 15: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

6. HUMAN BRAIN –CONT’D

15

• Brain Lobes• Our brain contains 4 lobes • Each one is responsible for a set of abilities

Page 16: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

6. HUMAN BRAIN –CONT’D

16

Frontal Lobe

• Cognition & Memory

• Concentrate and elaborate thoughts

• Reasoning

• Motor skills

• Personality and emotional traits

Parietal Lobe

• Sensory input processing

• Sensory discrimination

• Body orientation

Temporal Lobe

• Auditory reception and association

• Emotional expression

• Languages

• Info retrieval

Occipital Lobe

• Visual reception

• Visual association (interpretation)

Page 17: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

6. HUMAN BRAIN –CONT’D

17

• Electrode placement…

Page 18: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

7. BRAIN WAVES

18

1. Delta waves

2. Theta waves

3. Alpha waves

4. Beta waves

5. Gamma waves

Page 19: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

7. BRAIN WAVES –CONT’D

19

Type Frequency Amplitude Location Mental State

Delta <4 Hz (very low) very high everywhere occur during deep sleep (dreamless), coma.

Theta 4-7 Hz – temporal and parietal

light sleep (dreaming) or extreme relaxation.

Alpha 8-12 Hz – occipital and parietal

awake but relaxed and not processing much information

Beta 12-32 Hz – parietal and frontal

normal waking state of consciousness when attention is directed towards cognitive tasks and the outside world

Gamma >32 Hz(very high) –Fastest wave

very low – formation of ideas, language and memory processing, and

various types of learning

Page 20: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

7. BRAIN WAVES –CONT’D

20

• How to record brain activities ?!- EEG (electroencephalogram)• Signals acquired from a cap of

electrodes that contact scalp through a gel

• Signals are in microvolts range àneed to be amplified

• Produces low signal quality but it’s a safe techniques (non invasive BCI)

Page 21: DMET 1058: BRAIN COMPUTER INTERFACESmet.guc.edu.eg/Download.ashx?id=29670&file=bci_29670.pdf · •Eng. Eslam Osama •Email: eslam.osama@guc.edu.eg •Office Location: C6–305 •Official

21

PRACTICE ASSIGNMENT (1)