33
Smartphone based Blood Oxygen Level Measurement using Near-IR and RED Wave-guided Light Nam Bui, Anh Nguyen, Phuc Nguyen, Hoang Truong, Ashwin Ashok, Thang Dinh, Robin Deterding, Tam Vu 1/30 PhO 2

CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Smartphone based Blood Oxygen Level Measurementusing Near-IR and RED Wave-guided Light

Nam Bui, Anh Nguyen, Phuc Nguyen, Hoang Truong, Ashwin Ashok, Thang Dinh, Robin Deterding, Tam Vu

1/30

PhO2

Page 2: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Chronic Obstructive Pulmonary Disease (COPD)

24 Million Americans

have COPD

2/30

Leading cause of death in the US, 2016

OFTENFOUND IN LATE STAGE

$34,000 treatment in ICU

Early detection of COPD is key to successful treatment

Page 3: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Heart rate

Blood pressure

Breathing rate

Wheezing sound

Oxygen saturation (SpO2)

Vital signs screening in COPD

3/30

Oxygen Saturation needs to be measured frequently

Page 4: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Oxygen Saturation (SpO2)

𝑺𝒑𝟎𝟐 =𝑵𝒐. 𝒐𝒙𝒚𝒈𝒆𝒏𝒂𝒕𝒆𝒅 𝒉𝒆𝒎𝒐𝒈𝒍𝒐𝒃𝒊𝒏

𝑻𝒐𝒕𝒂𝒍 𝑵𝒐. 𝒉𝒆𝒎𝒐𝒈𝒍𝒐𝒃𝒊𝒏𝟏𝟎𝟎%

O2

O2

O2

O2

Oxygenated hemoglobin Deoxygenated hemoglobin

4/30

Page 5: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Photon Detector

IR emitter Red emitter

AC

R IR

Non-invasive Measurement of Oxygen Saturation

Intensity

t

Intensity

t

ACIR

ACR

𝑺𝒑𝟎𝟐 = 𝒇𝑨𝑪𝑹𝑨𝑪𝑰𝑹

5/30

Page 6: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Red and IR Wavelength Selection

At Red= 660 nm and IR = 960 nm, the difference of light absorption

by oxygenated hemoglobin and deoxygenated hemoglobin is largest.

6/30

Absorbed by red

pigmentation

Harmful

Low penetration

Page 7: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Pros Cons

High accuracy Inconvenient

Costly

Smartphone-based blood oxygen measurement

Dedicated Hardware Solutions

Page 8: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

A solution to capture the oxygen level and is

High accuracy.

Low-cost.

Easy to make by patients

8/30

Page 9: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

9/30

PhO2

Smartphone based Blood Oxygen Level Measurement

Page 10: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

10/30

IR emitter Red emitter

PULSE OXIMETER

Hardware Challenges

PHONE BASED PULSE OXIMETER

Light

Source

Page 11: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

11/30

Challenge. Phone’s camera IR filter

Sensor

IR filter

Page 12: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Existing Software-based Solutions

DigiDoc iHealthCare

RGB

Color

Image

Red Light

IR Light

DISADVANTAGES

Inaccurate: Green channel is mostly absorbed by red pigmentation.

Coarse-grained: one record per 10 seconds.

Page 13: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Solution.

Red and NIR for Oxygen Saturation Measurement

NIR

14/30

NIR

is available in most of phone’s flashlight and is not filtered by the phone’s camera.has similar characteristics of hemoglobin absorption with the IR lights.

NIR

Page 14: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

15/30

PhO2 NIR Extraction Technique

Absorbed by redpigmentation

Green filter

Absorbed

NIR

Red and Green filter cuttoff

Page 15: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

And 5 More Challenges…

16/30

Smartphone’s camera picks up most of the lights

Finger movement and Contact pressure

Pressure

Micro movements

RGB Intensity

Conversion between RGB and light intensity

Flashlight heat can cause skin burn

Page 16: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

17/30

3D printed Optical Hardware Add-on

Page 17: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

18/30

Smartphone’s camera picks up most of the lights

RGB Intensity

Conversion between RGB and light intensity

Finger movement and contact pressure

Pressure

Micro movements

Flashlight can cause skin burn

3D printed Optical Hardware Add-on

Page 18: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Wavelength selection

𝝀𝑹= 678 nm

𝝀𝑵𝑰𝑹= 724 nm

𝑺𝒑𝟎𝟐 =𝜺𝑯𝒃 𝒓 − 𝜺𝑯𝒃 𝒓 𝑹

𝜺𝑯𝒃 𝒊𝒓 − 𝜺𝑯𝒃𝑶𝟐 𝒓 + 𝜺𝑯𝒃𝑶𝟐 𝒊𝒓 − 𝜺𝑯𝒃 𝒊𝒓 𝑹

20/30

X:678

Y: 724

Z:1.002

𝜶

𝜶 = 𝒂𝒓𝒄𝒕𝒂𝒏(𝒂/𝒃)

a

b

Page 19: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Pressure Detection and Recommendation

No

rma

lized

In

ten

sit

y

PPG signal in a 7 seconds window

Sample

No

rma

lized

In

ten

sit

y

Sample

PPG signal in a 7 seconds window

21/30

No

rma

lized

In

ten

sit

y

PPG signal in a 7 seconds window

Sample

Page 20: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

22/30

Heat Reduction with Distributed Lighting Source

𝐸𝑝 = ℎ𝑓

𝑬 =

2.55 mm 0.6 mmModifyBandpass filter

To maintain

the high light

intensity

𝑯

Page 21: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Detecting pressure

ROI detection and create thePPG signals

PPG

Identify the peaksand troughs

Calculate peak-to-peak ratio

95

%

Collecting raw data

23/30

AlgorithmsPhO2

Page 22: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

App overview

PPG display

Image frame

24/30

Page 23: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

25/30

Page 24: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

In-lab experiments

• 3 males, 3 females

• 5 times performs the hyperventilation (a breath

holding technique to reduce oxygen).

• Totally 560 samples.

26/30

Page 25: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

27/30

PhO2 vs. Existing apps

Sp

O2 (

%)

Measurement Indices

DigiDoc

Sp

O2 (

%)

Measurement Indices

iHealthCareS

pO

2 (

%)

PhO2

Time (s)

Page 26: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Experimental results

28/30

3.5%

Page 27: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

In clinic experiment

In hospital experiment with patient.

29/30

Page 28: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

30/30

Fine-grained evaluation of the patient

Low Oxygen Level

Coughing

Page 29: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

31/30

Heat Reduction Evaluation

Hand multimeter

Thermalcouple Probe

Page 30: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

32/30

Output temperature of different add-on designs

0

10

20

30

40

50

60

Without Banpass Filter With Bandpass Filter

58.9

4538.5

36.840.3

37.6

Tem

peratu

re (

Cels

ius)

Large Tunnel Small Tunnel Multiple Small Tunnels

Page 31: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Conclusion

❑Accurately measuring oxygen level using low-cost opticalfilm filters.

❑Detect the appropriate contact pressure between fingerand phone’ camera.

❑3D-printed add-on to handle the problem of lightscattering and finger movement.

34/30

Page 32: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Application for optical light based sensing

35/30

Cholest-erol

Optical light

based sensing

Urea Lactate

Water

Alcohol Glucose

Page 33: CamK Weekly Meetingmnslab.org/hoangtruong/pubs/2017_Sensys_Pho2_slide.pdf · PhO2 vs. Existing apps) Measurement Indices DigiDoc) Measurement Indices iHealthCare) PhO2 Time (s) Experimental

Smartphone based Blood Oxygen Level Measurementusing Near-IR and RED Wave-guided Light

Nam Bui, Anh Nguyen, Phuc Nguyen, Hoang Truong, Ashwin Ashok, Thang Dinh, Robin Deterding, Tam Vu

37/30

PhO2