40
www.evk.biz © EVK DI Kerschhaggl GmbH 2014 Matthias Kerschhaggl ISFR 2015, 08/09/15 1 Near infrared hyperspectral imagery for waste recycling and real-time quantitative inline analysis of raw materials

Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Matthias Kerschhaggl ISFR 2015, 08/09/15

1

Near infrared hyperspectral imagery for waste recycling and real-time quantitative

inline analysis of raw materials

Page 2: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

EVK Introduction

We at EVK believe that we can contribute to increasing reuse & recovery of earth resources and to improve working conditions in

waste recovery

3

Page 3: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014 [email protected]

Who we are

♦ Smart sensing solutions since 1987

♦ 2006: First HSI camera & classification system introduced to market

♦ Real-time classification and sorting

♦ Industry proven in recycling, mining, food processing and pharmaceutical applications

4

Page 4: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

What We Do

♦Simple start From pixel to sorting

♦Imaging & Sorting system with high speed, high resolution and control of ejection unit

♦Software package adapts the system to specific application

5 ©EVK DI Kerschhaggl GmbH 2015

Page 5: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Applications

6

Metals from slag Household waste

C&D Recovered Paper Wood Sorting

Potato Sorting & Grading

E-Scrap

Nut Sorting

Page 6: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Technical Background Material Identification with HSI

stretching bending rocking

twisting wagging stretching

pict

ure:

Tia

go B

ecer

ra P

aolin

i

Absorption spectra according to the molecular composition

C-O-H-N Compounds (e.g. C10H8O4)

7 ©EVK DI Kerschhaggl GmbH 2015

Vorführender
Präsentationsnotizen
C10H8O4 = PET Grundlage für Chemical Imaging ist die Interaktion von elektromagnetischen Wellen mit Materie. Moleküle werden hierbei durch einen thermischen Strahler zu unterschiedlichen Schwingungen angeregt und absorbieren an bestimmten Wellenlängen Energie. Aufgrund der reflektierten oder transmittierten Reststrahlung können Rückschlüsse auf die molekulare Zusammensetzung des betrachteten Objektes gezogen werden. Über geeignete Algorithmen können verschiedenste Materialien, wie Kunststoffe, Papier, Mineralien aber auch Lebensmittel hinsichtlich ihrer Inhaltstoffe (z.B. Zuckergehalt, Fettgehalt oder Proteingehalt bei Lebensmittel) klassifiziert werden.
Page 7: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

HELIOS – Spectral Ranges

8 ©EVK DI Kerschhaggl GmbH 2015

Page 8: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014 [email protected]

Hyperspectral Imaging Technology

Camera internal classification and RGB visualization of chemical differences for real-time analysis

10

Vorführender
Präsentationsnotizen
LINE SCAN technology
Page 9: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Plastic Sorting

20

Page 10: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Plastic Sorting

21

PE PET PS

Fingerprint: NIR absorption bands due to functional groups (CH,NH,OH) translate into different spectral signatures.

Page 11: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Plastic Sorting

22

Principal Component Analysis

Partial Least Squares

Chemical Color Imaging: MVDA-projection of HSI data into RGB space

Page 12: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Plastic Sorting

23

Principal Components

Principal Component Analysis

Partial Least Squares

wavelength wavelength

AU AU

Page 13: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Recycling

24

paper cardboard

PE-LD

Page 14: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Mineral Sorting

26

Calcite CaCO3 vs. Dolomite CaMg(CO3)2

Page 15: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

HSI – Quantitative Analysis

wellness.byu.edu

Fig 2: PLS schematics (Wold et al. 2001)

Fernadez-Novales et al. (2009)

X Y Predictors (spectra)

Observations (reference analysis)

X Y

27

Page 16: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Copper Ores Quantitatively

28

~600 nm bandpass ~130 nm bandpass @ max correlation

Page 17: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Copper Ores Quantitatively

29

~600 nm bandpass

~130 nm bandpass @ max correlation

Full Range ROI

R2 0.4 0.9

RMSECV [%] 0.2 0.1

Page 18: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceutical Engineering

31 ©EVK DI Kerschhaggl GmbH 2015

Page 19: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceutical Engineering

32 ©EVK DI Kerschhaggl GmbH 2015

Page 20: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals

33

(left) First derivative normalized spectra of acetylsalicylic acid (red) and paracetamol (green) and (right) paracetamol blister (red) as well as spectra taken from the acetylsalicylic acid package as recorded with the HELIOS hyperspectral imaging camera.

Page 21: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals

34

Page 22: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals Quantitatively

35

Page 23: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals Quantitatively

R^2=0.98 RMSEC = 1.2 mg/cm2

36 [email protected]

Page 24: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Pharmaceuticals Quantitatively

R^2=0.98 RMSEC = 1.2 mg/cm2

37

mg/cm2

[email protected]

Page 25: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Food Food sorting – Blueberries and stems

Page 26: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Food

Food sorting – Noodles and worms

Page 27: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Inline Dry Matter Measurements

41

• Dry matter content traced by spectral signatures

• Inferred FIR-filter kernel

allows for concentration prediction

Page 28: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Inline Dry Matter Measurements

42

HELIOS Camera

R = 0.9 RMS = 1 %

Page 29: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Dry Matter Food Analyzer

43

• Integrated in sorting machine (INSORT Observer Food Analyzer)

• Valdidated model (R^2=0.9, RMS=5 %)

Page 30: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Dry Matter

44

Page 31: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Dry Matter Statistics

45

• DM „heat map“ • DM value histogramm • Mean DM • Standard Deviation of

product DM

Page 32: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Dry Matter Food Analyzer

46

Validation run of the dry matter measurement using HELIOS with respect to gravimetric reference methods (CEM, HB43).

Page 33: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Accuracy vs. Precision

[email protected] 47

Plots taken from http://en.wikipedia.org

higher precision

higher accuracy

Laboratory precision completed with inline inspection of entire

production stream

Page 34: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Precision vs. Accuracy

• The intrinsic variance of the product is greater than the precision of the lab reference, so better have full sampling rather than super precision!

• „Better you measure all the fries all the time with reasonable precision rather than 1 out of 100.000 with ultra-high precision!“

• It is about large scale trends in the whole product stream not about laboratory measurements of unrepresentatively small quantities!

• A RMS of e.g. 1 % for constant monitoring of the product throughout the entire input stream is already way better than what you can do with a precision of 0.1 % every 30 min on a spatially confined sample!

48

Courtesy W. Märzinger

Page 35: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Quantitative Analysis: Prospects for Recycling of Polymeric Materials

49

• enable also quantitative measurements of scanned organic material flows (e.g. moisture content, woodchips vs contaminants, deinking vs non-deink vs paperless etc).

• in-line characterization of organic bulk material streams: - moisture and chlorine content - calorific value for waste to energy processing - sugar content in biodegradable MSW for subsequent bio-based chemical production.

Page 36: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Award

51

International FoodTec Award

DLG (Deutsche Landwirtschafts-Gesellschaft

/ German Agricultural Society)

Page 37: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Conclusions

52

♦Hyperspectral Imaging is an already well established technology for sorting solutions in the recycling, mining and food industries.

♦The inferred spectral information is suitable for doing quantitative analysis in various applications.

♦The potential to bring the laboratory into the line with unprecedented statistical power is enormous.

Page 38: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Acknowledgements

M. Jeindl

W. Märzinger

E. Leitner

S. Sacher

53

Page 39: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014

Some References

54

Page 40: Near infrared hyperspectral imagery for waste recycling ...isfr.unileoben.ac.at/fileadmin/shares/isfr/docs/Kerschhaggl.pdf · Near infrared hyperspectral imagery for waste recycling

www.evk.biz © EVK DI Kerschhaggl GmbH 2014 Thank you for your attention