Applications of Hyperspectral Imaging from Planetary ... · The University of Leicester Space Research Centre • ~100 staff and postgraduate students, housed in purpose-built accommodation

Hyperspectral Imaging

1

Updated: 11/10/12 Issue 1

Space Research Centre Copyright M.R. Sims 2012

Applications of Hyperspectral Imaging from Planetary Science Through to

Healthcare

Professor Mark Sims

Space Research Centre Department of Physics and Astronomy

University of Leicester


2



Talk Purpose: General Introduction (aimed especially at non-specialists) Overview of Applications + Introduction for more specialist papers to follow Space Research Centre: Applications of Hyperspectral Imaging Talk Contents: Space Research Centre: University of Leicester Hyperspectral vs Multispectral Imaging Hyperspectral Imaging Data Hyperspectral Techniques Hyperspectral Applications Planetary Science Healthcare Concluding Remarks

Talk Contents

Origins …

1960

Univ. Leicester Space Research Group established by Royal Society grant of £13,006

“to study solar and stellar X-ray emissions”

To the present … 2011

Instrumentation development for High Energy Astrophysics, Planetary Exploration, Earth Observation Science, and Knowledge Exchange Total grant and contract portfolio ~£20M

Space Research Centre

The University of Leicester Space Research Centre • ~100 staff and postgraduate students, housed in purpose-built accommodation • Recent expansion: 550 sq.m Michael Atiyah Building Annexe (MAB Phase-3) – occupied November 2010 • Diversified funding for 5 current space projects and for laboratory programme in detectors and optics • Nationally recognised for Knowledge Exchange • Partnerships with National (e.g Astrium) and Regional (e.g Magna Parva) Industry • Interacting with the ESA Centre and Harwell ISIC •Three associated spin-off companies, plus G-STEP, Space IDEAS Hub • Partner in NERC/TSB Centre for Earth Observation Instrumentation

http://www.nerc.ac.uk/

http://www.environmentsensitivefarming.co.uk/images/spaw_images/DEFRA RDS.gif

Synergy – Connecting the Areas of the Space Research Centre’s Programme

Science & Technology Research & Development (e.g. sensors)

Space Systems Engineering Project Management

Astrophysics Earth Observation Science

Planetary Science Knowledge Exchange –

‘Spin-Off ’ Public Outreach

Missions and Mission Proposals, October 2011

Mission Instrument Partners

JWST MIRI ESA/NASA ) Current BepiColombo MIXS ESA ) Flight EXOMARS LMC/XRF/Raman ESA ) Projects Astrosat SXT India ) Gaia Data Pipeline ESA ) Lobster All-Sky Monitor India Athena Various ESA JUICE Auroral Imager ESA Plato CCD calibration ESA LOFT Large-area detector ESA Marco-Polo-R Various ESA SVOM X-ray Telescope China /CNES XTIM/XNAV X-ray Telescope DARPA/ESA BEXUS LaBr3 Detector ESA/DLR/Swedish Space Agency Operational : Swift, XMM-Newton, Chandra, MSG I and II, (Envisat)


7



Principles: Image a target in a number of discrete bands over a given wavelength band UV, Visible, NIR, SWIR, LWIR, (Tera-hertz) Known source, natural or artificial broad or narrow band Look at reflectance spectrum Characteristics of target change “reflected” light Unique signatures of objects, chemicals, features and substances may become

visible

Hyperspectral vs Multispectral: Multispectral: number of discrete bands not necessarily continuous coverage in

wavelength, ~>10nm width (visible) Hyperspectral: Continuous coverage high resolution ~2-5nm (visible) Can be enhanced in some cases by a wavelength tunable light source

Hyperspectral vs. Multispectral Imaging: I


8



Issues: Large data-sets Understanding what you are seeing Analysis Expense (of system)

Advantages: Non-contact Unique signatures may present themselves Many applications

Hyperspectral vs. Multispectral Imaging: II


9



Applications: Defence/Security Precision Agriculture Earth Resources Pollution Control Plastics/Recycling Pharma Art, Antiquities Ecology Food Forensics Healthcare Research ++……………

Hyperspectral vs. Multispectral Imaging: III


10



Large data sets consisting of images at each wavelength band, possibly 10-100’s GB Depending on spectral and spatial resolution Each image pixel has a “n” point spectrum associated with it Data called a image cube and sometimes incorrectly a “hypercube” Complex data analysis e.g. PCA may be needed to identify “target” May need to correct for atmospheric Absorption as well illumination source spectrum Image Credit “Why Use Hyperspectral Imaging? Peg Shippert Photgrammetric Engineering and Remote Sensing, April 2004, p377

Hyperspectral Imaging Data


11



Need to spectrally disperse data from a image pixel Need an detector (single pixel or ideally imaging 2-d array) Need to scan spatially and/or spectrally to collect full data set e.g. Whiskbroom or Pushbroom Scanning can be achieved via moving mirrors or imager Spectral dispersion can be achieved via gratings, linear variable filters, tunable band pass filters (filter wedges), spectrometers, prisms Image Credit Hyperspectrum News Letter http://www.techexpo.com/WWW/opto-knowledge/hyperspectrum/hypersp4.html (a), (b) multispectral (c), (d) hyperspectral

Hyperspectral Techniques


12



Defence/Security Security LWIR Credit: Holma, H., (May 2011) Thermische Hyperspektralbildgebung

im langwelligen Infrarot, Photonik Remote chemical imaging of a simultaneous release of SF6 and NH3 at 1.5km

using the Telops Hyper-Cam imaging spectrometer Credit: M. Chamberland, V. Farley, A. Vallières, L. Belhumeur, A. Villemaire, J. Giroux et J. Legault, "High-Performance Field-Portable Imaging Radiometric Spectrometer Technology For Hyperspectral imaging Applications” Proc. SPIE 5994, 59940N, September 2005

Hyperspectral Applications: I


13



Precision Agriculture

Stress detection (lack of water) via chlorophyll content (Credit: USDA, SpecTIR web site)

Earth Resources

Identification of Mineral deposits e.g USGS survey of Afghanistan (Credit USGS)

Hyperspectral Applications: II


14



Pollution Control

Detection of pollutants e.g. oil leak Credit: http://www.resonon.com/application_ecology.html Below (Credit) from “Hyperspectral Image Analysis for Oil Spill Mitigation” F. Salem and M. Kafatos, paper at 2001 22nd Asian Conference on Remote Sensing 5-9 November 2001

Hyperspectral Applications: III


15



Plastics/Recycling

Detection of clear plastics (Image Credit Resonon Web Site)

Pharma

Identification of Drugs, QA of Drugs (Image Credit Resonon Web Site) Near infrared identification of two different drug products.

Both appear white to the naked eye, however they can be easily distinguished using a Hyperspectral Imaging spectrograph.

Hyperspectral Applications: IV


16



Art, Antiquities

Detection of hidden detail, potentially overcome degradation/aging of materials Detection of mold Detection of earlier works Image Credit “Quantitative Hyperspectral Imaging of Historical Documents: Technique and Applications”, R. Padoan et al. 9th International Conference on NDT of Art, Jerusalem, Israel, 25-30 May 2008

Hyperspectral Applications: V


17



Forensics Detection of hidden evidence, body fluids, buried bodies, GSR, Forgery, Counterfeit items etc. Tunable light source may be useful Right and middle images Credit ChemImage Left image University of Leicester

Hyperspectral Applications: VI


18



Food

Detection of mold/degradation Detection of damage e.g. bruises on fruit Classification of quality e.g. meat Image Credit “Prediction of Meat Quality: Application of hyperspectral and Raman Spectroscopy” Moss et al. Report CMS/REP/114446/1 http://www.eblex.org.uk/documents/content/research/rd_qs_b_c_fr_-_nirhyperspectralimagingtopredictbeefquality_191010.pdf

Hyperspectral Applications: VII


19



Ecology

Land Use Change Climate Change (effects on plants, environment, estimate of carbon area index

m2m-2 , canopy water content) Detection of illegal logging Detection of disease e.g. diseased trees Detection of invasive species (plants, animals (latter if they affect plants,

environment)

Hyperspectral Applications: VIII


20



Planetary Science : I

Detect geo-chemistry (mineralogy) of planetary surfaces Based mainly in IR as that is where key absorptions occur Data load can be a problem Currently used from Orbit

Examples CRISM NASA Mars Reconnaissance Orbiter In future on-ground e.g. MicroOmega IR hyperspectral microscope on ESA

ExoMars 2018 rover for mineral classification Note only samples top surface of any rock outcrop, question mark over how much

this represents underlying geology Need an extensive library of spectra and pattern matching

Hyperspectral Applications: IX


21



Hyperspectral Applications: X

Planetary Science: II

Images courtesy CRISM, NASA JPL


22



Hyperspectral Applications: XI

Images Courtesy CRISM,

NASA JPL


23



Healthcare I

Non-invasive technique Both visible and NIR, can see into body “~700-900nm window “ Examples:

Skin Cancer Wound Healing

Many studies use limited numbers of patients University of Leicester has set up a Non-Invasive Diagnostics Development Unit (DDU) in conjunction with Leicester Royal Infirmary and Local NHS Trust to pursue start of the art techniques including hyper-spectral (visible) Based in accident and emergency resuscitation bay Want to look at real clinical use

Hyperspectral Applications:XII

Image Courtesy University of Leicester DDU


24



Healthcare: II

Initial Study 500 patients 20 most common presenting complaints e.g. breathlessness, chest pain No hyper-spectral, but TIR Applying for ethics approval for hyper-spectral work Initial planned studies: Kidney, Liver, Bruising, Skin Lesions Data shows blood distribution using a multi-spectral imager

Hyperspectral Applications: XIII

Background

Signal

Image Courtesy University of Leicester DDU


25


Space Research Centre Copyright M.R. Sims 2012 Healthcare: III

Hyperspectral Applications: XIV

Diagnostic Development Unit Equipment

Image Courtesy University of

Leicester DDU


26



General Remarks Hyper-spectral imaging is a growing area Many applications, an ever growing list Many companies related to topic now in existence: hardware, data processing and

applications Costs are reducing and it is no longer just a research or defence/security tool IR hyperspectral remains comparatively expensive Data processing can be an issue Understanding the data is needed by the user – skilled expertise may still be

needed in many applications to process and interpret the data Need other data to complement data obtained from hyper-spectral

The Future Development of further applications Growth of field and companies associated with it

Concluding Remarks


27



Photonex 2012 for hosting this event Prof. Steve Marshall, Gilden Photonics Ltd. and Photonex for the invite You for attending Various companies, institutes as credited on slides for images and information University of Leicester My contact details are e-mail: [email protected] , tel: 0116 2523513

Please enjoy the Conference and Visit the Exhibitors Stands

Thank You for Listening

Acknowledgements