Applications of Spectral Color Research

Markku Hauta-Kasari

PhD, DocentDirector of InFotonics Center JoensuuUniversity of Eastern FinlandJoensuu campusP.O.Box 111, FI-80101 Joensuu, FINLAND

VIPP Symposium 2010, Aalto University, January 21, 2010

Contents

Introduction InFotonics Center Joensuu – concept Spectral imaging systems Case examples of spectral color related

industrial applications Research projects and project funding examples Conclusions

Introduction In this talk, applied research results related to

spectral color will be presented

Talk is focused to industrial applications

Case studies have been realized in InFotonics Center Joensuu, which is the research center in the field of photonics and spectral color research at the University of Eastern Finland

University of Joensuu Color GroupLeadersProf. Timo Jääskeläinen Prof. Jussi Parkkinen

Spectral measurementsDr. Jouni Hiltunen Dr. Jarkko MutanenDr. Martti MäkinenM.Sc. Jussi Kinnunen

M.Sc. Students10

Spectral color analysisDr. Markku Hauta-Kasari Dr. Birgitta MartinkauppiDr. Hannu LaamanenDr. Oili KohonenDr. Juha LehtonenDr. Joni OravaM.Sc. Jukka AntikainenM.Sc. Alexey AndriyashinM.Sc. Pauli FältM.Sc. Ville HeikkinenM.Sc. Tuija JetsuM.Sc. Pesal KoiralaM.Sc. Konstantin KrasavinM.Sc. Hongyu LiM.Sc. Paras Pant M.Sc. Elina RäisänenM.Sc. Masayuki Ukishima

InFotonics Center Joensuu

Established in 2003 at the University to generate new openings with industrial partners

A core strategy: research center in the field of optics and spectral

color research research collaboration with other scientific

organizations and high technology companies

Optics Research- Since 1970, from holography to diffractive optics

Spectral Color Research- Group started in the middle of 1980’s- Joint group of the Physics and Computer Science

• Long-term research background and internationally known groups

Industrial cooperation expanded → Need for the research center→ InFotonics Center started on September 2003

Background

Optics and Spectral Color in Joensuu, FINLAND

University of Joensuu• optics group ~ 70• spectral color group ~ 25• InFotonics Center ~ 10

Joensuu Science Park

Optoinspection Ltd2003

Nanocomp Ltd1997

~ 100 SPECIALISTSIN THE FIELD OF OPTICS AND

SPECTRAL COLOR

SoftColor Ltd2005

MGM-Devices Ltd2005

InFotonics Center’s activities

Reseach cooperation with other scientific organizations and services for high technology companies

Applied research projects Measurement services Feasibility studies Concept development

Financiers of InFotonics CenterFunding for years 2003 – 2009 ~ 5 milj. euros

The EU social fund and structural fund- State Provincial Office of Eastern Finland- Employment and Economic Development Centre of Joensuu- The Regional Council of North Karelia

Euregio Karelia Neighbourhood Programme (Interreg) and TEKES (Finnish Funding Agency for Technology and Innovation)

City of Joensuu Joensuu Regional Development Company, JOSEK Ltd Funding from industry

Spectral Imaging Systems

Spectral Imaging Systems at the Color Research Laboratory Filter based system

Nuance LCTF visible (by CRI) Nuance LCTF visible + NIR (by CRI)

Line scanning based spectral imaging systems ImSpector V8 ImSpector V10E ImSpector N17E ImSpector UV ImSpector IR

Capturing Spectral Image

Spectral Image Structure

Spectral scanning LCTF Interference

filter, etc.

Spatial scanning ImSpector

Illuminator

Spectral camera

Sample holder and XY-table

Software for spectral camera

Presenter

Presentation Notes

Different type of spectra than in the previous image. Note! Less noisy component images.

Case studies

Examples are focused to industrial applications

1. Plastics industry2. Optimizing color images for displays3. Fluorescence for biophotonics4. Spectral based fundus imaging5. Paper and printing industry6. Digital museum exhibition

Case 1: Application for quality control of plastics products

Case 2: Metameric color reproduction

Application for industrial product presentation

Display Characteristics

IMAGE OF ORIGINAL SAMPLE

IMAGE OF SRGB-REPRODUCTION

ON CRT DISPLAY

IMAGE OF METAMERICCOLOR REPRODUCTION

ON CRT DISPLAY

Examples for CRT and LCD displays

Spectral based Optimization of Screen Images for Industrial Product Presentation

Lari Härkönen, Birgitta Martinkauppi, Hannu Laamanen, Markku Hauta-KasariInFotonics Center

Department of Computer Science, Department of PhysicsUniversity of Joensuu, FINLAND

Petri Huhtelin, Pekka HorttanainenTulikivi Corporation, FINLAND

Electronic Imaging, San Jose, 2006

Case 3: Fluorescence for biophotonics

Example of fluorescent colors

Optical setup for bispectrometer

Optical setup for bispectrometer

Fluorescent standard samples

Fluorescence analysis

Fluorescence analysis

Applications

Paper Industry Safety Industry Textile Industry

Biological Geological Medicine

Case 4: Spectral Fundus Imaging

Examples

458 nm 550 nm 694 nm

Inner product images. Upper row PCA, lower row ICA.

Case 5 : Paper and printing industry

Application for quality control of printed products The reclamation cases were analyzed for the

company

Customer had selected the printing quality by the pre-print, however, the final print was not satisfactory

The color differences under different illuminations were simulated by spectral color technologies

Comparison between pre-print and print

pre-print print

color difference

Spectral properties of printing inks

Visualization of color gamuts: same paper, different ink set used

Spectral analysis of printing dots

Case 6: Digital Museum Exhibition

Shades of Colors –Digital Museum Exhibition

Location:

North-Karelian Museum, Carelicum, Joensuu, FINLAND

http://digimuseo.joensuu.fi

Shades of Colors exhibition

Dates: January 25 – September 2, 2007

Location: North-Karelian Museum, Carelicum, Joensuu, FINLAND

Organizers: North-Karelian Museum University of Joensuu, InFotonics Center Joensuu North-Karelian Polytechnic National Museum of Japanese History, JAPAN

(Kokuritsu Rekishi Minzoku Hakubutsukan, Rekihaku)

Lecture serie January 24, 2007, Wed., at 6 pm.

Auditorium in Carelicum, Torikatu st. 21 C, JoensuuDr. Kimiyoshi Miyata, National Museum of Japanese History, Japan ”Welcome words”Professor Jussi Parkkinen, University of Joensuu, Finland, ”Opening lecture”

February 7, 2007, Wed., at 7 pm. Auditorium Louhela, Science Park, Länsikatu st. 15, Joensuu Professor Shigeki Nakauchi, Toyohashi Technical University, Japan"Psychophysical color research"The lecture will be interpreted from English into Finnish. After the lecture, the public is invited to acquaint themselves with the research laboratory of the color research group of the University of Joensuu.

February 28, 2007, Wed., at 6 pm. The Art Museum of Joensuu, Kirkkokatu st. 23Instructor Harald Arnkil, University of Art and Design Helsinki"Väri taiteen ja tieteen yhtymäkohtana" (Color as a point of contact between art and science) The lecture will be delivered in Finnish.

March 21, 2007, Wed., at 6 pm.Auditorium in Carelicum, Torikatu st. 21 C, JoensuuProfessor Göte Nyman, University of Helsinki"Värin subjektiivisen kokemuksen mittaaminen" (Measuring the subjective experience of color) The lecture will be delivered in Finnish.

March 25, 2007,Sun., at 2 pm. Auditorium in Carelicum, Torikatu st. 21 C, JoensuuDirector Markku Hauta-Kasari, InFotonics Center Joensuu"Mitä värit ovat" What colors are ?

April 25, 2007, Wed., at 6 pm. Auditorium Louhela, Science Park, Länsikatu 15, Joensuu Professor Fernando Fermi, University of Parma, Parma, Italy"Color technology in study of paintings" The lecture will be interpreted from English into Finnish.

Internet-connections

http://digimuseo.joensuu.fi

Skype: digimuseo

Internet based Feedback-system

Web-camera broadcast

Acknowledgements for Digital Museum Exhibition Finnish Cultural Foundation

Collaborators:

Dr. Kimiyoshi Miyata, Rekihaku, Japan Mr. Sawada, Rekihaku, Japan Dr. Norimichi Tsumura, Chiba University, Japan Mr. Ochiai, Chiba University, Japan Prof. Shigeki Nakauchi, Toyohashi University of Technology Itoh Optics, Japan Riikka Räisänen, Department of Home Economics and Craft Science,

University of Helsinki Olli Ronkainen, North Karelia Polytechnic Kerttu Kalteinen, artisan Päivi Hintsanen, coloria.net

Example of the plastics component, in which three different nanostructures are written.

• We can design and manufacture thiskind of components for massproduction

Recycling marks

Applications

Diffractive beam splitters Divide light into diffraction

orders Used in machine vision,

optical communication,… Continuous, binary, and

multilevel structures

Applications: gratings for spectrometers and spectral cameras

Massproduction:Nanocomp Ltd. Joensuu, Finland

Examples of recent applied research projects NaarMu – Nanostructures into mold, Tekes, 2005-2007

Aktiva – Injection moulding of active materials, Tekes, 2005-2006

NEMO, Network of Excellence on Micro-Optics, EU 6. framework programme, 2004 -2008

Haiku - Managing High-Quality Image Material in Evolving Media, Tekes, Joint project with the University of Helsinki, Toyohashi University of Technology, Chiba University, Nokia, M-real), 2003-2006

HIPROLA - Spectral based monitoring of laser welding, Tekes, joint project with the Lappeenranta University of technology, (Companies:Daimler-Chrysler, Precitec, Kemppi Ltd. , Gasmet Ltd., Specim Ltd.), 2004-2007

Future Steel Frontages – Tekes, Rautaruukki (Other parties: InFotonics Center, Hämeenlinna Polytechnic, TopAnalytica Ltd.), 2006-2008

ImageRet – Machine Vision for Retinal Image Analysis – Tekes, Lappeenranta University of Technology, (Other parties: University of Kuopio, InFotonics Center, Imperial College London, YTI Research Center Mikkeli, Kuomed Oy, Perimetria Oy, Santen Oy, VAS Oy), 2006.

Tekes = Finnish Funding Agency for Technology and Innovation

Digital museum concept development – joint project with North Carelian museum, North Carelian Polytechnic, and National Museum of Japanese History, grant from the Finnish Cultural Foundation 2006-2008.

InFotonics Center Joensuu – knowledge and technology transfer development, Tekes – Euregio Karelia Neighbourhood Programme (Cooperating Universires: St. Petersburg State Technical University, Russia, St. Petersburg State University, Russia, Petrozavodsk State University, Russia, Companies: PunaMusta, M-real, Stora Enso, Metso Paper, Mäntsälän saha), 2005-2007

Papvision – Paper Printability Inspection Using Machine Vision, Tekes, Lappeenranta University of Technology, (Other Parties: Stora Enso, Metso Paper, UPM-Kymmene, Myllykoski Paper, Future Printing Center, Labvision Technologies, InFotonics Center) 2006

RedWood, - Wood humidity analysis by spectral color technique - Tekes, MILA Kajaani, (Other Parties: InFotonics Center, Mecano Group, Valutec, UPM-Kymmene Wood), 2006-2007

ImageRet2 – Optimal Detection and Decision – Support Diagnosis of Diabetic Retin Opathy, Tekes, Joint project of Lappeenranta University of Technology, InFotonics Center, University of Kuopio, (Other parties: Imperial College London, YTI Research Center Mikkeli, Kuomed Oy, Mawell Oy, Perimetria Oy, Santen Oy, VAS Oy), 2007-2009.

AKO – Aluekeskuohjelma-toimenpide: Fotoniikka ja spektrinen väritutkimus pk-yritysten tuotekehityksen tueksi – selvitykset ja kartoitukset , Joensuun seudun kehittämisyhtiö, JOSEK, 2007 – 2009

. DIME – Direct color marking of metal surfaces by fibrelaser – Tekes, VTT, IFC, (Other parties: Iittala Group, Kone, Nanofoot Finland, Nokia, Savcor

Alfa), 2007-2009.

Highresolution remote sensing to measure single trees, Academy of Finland, University of Joensuu, Facultu of Forestry, InFotonics Center, 01.01.2008–31.12.2011

Aging Macula, Tekes (Pharma-technology program), Joint project with University of Kuopio, (Other parties: InFotonics Center, Joensuu Santen, Novartis Finland Oy, Santen Oy, Duallaser Oy, CNServices Oy), 2008 –2010.

Optical sensor technology in applications of medical physics and medical technology,Start-up project for the University of Eastern Finland, 2007-2010.

Tools for simulation of color in digital prints, MittUniversitet, Sweden, (Other parties: M-real, Agfa, MoRe, Stora Enso, Lorentzen-Wettre, StFi, Daus, InFotonics Center) – research project, 2007 - 2009

Mitsubishi Paper Mills – Chiba University- InFotonics Center,researcher exchange, 2007 – 2009

Qvision – Imaging techniques in paper industry, ForestCluster Ltd, (SHOK) consortium project with several universities, 2009-2010.

Company projects Research project: IFC - Samsung Advanced Institute of Technology (SAIT), Korea, 2005-2006

Research project: IFC – CPS Color, 2006

Research project: IFC – KCL, 2006-2007, 2009

Research project: IFC – WinGlobal Technology Inc. (Taiwan), 2006

Research project: IFC – DENSO CORPORATION (Japan), 2007-2008

Research project: IFC – Upload Image Processing Ltd., 2007

Research project IFC – MGM Devices Oy, 2008

Research project IFC – UPM Kymmene, 2007-2010

Research project IFC – Medisize Corporation, 2009

In addition, 40 short term feasibility studies and concept developments for industry since 2003 Perlos 8, Nanocomp 2, M-real 8, Nokia 2, Tameye 4, Turun Sarjatuote 1, Exel 2, Tulikivi 1, Metso Paper 1, Rautaruukki 1, Mastsystems Int’l 1,

Moventas 1, Specim 1, ColoChrome 2, Kemira 1, Aduser Oy 2, Pohjois-Karjalan eMaakunta 1, Joensuun Tiedepuisto, network Oasis, FlexLab 1

International industrial co-operation Samsung Advanced Institute of Technology, Korea Daimler-Chrysler, Germany Precitec, Germany Winglobal, Taiwan DENSO CORPORATION, Japan Mitsubishi Paper Mills, Japan Exel, Belgium Agfa, Sweden M-real, Sweden StFi, Sweden Lorentzen-Wettre, Sweden Daus, Sweden Stora Enso, Sweden

International cooperation

Research co-operation since 1988 with Japanese research groups, totally over 25 researcher years:

Chiba University, Japan Toyohashi University of Technology, Japan Saitama University, Japan Nara Institute of Science and Technology, Japan Tokyo Institute of Technology, Japan National Museum of Japanese History, Japan

Other international cooperation

Fudan University, China Kyungpook National University, Korea Rochester Institute of Technology, USA St. Petersburg State Polytechnical University, Russia St. Petersburg State University, Russia Petrozavodsk State University, Russia Linköping University, Sweden

Erasmus-Mundus ”Color in Informatics and Media Technology” master programme

University of Joensuu University of Saint-Etienne, France Gjovik University College, Norway University of Granada, Spain

Conclusions The advantages of the spectral color based systems

are that the most accurate color representation is acquired and it can then be filtered for specific purposes, such as for displaying the color characterized image.

The final sensor optimized to specific spectral wavelengths can be designed according to the results from high-dimensional spectral analysis

Due to the technical development of spectral imaging systems, they are becoming more and more possible to be used in industrial applications, for example, on online quality control applications.

AcknowledgementsJoensuu Color Group

LeadersProf. Timo Jääskeläinen Prof. Jussi Parkkinen

Spectral measurementsDr. Jouni Hiltunen Dr. Jarkko MutanenDr. Martti MäkinenM.Sc. Jussi Kinnunen

M.Sc. Students10

Spectral color analysisDr. Markku Hauta-Kasari Dr. Birgitta MartinkauppiDr. Hannu LaamanenDr. Oili KohonenDr. Juha LehtonenDr. Joni OravaM.Sc. Jukka AntikainenM.Sc. Alexey AndriyashinM.Sc. Pauli FältM.Sc. Ville HeikkinenM.Sc. Tuija JetsuM.Sc. Pesal KoiralaM.Sc. Konstantin KrasavinM.Sc. Hongyu LiM.Sc. Elina RäisänenM.Sc. Masayuki Ukishima

Acknowledgements: University of Joensuu Color Group, InFotonics Center Joensuu,our research and industrial partners

More Information

http://ifc.joensuu.fi

Email: info@ifc.joensuu.fi

Acknowledgements: Joensuu Color Group, InFotonics Center Joensuu,our research and industrial partners