Intelligent Signal Processing - Technical University of ...cogsys.imm.dtu.dk › presentation › isppre.pdf · Informatics and Mathematical Modelling / Intelligent Signal Processing

Informatics and Mathematical Modelling / Intelligent Signal Processing

1Jan Larsen

Intelligent Signal ProcessingJan LarsenInformatics and Mathematical ModellingTechnical University of DenmarkWeb: isp.imm.dtu.dk

http://isp.imm.dtu.dk/nnsp2002

http://isp.imm.dtu.dk/nnsp2002

Jan Larsen 2


DTU FactsIndependent state university since January 1st, 2001Annual budget 1382 million DKK or 186 million EuroExternal research finances account for 35%1027 faculty/academic staff members, 948 technical and administrative staffOrganized in 15 departments1500 B.Sc., 4300 M.Sc., 500 Ph.D., and 500 international students380 courses in English, 10 international M.Sc. programs

Jan Larsen 3


DTU FactsLocated in Lyngby 10km (6.3miles) north of CopenhagenMore than 80 buildingsTotal floorage of about 375,000 m2 (3.3million ft2)Campus size 1500m from North to South, 850m from East to West (0.9 by 0.5 miles)

Jan Larsen 4


IMM86 faculty members32 administrative staff members60 Ph.D. students70 M.Sc. students annually6000 students follow an IMM course annually

Jan Larsen 5


Competences and Research at IMM

image processing and graphical communication

software engineering

data safety

knowledge-based systems

networks and distributed systems

embedded systemsmathematical physics

mathematical statistics

geoinformatics

operations research

intelligent signal processing integrated circuits and digital system

numerical analysis

programming languages

Jan Larsen 6


ISP Group Activities

HumanitarianDemining

Monitor Systems

Biomedical

Neuroscience

Multimedia

MethodsAlgorithms

•3 faculty•3 post docs•11 Ph.D. students•10 M.Sc. students

•3 faculty•3 post docs•11 Ph.D. students•10 M.Sc. students

Jan Larsen 7


Research Projects1991-2001 CONNECT: fundamental research in neural networks and adaptive systems1997-2001 DMM: Distributed Multi Media research program1998-2001 THOR Center for Neuroinformatics1996-1999 Interdisciplinary Neuroscience Initiative - neuroimagingcollaboration in Copenhagen1999-2002 SITE: signal and image processing methods for telemedicine2002-2006 International Center for Biomedical Research, minor contribution to EEG/pain studies.1997-2004 HBP: Human Brian Project - tools for analysis of brain scans2000-2003 MAPAWARMO - EU5FP project on mapping visual cortical regions in awake, behaving monkey using functional MRI2002-2005 AE-WATT - EU5FP project on neural network and adaptive processing for monitoring and control of large diesel engines1997- Humanitarian Demining Laboratory (HDL)

Jan Larsen 8


Network

IEEE Neural Networks for Signal Processing technical committeeCopenhagen Signal and Image Processing Graduate school (CISP)Copenhagen Brain Research CenterNordic Demining Research ForumEuropean partners through more 6th EU FP LoI’s

Jan Larsen 9


How do we colaborate

Master thesis projectsPh.D. projects funded by DTUIndustrial Ph.D. projectsResearch projects funded by Danish research councils / EUCommissioned research and developmentSpecial designed competence development courses

Jan Larsen 10


Competences in signal processing

adaptive

statistical

nonlinear

machine learning bayesian

pattern recognition

data and webmining

Learning

Jan Larsen 11


Methods and AlgorithmsTheory

Bayesian learningMean field methodsUnsupervised/supervised and combined learningClassification/regressionModel selectionNonstationary modelingDatafusionGeneralization Outlier detectionRobust modelingActive learning

ModelsNeural networksRelevance vector machinesIndependent Component AnalysisTime-series modelsGraphical ModelsGaussian ProcessesMixture models

Jan Larsen 12


Our modeling approach

Model Selection

Validation Learning

Prior knowledgeand data

Jan Larsen 13


Learning Based Modeling

⋅| , )up(y x w ( | )up x w

Measurements

Parameters

Labels

Unsupervised

Learning

Supervised

LearningLearning joint probability

Jan Larsen 14


Supervised LearningSelection of model familyPreprocessingA priori knowledge constraints/probabilisticLearning (ML,MAP,Bayes)Active learning Outlier detection– Erroneous label– Unknown label

Model structure optimizationPerformance issues– Generalization– Confidence– ROC curves– Confusion matrices– Reproducibility

Visualization/interpretation– Importance analysis

( | , )sp y x w

Jan Larsen 15


Unsupervised LearningIdentification of structure, e.g. clustersCan be used as preprocessing in combination with supervised learningMethods– ICA– Probabilistic clustering using

RBF neural networks

Novelty detection –identification of new clustersHierarchical clustering

( | )up x w

Jan Larsen 16


NeuroscienceAnalysis of EEG, PET, MRI, fMRI imagesLyngby ToolboxWeb repository hendrix.imm.dtu.dk

Programs: CBRC, HBP, EU-BIOMED II, EU-TMR, EU, Res.Counc., INC, NIH

Jan Larsen 17


MultimediaAdaptive tools for sharedvirtual environmentsReal time multi-modal communicationTools for intelligent mobile phones (CDMA)Sound processingWebmining(content,structure,usage)

Programs: Center for Multimedia, DMM

Jan Larsen 18


Humanitarian DeminingHumanitarian Demining Lab (Ørsted•DTU,IMM,FOFT)– Detection and clearance of

mines– Quality control and clearance

validation– Socio-economical decision

support systems– Resource management systems

Nordic Demining Research ForumNew EU 6FP EoIs

Jan Larsen 19


Monitor SystemsSupervision and fault-diagnosis of marine enginesNeural optimization of pulse plating in print circuit boardsMonitoring of power distribution networksMulti-channel adaptive analysis of revolving machinesAdaptation of mobile base station filters

Program: AE-WATT

Jan Larsen 20


BiomedicalSun exposure modelingSkin cancer diagnosisBioinformatics

5001000150020002500300035000.01

0.015

0.02

0.025

0.03

0.035

0.04

0.045

A B

B

C

DE

F

G

Sensitivity

wavenumber/cm-1

Program: Signal and Image Processing for Telemedicine

Documents

Intelligent Signal Processing - Technical University of ...cogsys.imm.dtu.dk › presentation › isppre.pdf · Informatics and Mathematical Modelling / Intelligent Signal Processing