38
National Institute of Technology Jamshedpur Digital Imaging Processing (CS705) Department of Computer Science and Engineering

Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Digital Imaging Processing (CS705)

Department of Computer Science and Engineering

Page 2: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Instructor

Dr. Koushlendra Kumar Singh

Assistant ProfessorDepartment of Computer Science and Engineering

NIT JamshedpurCan catch at : Room No. SA-09

mail at: [email protected]: [email protected]

Page 3: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 3

Evaluation Pattern

1. End Semester and Mid semester as per Institute rule 2. Teacher Assessment will divided as follows

a) Unit Project : At the end of each unit student have to implement one small project (Total- 10 marks)

b) Course project: After mid semester each group (3 students) have toimplement a course project and every group have topresent the work. (10 marks)

c) Quiz, Involvement in class and Attendance – 10 marks

Page 4: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 4

Pre-requisites of the course

Basic concept of signal processing

High school mathematics

C/C++ programming skill, MatLab, Python etc

Probabilistic Methods

Basics of calculus

matrix and determinant

Page 5: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 5

Course Plan

Introduction to Image Processing

Image Processing and related field, Fundamental Steps in DIP, Components of an Image Processing System

Classification of Image Processing operationsDetails of Image processing operations, , basic relationship, distance metrics, Arithmetic Operations, Logical operation, Set operation, Statistical Operation, Sampling and Quantization

Intensity Transforms and Spatial filteringBackgrounds, basics of intensity transforms and spatial filtering, Intensity transform function, Image negative, Histogram processing for image enhancement, Smoothing spatial filters, The Laplacian, The Gradient,

Filtering in the frequency domainHotelling Transform, Fourier Transforms and properties, FFT (Decimation in Frequencyand Decimation in Time Techniques), Convolution, Correlation, 2-D sampling, Discrete CosineTransform, Frequency domain filtering

Wavelet and Mutiresolution ProcessingExpansion of functions, Multi-resolution analysis, Scaling functions, MRA refinement equation, Wavelet series expansion, Discrete Wavelet Transform (DWT), Continuous Wavelet Transform,

Page 6: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 6

Image restoration

Introduction to various noise models, restoration in presence of noise only, periodic noise

reduction, linear and position invariant degradation, estimation of degradation function

Mathematical morphology

Erosion and dilation, opening and closing, the Hit-or-Miss transformation, various

morphological algorithms for binary images

Image restoration

Introduction to various noise models, restoration in presence of noise only, periodic noise

reduction, linear and position invariant degradation, estimation of degradation function

Wavelets and multiresolution processing

Image pyramids, subband coding, multiresolution expansions, the Haar transform, wavelet

transform in one and two dimensions, discrete wavelet transform

Page 7: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 7

Course materials/ Text book/ Reference book

Gonzalez, R. C. and Woods, R. E., "Digital Image Processing", Prentice Hall, 3rd Ed.

Jain, A. K., "Fundamentals of Digital Image Processing", PHI Learning, 1st Ed.

Bernd, J., "Digital Image Processing", Springer, 6th Ed.

Scherzer, O., " Handbook of Mathematical Methods in Imaging", Springer

Burger, W. and Burge, M. J., "Principles of Digital Image Processing", Springer

Digital Signal Processing by Prof. P.K. Biswas Multi rate signal Processing by Prof. V. M. Gadre

The instructor will also provide the slides of course.

Page 8: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

What is digital image processing???

Need of digital Image processing

Applications of digital Image Processing

One of the earliest applications of digital image was in the newspaper industry.

First pictures were sent by submarine cable between Londan and New York in 1920s.

Page 9: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 9

Page 10: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 10

Page 11: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 11

Page 12: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 12

Page 13: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 13

Page 14: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 14

Page 15: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 15

Image Acquisition Process

Page 16: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 16

Introduction

What is Digital Image Processing?

Digital Image— a two-dimensional function

x and y are spatial coordinates

The amplitude of f is called intensity or gray level at the point (x, y)

Digital Image Processing— process digital images by means of computer, it covers low-, mid-, and high-level processes

low-level: inputs and outputs are images

mid-level: outputs are attributes extracted from input images

high-level: an ensemble of recognition of individual objects

Pixel— the elements of a digital image

( , )f x y

Page 17: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 17

A Simple Image Formation Model

( , ) ( , ) ( , )

( , ) : intensity at the point ( , )

( , ) : illumination at the point ( , )

(the amount of source illumination incident on the scene)

( , ) : reflectance/transmissivity

f x y i x y r x y

f x y x y

i x y x y

r x y

at the point ( , )

(the amount of illumination reflected/transmitted by the object)

where 0 < ( , ) < and 0 < ( , ) < 1

x y

i x y r x y

Page 18: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 18

Some Typical Ranges of Reflectance

Reflectance

0.01 for black velvet

0.65 for stainless steel

0.80 for flat-white wall paint

0.90 for silver-plated metal

0.93 for snow

Page 19: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 19

Image Sampling and Quantization

Digitizing the coordinate values

Digitizing the amplitude values

Page 20: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 20

Image Sampling and Quantization

Page 21: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 21

Representing Digital Images

The representation of an M×N numerical array as

(0,0) (0,1) ... (0, 1)

(1,0) (1,1) ... (1, 1)( , )

... ... ... ...

( 1,0) ( 1,1) ... ( 1, 1)

f f f N

f f f Nf x y

f M f M f M N

Page 22: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 22

Representing Digital Images

► The representation of an M×N numerical array as

0,0 0,1 0, 1

1,0 1,1 1, 1

1,0 1,1 1, 1

...

...

... ... ... ...

...

N

N

M M M N

a a a

a a aA

a a a

Page 23: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 23

Representing Digital Images

►The representation of an M×N numerical array in MATLAB

(1,1) (1,2) ... (1, )

(2,1) (2,2) ... (2, )( , )

... ... ... ...

( ,1) ( , 2) ... ( , )

f f f N

f f f Nf x y

f M f M f M N

Page 24: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 24

Representing Digital Images

► Discrete intensity interval [0, L-1], L=2k

► The number b of bits required to store a M × N digitized image

b = M × N × k

Page 25: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Weeks 1 & 2 25

Representing Digital Images

Page 26: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

What is a Digital Image? (cont…)

►Common image formats include: 1 sample per point (B&W or Grayscale)

3 samples per point (Red, Green, and Blue)

4 samples per point (Red, Green, Blue, and “Alpha”, a.k.a. Opacity)

►For most of this course we will focus on grey-scale images

Page 27: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Image processing

► An image processing operation typically defines a new image g in terms of an existing image f.

► We can transform either the range of f.

► Or the domain of f:

► What kinds of operations can each perform?

Page 28: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

What is DIP? (cont…)►The continuum from image processing to computer vision can be broken up into low-, mid- and high-level processes

Low Level Process

Input: ImageOutput: Image

Examples: Noise removal, image sharpening

Mid Level Process

Input: Image Output: Attributes

Examples: Object recognition, segmentation

High Level Process

Input: Attributes Output:Understanding

Examples: Scene understanding, autonomous navigation

Page 29: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Key Stages in Digital Image Processing

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Page 30: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Image Acquisition

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image CompressionIm

ages

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 31: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Image Enhancement

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Images

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 32: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Image Restoration

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Images

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 33: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Morphological Processing

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Images

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 34: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Segmentation

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Images

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 35: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Object Recognition

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Images

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 36: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Representation & Description

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Images

taken f

rom

Gonza

lez

& W

oods,

Dig

ital Im

age P

roce

ssin

g (

2002)

Page 37: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Image Compression

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression

Page 38: Digital Imaging Processing (CS705) · Department of Computer Science and Engineering. National Institute of Technology Jamshedpur Instructor Dr. Koushlendra Kumar Singh ... Unit Project

National Institute of Technology Jamshedpur

Colour Image Processing

Image Acquisition

Image Restoration

Morphological Processing

Segmentation

Representation & Description

Image Enhancement

Object Recognition

Problem Domain

Colour Image Processing

Image Compression