44
DCSP-1: Introduction Jianfeng Feng

DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK [email protected]

Embed Size (px)

Citation preview

Page 1: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

DCSP-1: Introduction

Jianfeng Feng

Page 2: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

DCSP-1: Introduction

Jianfeng Feng

Department of Computer Science Warwick Univ., UK

[email protected]

Page 3: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

DCSP-1: Introduction

Jianfeng Feng

Department of Computer Science Warwick Univ., UK

[email protected]

http://www.dcs.warwick.ac.uk/~feng/dcsp.html

Page 4: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Time

• Tuesday (L) 11.00 –- 12.00 CS1.01

• Wednesday (L) 12.00 —13.00 room R1.13

• Thursday (S) 12.00 -- 1.00 CS1.01

From this week, seminar starts

   Tian Ge

Page 5: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Jianfeng Feng(冯建峰 )• http://www.youtube.com/watch?v=hvSgw50bc4I

Treat female vs male as health vs patients

• http://edition.cnn.com/2011/10/04/health/depressed-brains-hate-differently/index.html

Page 6: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Computational Biomedicine: Big Data

• Find a needle in a haystack

• New York Times article

Page 7: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Computational Biomedicine: Big Data

• Find a needle in a haystack

• New York Times article

• This module is all about data data data

Page 8: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Announcement for Seminars

1. DCSP seminars (to cover DCSP tutorial problems) start in Week 2.

2.  Students need only attend one seminar per week.

Page 9: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Assignment

The DSP assignment coursework will be issued in Week 4

The coursework is worth 20% of the  module assessment and the submission deadline is 12 noon on Thursday Week 10 (i.e., 14th March 2013).

Page 10: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

References

• Any good book about digital communications and digital signal processing

Page 11: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

References

• Any good book about digital communications and digital signal processing

• Wikipedia, the free encyclopedia

Page 12: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

References

• Any good book about digital communications and digital signal processing

• Wikipedia, the free encyclopedia

• Lecture notes is available at

http://www.dcs.warwick.ac.uk/~feng/teaching/dcsp.html

Currently I am working on a new version (added materials) to cover some modern topics including wavelet and Kalmann filter etc.

Page 13: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• This module is one of the hardest in our dept. since it heavily relies on math

Page 14: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• This module is one of the hardest in our dept. since it heavily relies on math

• As usual, the harder the module is, the more useful it will be.

Page 15: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• This module is one of the hardest in our dept. since it heavily relies on math

• As usual, the harder a module is, the more useful it will be.

• Would be a big, big mistake if you miss too many lectures

Page 16: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Introduction

Movie, music, sound

Page 17: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Detect what you are thinking Now?

Using Fourier Transform

Page 18: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

The information carrying signals are divided into two broad classes

• Analog

• Digital

Page 19: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Analog Signals Analog signals are continuous electrical signals that

vary in time as shown below.

Most of the time, the variations follow that of the non-electric (original) signal.

The two are analogous hence the name analog.

Page 20: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Example:

Telephone voice signal is analog.

The intensity of the voice causes electric current variations.

At the receiving end, the signal is reproduced in the same proportion.

Page 21: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Digital Signals

Digital signals are non-continuous, they change in individual steps.

They consist of pulses or digits with discrete levels or values.

The value of each pulse is constant, but there is an

abrupt change from one digit to the next.

The values are anywhere within specific ranges and we define values within a given range.

Page 22: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Digital Signals

Page 23: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Advantages

The ability to process a digital signal means that errors caused by random processes can be detected and corrected.

Digital signals can also be sampled instead of continuously monitored and multiple signals can be multiplexed together to form one signal.

Page 24: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Because of all these advantages, and because recent advances in wideband communication channels and solid-state electronics have allowed scientists to fully realize these advantages, digital communications has grown quickly.

Digital communications is quickly edging out analog communication because of the vast demand to transmit computer data and the ability of digital communications to do so.

Page 25: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Summary

Page 26: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• Data transmission: Channel characteristics, signalling methods, interference and noise, synchronisation, data compression and encryption;

Page 27: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• Data transmission: Channel characteristics, signalling methods, interference and noise, synchronisation, data compression and encryption;

• Information Sources and Coding: Information theory, coding of information for efficiency and error protection;

Page 28: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• Data transmission: Channel characteristics, signalling methods, interference and noise, synchronisation, data compression and encryption;

• Information Sources and Coding: Information theory, coding of information for efficiency and error protection;

• Signal Representation: Representation of discrete time signals in time and frequency; z transform and Fourier representations; discrete approximation of continuous signals; sampling and quantisation; stochastic signals and noise processes;

Page 29: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• Data transmission: Channel characteristics, signalling methods, interference and noise, synchronisation, data compression and encryption;

• Information Sources and Coding: Information theory, coding of information for efficiency and error protection;

• Signal Representation: Representation of discrete time signals in time and frequency; z transform and Fourier representations; discrete approximation of continuous signals; sampling and quantisation; stochastic signals and noise processes;

• Filtering: Analysis and synthesis of discrete time filters; finite impulse response and infinite impulse response filters; frequency response of digital filters; poles and zeros; filters for correlation and detection; matched filters;

Page 30: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• Data transmission: Channel characteristics, signalling methods, interference and noise, synchronisation, data compression and encryption;

• Information Sources and Coding: Information theory, coding of information for efficiency and error protection;

• Signal Representation: Representation of discrete time signals in time and frequency; z transform and Fourier representations; discrete approximation of continuous signals; sampling and quantisation; stochastic signals and noise processes;

• Filtering: Analysis and synthesis of discrete time filters; finite impulse response and infinite impulse response filters; frequency response of digital filters; poles and zeros; filters for correlation and detection; matched filters;

• Digital Signal Processing applications: Processing of images using digital techniques.

Page 31: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Starting starting…..

Page 32: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Data Transmission1.1 General Form

Page 33: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

• A modulator that takes the source signal and transforms it so that it is physically suitable for the transmission channel

• A transmitter that actually introduces the modulated signal into the channel, usually amplifying the signal as it does so

• A transmission channel that is the physical link between the communicating parties

• a receiver that detects the transmitted signal on the channel and usually amplifies it (as it will have been attenuated by its journey through the channel)

• A demodulator that receives the original source signal from the received signal and passes it to the sink

Page 34: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Digital data is universally represented by strings of 1s or 0s.

Each one or zero is referred to as a bit.

Often, but not always, these bit strings are interpreted as numbers in a binary number system.

Thus 1010012=4110.

The information content of a digital signal is equal to the number of bits required to represent it.

Thus a signal that may vary between 0 and 7 has an information content of 3 bits.

Page 35: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Written as an equation this relationship is

I= log2(n) bits

where n is the number of levels a signal may take.

It is important to appreciate that information is a measure of the number of different outcomes a value may take.

The information rate is a measure of the speed with which information is transferred. It is measured in bits/second or b/s.

Page 36: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Examples Audio signals. An audio signal is an example of an analogue signal.

It occupies a frequency range from about 200 Hz to about 15KHz.

Speech signals occupy a smaller range of frequencies, and telephone

speech typically occupies the range 300 Hz to 3300 Hz..

The range of frequencies occupied by the signal is called its

bandwidth.

Page 37: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

A signal is bandlimited if it contains no energy at frequencies higher than some bandlimit or bandwidth B

Page 38: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

ExamplesTelevision. A television signal is an analogue signal created by

linearly scanning a two dimensional image. Typically the signal occupies a bandwidth of about 6 MHz.

Teletext is written (or drawn) communications that are interpreted visually.

Telex describes a message limited to a predetermined set of alphanumeric characters.

Reproducing cells, in which the daughter cells's DNA contains information from the parent cells;

A disk drive

Our brain

Page 39: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Disadvantage of DSC

Could you find out one or two?

Page 40: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

The conversion of analogue and digital signals

In order to send analogue signals over a digital communication system, or process them on a digital computer, we need to convert analogue signals to digital ones.

This process is preformed by and analogue-to-digital converter (ADC).

The analogue signal is sampled (i.e. measured at regularly spaced instant)

The converse operation to the ADC is performed by a digital-to-analogue converter (DAC).

Page 41: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk
Page 42: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk
Page 43: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

The ADC process is governed by an important law.

Nyquist-Shannon Theorem (will be discussed in Chapter 3)

An analogue signal of bandwidth B can be completely recreated from its sampled from provided its sampled at a rate equal to at least twice it bandwidth.

That is

S >= 2 B

Page 44: DCSP-1: Introduction Jianfeng Feng. DCSP-1: Introduction Jianfeng Feng Department of Computer Science Warwick Univ., UK Jianfeng.feng@warwick.ac.uk

Example, a speech signal has an approximate bandwidth of 4KHz.

If this is sampled by an 8-bit ADC at the Nyquist sampling, the bit rate R is

R = 8 bits x 2 B=6400 b/s