28
Video Processing BY: Maria, Ben, Jason

Video Processing

  • Upload
    geordi

  • View
    57

  • Download
    0

Embed Size (px)

DESCRIPTION

Video Processing. BY: Maria, Ben, Jason. Overview:. Video basics Video compression Manipulation of video Stitching multiple videos Reducing errors in stitching The future of processing. How Is Video Captured. - PowerPoint PPT Presentation

Citation preview

Page 1: Video Processing

Video ProcessingBY: Maria, Ben, Jason

Page 2: Video Processing

• Video basics

• Video compression

• Manipulation of video

• Stitching multiple videos

• Reducing errors in stitching

• The future of processing

Overview:

Page 3: Video Processing

How Is Video Captured

The CMOS Sensor Captures the light and converts it to an electrical signal. This happens numerous times a

second to compose a video.

Page 4: Video Processing

Basics of Video

A video is simply a sequence of images that changes rapidly.

The human eye can distinguish the difference in images that change about 15-20 times per second (fps).

When the images change at a rate quicker than 15-20 fps our eye can not distinguish them and therefore we are fooled into seeing a continuous stream.

Page 5: Video Processing

Video CompressionUncompressed video files are Extremely Large

- 1 minute of 1280 x 960 uncompressed video = 4 GB

Compressed files can be almost infinitely times smaller depending on how much video quality you are willing to sacrifice.

Simply put, compressing a video will tell the computer to ignore everything that isn't moving to save processing power.

Page 6: Video Processing

Video Compression

Page 7: Video Processing

Over Compression

Page 8: Video Processing

Over Compression

VIDEO TRAILS

Page 9: Video Processing

Video EncodingCodec - Compression Decompression algorithms

- H.264, Divx, FFMpeg - These are the algorithms that reduce the file size of a video

Container - File type that is output after compression - MOV, AVI, MP4 - Containers can hold more than one codec - Most common container on the web is Flash which is compatible with H.264, VP6, and Spark Codecs

Page 10: Video Processing

(x,y)

Geometric Transformations

Translation

(x',y')

ΔXΔY

Page 11: Video Processing

Geometric Transformations

Scale

X

Y

X'

Y'

Page 12: Video Processing

Geometric Transformations

Rotation

Ө

(x,y)

(x',y')

Page 13: Video Processing

Alpha BlendingStandard Video has 3 Channels: Red, Green, and Blue,

totaling 24 bits (8 bits per channel).

A 4th channel, called the alpha channel is sometimes available in 32 bit video sources, and if not, can be created within the computer.

The alpha channel is represented by transparency and is understood by the computer on a scale of 0 to 255.

Page 14: Video Processing

Alpha Blending

Do we want the alpha channel of every video to be the same, or individually adjustable?

Page 15: Video Processing

StitchingConventional stitching algorithms leave a

visible seam in the overlapped region (due to accuracy limitations, vignetting, difference in exposure times, and white balance)

Most are also too complicated to be practical in real-time. They require too much computational energy.

Page 16: Video Processing

Choosing the right endpoints is important when aligning the images, so that there are no obvious seams. Picture (b) shows an alignment with poorly chosen endpoints, so there are visible seams shown in the circled regions.

Page 17: Video Processing
Page 18: Video Processing

• Start with videos that share an overlapping region

• Use a Block Matching Algorithm (BMA) to find corresponding points of the images to line them up

• You need to account for motion in the frames, using phase correlation.o Phase Correlation: a method to estimate how far

offset two images are

• Finally, blend the images together at the overlapping region.

Process:

Page 19: Video Processing

Determining where to overlap the images in each frame individually creates a more seamless image than if the overlap remains the same for all the frames.

Page 20: Video Processing

Ghost Images

Page 21: Video Processing

Some steps for eliminating ghost images:

Calculate the size in pixels of the overlapping region, then find the center point of this region, shown as P in the diagram. This gives you a focal point for the overlap. The article gives an equation to create a gradual change in the overlapping region, blending the images gradually from one to the next.

*Be sure to account for differences in color and position of moving objects

http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=5541517

Page 22: Video Processing

Current Video Processing Research

• Researchers in india are creating algorithms to improve face recognition technology.

Page 23: Video Processing

ContinueIn the medical field, there has been a big focus

on improving quality in every image that a piece of equipment makes.

MRI

Page 24: Video Processing

Ultrasound

Page 25: Video Processing

Bronchoscopy

Page 26: Video Processing

Reconstruction from Brain Activity

Measuring the blood flow and other actvitity in the brain, researchers have been able to project what the person sees in their head

Page 27: Video Processing

<iframe width="420" height="315" src="http://www.youtube.com/embed/KMA23JJ1M1o" frameborder="0" allowfullscreen></iframe>

Page 28: Video Processing

Questions?