Application in Computer VisionApplication in Computer Vision

Final Project

Nir Slakman, Oren Zur and Noam Ben-Ari

The Goal. The Goal.

To Create:

• A game for kids, to assist them

getting familiar with the world of nature.

• Using simple motor skills, sound effects and colors.

Description.Description.

• Web-cam based.• Few different screens (levels). • Motion detection.• Identifying the animals by the sounds

they make.

Motivation.Motivation.

• To create an educational game for kids.• An interesting game, using colors and

sounds effects.• An EyeToy look-like game.

What is Eye Toy?What is Eye Toy?

• Color digital camera device.

• Usually used for the PlayStation consoles.

• Allows the player to play the game by using his hands movements instead of using a joystick or a keyboard.

The Technology.The Technology.

• uses computer vision to process images taken by the camera.

• allows players to interact with games using motion, color detection and sound.

Video Capturing.Video Capturing.

• Captures frames using Matlab.• Each frame being converted to a 3D

matrix (X*Y*3).• X and Y are the dimension of the

frame.• The third value means 3 layers of

color – RGB.

Motion Detection.Motion Detection.

• A five frames buffer.

• A median matrix was computed for each five matrixes.

• If the value of a pixel is different from the value of the median – there was a motion!

Color Detection.Color Detection.

• The software is looking for a blue object in motion.

• Each pixel’s RGB values are being examined for a dominant value of blue.

Location detection.Location detection.

This is easy…

• The location is actually the values of x and y in the matrix (frame – [x,y]).

• When the object being located is signed with a square.

Location detection.Location detection.

• The square is drawn on the game’s screen according to the camera screen window’s coordinates.

• The moving object is being followed by the square online.

Effects.Effects.

• When the software locates the square in one of the pictures’ location range, it recognize the animal, mark the picture and create sounds effects.

Example.Example.

EyeToy - Example.EyeToy - Example.Short Movie - YouTube

In The Future.In The Future.

• Expand the system for different subjects.

• Include competitions and High-scores.

• Time based levels.

Any Questions?Any Questions?