9
 Multi Actions – Multi int eractive System Hardware Information Hardware: This system (solution) is possible due to a interconnection of a emitting device, a acquisition device, a processi ng unit and the projection of the result. The hardware concerns are the major issue for success in this project. The devices used, should be suitable for a general/massive solution, Each projector and each camera have technical specifications. For our project the information that is crucial in the angle of opening of the projector and the camera. To a specific video projector, it is viable to make adjustments to lenses that allow a 100% mapping of the image. (See pictures above). For this solution using a ordinary long video projector ,and a Microsoft HD webcam,we have a map 1x1 at 935 mm of the projection surface. This means that 1 mm(millimeter) is mapped by 1 pixel of t he picture, allowing a short 1 mm error when using the IR pen. The reasonable values of mapping are at most 3mm * 1 px, because of the size of the pen used. Therefore, the camera should always have a resolution and distance adjusted to the values in each case. For a bundle product, the measures of positioning the camera should be provided by t he supplier, regarding that, if the camera is capturing using 800x600 (px) , should use a distance that allows at least a i mage (projected area) of 1600x1200 (mm) for a good operation of the system (in this limit situation the camera should j ust see the projected area, and not include surrounding area.) Good Adjustment Camera and Projector; Resolution Loss. CPU Image acquisition Filter Projection Emitting Devices Any Projection Surface

Multi Actions - Tech Details

Embed Size (px)

Citation preview

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 1/9

 

Multi Actions – Multi interactive System

Hardware Information

Hardware:This system (solution) is possible due to a interconnection of a emitting device, a acquisition device, a processing unit and theprojection of the result.

The hardware concerns are the major issue for success in this project. The devices

used, should be suitable for a general/massive solution,

Each projector and each camera have technical specifications. For our project the

information that is crucial in the angle of opening of the projector and the camera.

To a specific video projector, it is viable to make adjustments to lenses that allow

a 100% mapping of the image. (See pictures above).

For this solution using a ordinary long video projector ,and a Microsoft HD

webcam,we have a map 1x1 at 935 mm of the projection surface. This means that

1 mm(millimeter) is mapped by 1 pixel of the picture, allowing a short 1 mm error

when using the IR pen.

The reasonable values of mapping are at most 3mm * 1 px, because of the size of the pen used. Therefore, the camera should always have a resolution and distance

adjusted to the values in each case.

For a bundle product, the measures of positioning the camera should be provided by the supplier, regarding that, if the camera is

capturing using 800x600 (px) , should use a distance that allows at least a image (projected area) of 1600x1200 (mm) for a good

operation of the system (in this limit situation the camera should just see the projected area, and not include surrounding area.)

Good Adjustment Camera and Projector; Resolution Loss.

CPU

Image

acquisitionFilter

Projection

Emitting Devices

AnyProjection

Surface

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 2/9

 

Software InformationThe software (we provide source files), creates a interface between the hardware and the applicationsoftware proprietary to the company.

This software is not intended to operate as it is. It is provided as a demonstration procedure that simulates the tracking process and

usability in writing applications and in operating system Windows 7.

There are procedures that are made with manual intervention, but that are intended to be automated in the final integrated

application with simple programming routines.

ATTENCION: All testing’s should be made using 1024x768 as screen resolution!(Once more this is a test method, the final solution will be multi resolution and auto detects the size of screen used!)

Setup Process:Now, we explain how to install our software Demo.

1 – The installation is a standard one, and should be made

carefully due to the specifications of this application.

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 3/9

 

2 – When completing the installation, special cares should be followed, because there are security routines made for the correct

operation of the software in windows.

If a message appears for allowing the installation of a driver you MUST ALLOW IT! If you do not allow it, please repeat the

setup.

After the driver is installed you must press a key to continue… and then the setup finishes.

As they are used communication routines inside windows, the correct rules must be defined/ created in windows firewall or any

other else (this could be the main issue for an incorrect functioning of the application). At this time pay attention to security

questions of windows. In network matter, you must allow access to the PRIVATE and PUBLIC Networks, because of the

protocols used! 

After the setup finishes, you must configure windows to accept TUIO messages, therefore a windows is automatically opened for

human interaction, authorizing TUIO messages.

You should select TUIO and then press the Blue arrow! (This window just appears once). Then you could close it.

(If a command window remains opened after finishing the setup, you should just close it. It’s due to the windows driver startup)

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 4/9

 

REMEMBER: You must allow public and private access in the windows firewall for this application

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 5/9

 

3 – The first time you run the application you should adjust the camera and reception component of the software. For that, you

should execute  Ivision application (Should be in your start menu or desktop).

After opening  Ivision:If you see a message like the above, that’s because there is no supported camera connected with the computer, therefore the

application cannot initialize.

3-1:If there is a camera connected and installed in the system you’ll see a windows for configure the picture capturing.

In our testing, the best results obtained with a standard webcam were for the settings:•  Framerate: 30.000

•  Color/Compression: RGB 24

•  Size of output: 640x480

3-2:After the settings have been defined you should have a window system like the above one:

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 6/9

 

The Ivision windows accepts the command keys showed in the adjacent window, therefore the main keys to be used are:

3-2-1: Keyboard key o – For making important adjustments to camera settings: (the pictures provided are representative only

of the best results obtained in our testing procedures for our camera, this definitions should be adapted with different

distances/light conditions/projected background surface.

These settings were configured in a Portuguese windows, so the English equivalent is:

Camera Control:

•  Focus : 6 (Remove the Automatic Focus)

•  Zoom : 0

•  Shift Image : 0

•  Rotate : 0

Video Definitions:

•  Remove True Color Option

•  Luminosity : 71

•  White Balance : 5300 (Remove the automatic Option)

•  Saturation : 70

•  Exposure : -11 (Remove the automatic Option)•  Contrast : 0

•  Frequency : 50 Hz (Portuguese electricity frequency)

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 7/9

 

(These definitions are the intended for testing purposes in the conditions of our equipment and conditions, for any matter, this

process is also possible to be very simplified as it always depends in environment)

3-2-2: Keyboard key f – Dot size definition and calibration

REMEMBER: The size of the screen should at this time be 1024x768;

Use the keys← and→ to adjust the blue ball to the size of the IR dot captured by the webcam. If there are white spots captured

by the camera without any IR emitter, then you should review the camera definitions.

Then use the IR pen to click for approximately one second in each cross, until it disappears. When the cross quick flashes between

blue and red, it’s because the position of the cursor is not precise (you should correct the size of the dot, or, if the problem remains

it’s because the pen it’s between pixels and you should adjust slightly the pen).

The size of the dot, it’s also possible to make automatically detectable.

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 8/9

 

3-3: After calibration you must use once again the key f to minimize the calibration window.

8/3/2019 Multi Actions - Tech Details

http://slidepdf.com/reader/full/multi-actions-tech-details 9/9

 

After that you can open the writing software (MultiActionsDemo).

REMEMBER: You must allow public and private access in the windows firewall for this application:

At this time if the firewall rules are correct, you should be able to write in the screen using your pen. Try to test the smoothness of the writing and precision.

Allow to minimize, clear screen and close.

4: Now using the minimize button, you should be able to control windows 7 with the infrared pen like a

mouse, or pens, zooming in and out of pictures, or making drawings in windows paint (or for that matter using any software that

allows native windows multiwriting/multicontrol). After that you could return to drawing software.

Note: The information provided in all this document is extremely confidential and just intended for the destinatary.