ELSYS Corp. - Behavior Detection System VibraImageBehavior Detection System VibraImage Manual Version 10.2.0.223 ELSYS Corp. Saint-Petersburg 2020

Behavior Detection System

VibraImage

Manual

Version 10.2.0.223

ELSYS Corp.

WWW.ELSYS.RU

WWW.PSYMAKER.COM

Saint-Petersburg

2020

http://www.elsys.ru/

http://www.psymaker.ru/

VibraImage10 Copyright © 2019 by Elsys Corp. All rights reserved.

2

Content

Introduction ................................................................................................................. 5

1 Useful information .................................................................................................... 8

1.1 Basic applications ...................................................................................................................... 8

1.2 System specifications ................................................................................................................ 8 1.2.1 VibraImage system parameters ............................................................................................ 8 1.2.2 Digital (web) camera requirements ...................................................................................... 8 1.2.3 System requirements............................................................................................................. 9

1.3 Package content ....................................................................................................................... 10

1.4 Software specification ............................................................................................................. 10

2. Before you begin .................................................................................................... 11

2.1 Operating limits ...................................................................................................................... 11

2.2 Software installation ............................................................................................................... 14 2.2.1 Digital camera driver installation (*).................................................................................. 14 2.2.2 Guardant dongles driver installation ................................................................................... 14

2.2.3 VibraImage installation ...................................................................................................... 15

2.3 First start of VibraImage system ........................................................................................... 16 2.3.1 Video quality auto checking function ................................................................................. 17 2.3.2 Video setting ....................................................................................................................... 20

2.3.2.1 One camera ................................................................................................................................ 20 2.3.2.2 Multi cameras mode (Overview) ............................................................................................... 21 2.3.2.3 Saved video ............................................................................................................................... 23

3 VibraImage. Users manual. Basic function. ........................................................ 24

3.1 Multifunction window ............................................................................................................ 24 3.1.1 Basic window design .......................................................................................................... 25 3.1.2 Windows position control ................................................................................................... 29

3.2 Main menu ............................................................................................................................... 31 3.2.1 Menu «File» ........................................................................................................................ 31

3.2.2 Menu "View" ...................................................................................................................... 32 3.2.3 Menu "Settings" .................................................................................................................. 34 3.2.4 Menu «Action» ................................................................................................................... 37

3.2.5 Menu "Help" ....................................................................................................................... 38

3.3 Image area control .................................................................................................................. 39 3.3.1 Choice of the main display mode ....................................................................................... 39 3.3.2 Submenu "Mode" ............................................................................................................... 42 3.3.3 Graph display ...................................................................................................................... 46 3.3.4 Graph analyze ..................................................................................................................... 48

3.4 Toolbar ..................................................................................................................................... 50


3

3.5 Vibraimage parameters .......................................................................................................... 51 3.5.1 Т1-Т12 parameters ............................................................................................................. 54

3.6 Information panel ................................................................................................................... 55 3.6.1 Information panel. VI mode. .............................................................................................. 56 3.6.2 Information panel. M mode. ............................................................................................... 58 3.6.3 Information panel. LD mode. ............................................................................................. 60 3.6.4 Information panel. GR mode. ............................................................................................. 61

3.6.5 Information panel. С mode. ................................................................................................ 64 3.6.6 Information panel. S mode. ................................................................................................ 66 3.6.7 Information panel. DB mode. ............................................................................................. 75

3.7 Save of measurements results ................................................................................................ 76 3.7.1 Save of current images ....................................................................................................... 76 3.7.2 Save of video file ................................................................................................................ 77 3.7.3 Save of results and settings files ......................................................................................... 78

3.7.4 Auto capture image in Macro mode ................................................................................... 79

4 The basic modes of the VibraImage system ......................................................... 81

4.1 Micro mode. Emotions (personality traits) definition ......................................................... 82 4.1.1 "M" mode of information panel .......................................................................................... 90

4.1.2 Psychophysiological state analysis results ......................................................................... 92

4.2 Macro mode. The suspicious people detection in crowd ..................................................... 97 4.2.1 "Macro" mode parameters .................................................................................................. 97

4.2.2 Face detection mode ......................................................................................................... 102

4.2.3 First start and settings selection for Macro mode ............................................................. 105

4.3 Mix mode. The suspicious people detection with high accuracy ...................................... 107 4.3.1 Mix mode parameters ....................................................................................................... 107

4.3.2 First start and settings selection for Mix mode ................................................................. 110

4.4 LD mode. Lie detection ......................................................................................................... 112 4.4.1 Before starting LD mode .................................................................................................. 112 4.4.2 Switch on LD mode .......................................................................................................... 113

4.4.3 LD working mode ............................................................................................................. 115 4.4.4 Additional settings in "S" information panel .................................................................... 117 4.4.5 Settings in «LD"information panel. .................................................................................. 119

4.4.6 Backster’s test ................................................................................................................... 122 4.4.7 Lie detector with questionnaires ....................................................................................... 123 4.4.8 Questionnaires stucture ..................................................................................................... 127 4.4.9 Create new questionnaires ................................................................................................ 128

4.4.10 Psychophysiological detection of deception in semi-automatic mode without

questionnaires ............................................................................................................................ 129 4.4.11 Psychophysiological detection of deception in semi-automatic mode, random questions

................................................................................................................................................... 130 4.4.12 Recording the main test LD results ................................................................................ 130

4.4.12.1 Graphics of psychophysiological state changes .................................................................... 132 4.4.12.2 Recording the main test results .............................................................................................. 135


4

4.4.13 Ranking mode of reactions to questions ......................................................................... 139 4.4.14 Video recording during testing and mark standing ........................................................ 141

5 Operation with external devices ......................................................................... 142

5.1 Operation with EEG devices ................................................................................................ 142

5.2 Operation with a fingerprint scanner and registration of the pulse wave. ...................... 144

6 Vibraimage. General info .................................................................................... 146

7 Warranty ............................................................................................................... 148

7.1 Disclaimer of Warranties ..................................................................................................... 148

7.2 Limitation of Liability .......................................................................................................... 149


5

Introduction

Welcome to the VibraImage World! Thank you for your purchase of VibraImage

system. This Manual is written to help you enjoy vibraimaging and open new features in well-

known objects!

VibraImage technology measures micromovement (micro motion, vibration) of person by

standard digital, web or television cameras and image processing. Human head microvibration is

linked with the vestibulo-emotional reflex (VER) of a person and reflects emotion status and

personality traits. VibraImage system detects human emotions by the control of three dimensional

(3D) head-neck movements and fluctuations, accumulated as frame difference in several video

frames.

Fig.1. Frequency vibraimage of the person Fig.2. External vibraimage around the frequency

vibraimage

VibraImage is a new image type and so primary, as original color image, thermo image or x-

ray image. Each image type gives new and unique information about the object. Every pixel of

vibraimage reflects vibration parameters - frequency or amplitude (fig. 1) of vibration. One frame

visualization of vibration frequency and amplitude named external vibraimage and looks like aura

(vibra-aura) of person (fig. 2). Typically, external vibraimage colors linked with vibration frequency

and external vibraimage dimension linked with vibration amplitude.

The method, system and the device of said VibraImage technology are protected by

the patents of Russian Federation RU 2187904 (fig.3), RU2289310 (fig. 4), RU 2510238 (fig. 5), RU

2515149 (fig. 6), RU 2629247 (fig. 7), RU 2695888 (fig. 8), Software Registration N2006614137

(fig. 9), United States Patent US 7346227, Korean patent KR 10-1500888 and awarded with Gold

medal on the international exhibition of inventions and innovations Brussels - Eureka 2002 (fig. 10)


6

Fig.3. Patent of Russian Federation

RU 2187904


RU 2289310


RU 2510238


RU 2515149


7


RU 2629247


RU 2695888

Fig.9. Diploma of international exhibition of

inventions and innovations Brussels - Eureka

2002

Fig.10. Certificate on official registrations

Software VibraImage in Russian software

database


8

1 Useful information

1.1 Basic applications

Human emotions control system (further - VibraImage) intends for registration, analysis,

control and research of human emotion, functional and psychophysiological states for different

applications in the fields of security, biometrics, psychology, medicine, electronics and human life.

VibraImage software solves the following targets:

Psychophysiological parameters monitoring and detection;

Emotion recognition;

Lie detection;

Monitoring of person physiological parameters;

Video surveillance in real time by vibraimage and suspicios person detection;

Psychological testing and interview

1.2 System specifications

1.2.1 VibraImage system parameters

Resolution, TVL, not less 400

Noise level of VibraImage, bit, less than 0,1

Frame rate, f/s, not less 25

Frequency range, Hz, more than 0,1 10

1.2.2 Digital (web) camera requirements

Sensor CMOS/CCD

Resolution, pixel, not less 640 х 480

USB compatible USB 1.0; USB 2.0, USB 3.0, IP

Frame speed, f/s, not less 25

Microphone external (not built-in camera)

Exposition control auto and manual


9

Color mode color and B/W switch

Flicker mode Flicker 50 Hz and 60 Hz

1.2.3 System requirements

Operation System Microsoft Windows better then Windows 7,

only 64-bit version!!!

Processor PC with Pentium Core Duo2 2400 or better

RAM 8 Gb or more

HDD Recommended SSD type more than 500 Gb

USB port 2 free USB ports version USB 2.0

Software DirectX 9.0 or later

Video capture WDM-compatible video device

Audio audio capture device (support 16-bit data and

44100 Hz stream frequency)

Network LAN 100Mb/s or better


10

1.3 Package content

1. VibraImage PRO and Guardant dongle - 1

2. User’s Guide (Manual) - 1

3. Digital USB camera (option) - 1

4. Disk or flash card with vibraimage info (option) - 1

5. Personal computer (option) - 1

1.4 Software specification

Video source

In directory \Soft\VideoCam utilities to test the functionality of a digital camera (provided it

supplies with a complex) are located. Detailed installation instructions of drivers of a digital video

camera are located on a CD disk (or other source) of the camera software delivered together with

the camera.

VibraImage

In directory \Soft\ the installation package of the VibraImage10.exe program is located. For

start of the program it is necessary to study recommendations about the installation, specified in

the section "VibraImage Program Installation" (see below). Also, the installation kit can be

downloaded from the website http://www.psymaker.com/downloads/Vibraimage10.exe.

Guardant drivers

Before starting VibraImage 10.x, you must install a device driver hardware lock (dongle). In

the catalog \Soft\ Guardant2eng the installation package dongle drivers are located. To run

the program should be read the recommendations for installation specified in the «Guardant dongles

driver installation" (see below).

Note, to install the driver in W7/W8/W10 administrator rights are required!

http://www.psymaker.com/downloads/setupVibraPro10.exe

http://www.psymaker.com/downloads/VI10_ManualEng.pdf

http://www.psymaker.com/downloads/Vibraimage10.exe


11

2. Before you begin

2.1 Operating limits

Power supplies requirements for hardware

1. Power supply must be 220 V in 50 Hz via an uninterruptible power supply (UPS) with

feedback. UPS capacity should be sufficient for the functioning of the system for at least 20

minutes needed to save the results of analyzing and processing.

2. For low noise and reliable system action the monitor, power units of cameras should be

connected to an electric network through the special sockets having additional ground contact

(the socket of a class 1).

3. For reliable maintenance system the equipment included in complex and the equipment,

taking place in direct near should be certificated on electromagnetic compatibility according

to requirements.

Light exposure requirements

1. Natural illumination of object can be used only if speed of natural light exposure changes of

object does not exceed 1 Lx/s.

2. Illumination of object by fluorescent lamps with illumination in a range 400 - 600 Lx in a

plane of object is preferable.

3. When the system operated in continuous mode the lighting in indoor all time should be from

400 to 600 lux.

Camera vibration requirements

1. The television camera used for surveillance and-or object on which the camera is established,

should be motionless.

2. Allowable vibration speed of television camera not more than 0.1 mm/sec in the range (0.1 –

50) Hz.

Settings VibraImage recommendations

For correct results, you must minimize:

Light sources, fixtures and bright surfaces, windows, etc.

Window, which gets the image from the streets.

Glass surfaces such as walls, which change with the lighting system in the room or on the

street lighting can act as "mirrors"

Light sources with variable lighting (flickering, flashing, etc.) or lighting systems, which

are moved mechanically (subject to vibrations from external factors).


12

Light sources with a unidirectional light, i.e, a person must uniform illuminated from all

sides,

Outside people influence,

The moving objects, sliding doors, people passing by, etc.

Hardware Requirements

1. The resolution of the TV camera should be at least 640 x 480 pixels, and the rate of input

video frames to a computer for at least 25 – 30 frames / sec.

2. It is recommended to use the TV cameras with low noise.

3. After starting the program VibraImage CPU load should not exceed 80 %.

4. The computer's hardware must provide performance sufficient to be processed in real time at

least 25 frame/s received from the television camera.

Factors affecting the quality of vibraimage

The following factors are taken into account it is recommended to get the correct vibraimage

person:

1. An object (person) has to be well and evenly lit, and normal (black and white or color) image

of a man should be clear and contrasting. human face in the frame should be no smaller than

200 pixels.

2. The person must be in its natural state, when its movements are determined by unconscious

processes, especially the vestibular system. It is necessary to exclude the presence of

additional mechanical contact sources (for example, a man leaned against a certain subject,

leaned on the table, leaned his head by hand).

3. Vibraimage Micro mode is designed for the visualization of vibration only one object in the

frame, so the live objects that are close to the main object of study, can significantly affect

and distort the vibraimage of the main subject.

4. There is a certain delay between the current psychophysiological state and vibraimage. The

value of this delay is mainly determined by the selected accumulation time. For example,

when the real system performance 25 f / s and the selected time N = 100 frame, the objective

vibration aura of a person can be displayed on the screen is not earlier than 4 seconds after the

person in front of the camera. Therefore, a person must remain in the camera frame for at least

10 seconds based on Nyquist–Shannon-Kotelnikov theorem.

https://en.wikipedia.org/wiki/Nyquist%E2%80%93Shannon_sampling_theorem


13

Note

The correct analysis of person emotion levels and lie detection is possible only at detail

execution of the recommendations stated in the given document, and by processing of high

quality vibraimage.

It is recommended to system users to be trained and certification of the user on special

courses and to use of VibraImage, certificated by ELSYS corp.

User of VibraImage system should use the system for research and monitoring of the

psychophysiological state in accordance with the common law and in accordance with the

legislation of the country in which the system is used without violating the rights of the

investigated person.


14

2.2 Software installation

2.2.1 Digital camera driver installation (*)

(*) – Available on request

If the user uses own USB camera, it is need to install drivers for video capture device like web

cam according to it manual.

Note, restart the system after camera driver installation.

2.2.2 Guardant dongles driver installation

Note, for driver installation in NT/2000/XP/W7/W8/W10 the administrator rights are

required!

Perform the following steps to install the dongle Guardant driver for NT/2000/XP.

1. Close all other applications to avoid file sharing errors;

2. Run INSTDRV.EXE application from "Guardant drivers" folder "\Soft\Guardant2eng\";

3. When the utility is started, it will check the presence of Guardant driver in the system. If

the driver is not found, only [Install driver] button will be available in the main window. To

install or update Guardant driver click on [Install driver] or [Reinstall driver] button. If

installation is completed successfully, INSTDRV will display a corresponding message and

then return to the main window.

4. If the driver installation is successful, a message box is displayed.

5. Click [OK] to continue.

6. Close INSTDRV application.;

7. Restart the system.

8. Connect video capture device and dongle to PC.

9. Run VibraImage.exe

Note

By default, the system installs the driver for 64-bit Windows 7. If necessary, you can manually

install the required driver of folders "\Soft\32\" or "\Soft\64\".


15

2.2.3 VibraImage installation

It is necessary to execute the following actions for installation of VibraImage program on your

computer:

1. Run setupVibraPro10.exe file

2. Choose language of installation in appeared window;

3. Press button "Next" in the appeared window;

4. Accept the license agreement and to press button «Next"in the appeared window;

5. In the appeared window specify a way to the catalogue where files of the program will be

written down, then to press button "Next";

7. The next two screens allow the creation of a shortcut in the Windows menu “Start” and

VibraImageEx icons on your desktop computer

8. Press button "Next" in the appeared window, allows installation of software files on your

computer;

9. Press button "Close" at the end of installation.

10. VibraImage program pictograms appears after the end of installation in system menu and

on desktop of your computer

11. Connect dongle to USB port of computer and start. VibraImageEx.exe.

http://www.psymaker.com/downloads/setupVibraPro10.exe


16

2.3 First start of VibraImage system

1. After the first start of the program you will see the progress bar (fig.2.1) that means loading

process bar.

Fig. 2.1 Progress bar

2. First program window shown in fig. 2.2

Fig. 2.2. First program start

3. In menu "Settings" => "Language" select interface language (Fig. 2.3).

Fig. 2.3. Select language


17

4. Once connected to the computer camera in the menu "Settings" => "Video" (Fig 2.4) you

need to select the camera to work (in Fig 2.4 – Microsoft Lifecam Cinema camera).

Fig. 2.4. Video camera connecting

5. After correct connecting the camera the image appears on the screen.

6. Perform video camera settings (see. ch. 2.3.2).

7. Perform quality control of videoimage (see. ch. 2.3.1) and, if it necessary, eliminate the causes

of low-quality video.

8. Select the directories for recording video information and log files (see. ch. 3.6).

9. Get started in accordance with the program description.

2.3.1 Video quality auto checking function

The VibraImage program has built-in automatic quality control function image quality control

during the test. Since the calculation of human reaction using the video image, the quality control for

the processed video is necessary to obtain a correct test result. Error message and the low quality of

video will appear on top of the QT windows (Fig. 2.5), but only if the "Quality test" mode in "S"

information panel is switch on.

Program gives error indication if the image quality is lower than standard vibraimage requests:

Error 1 – indicates when facial image is lower than necessary. For cancel this error is need to

move checked person near to camera or start zoom function on camera.

Error 2 – indicates when camera noise level is higher than necessary. The reason of this error

could be low illumination, incorrect camera settings or camera vibration.

Error 3 – indicates when computer input frame rate is lower than necessary. Requested norm

for processed frame rate is more than 24 f/s. This errors indication was done for deleting unqualified

staff influence during results control.


18

Fig. 2.5. Error message 1 – low quality of image

The size of the person's head image in the picture elements (pixels), which determines the

accuracy of recorded vibrations, requires constant monitoring during testing. When tested with a

video image analysis there are no severe restrictions on the movement of the test person, as required

by the contact method. This person feels natural, which increases the accuracy of test results.

However, the natural behavior can lead to the fact that during the test response deviates

from the camera and the size of the human head image becomes less than required. To resolve this

issue vibraimage system constantly monitors a person's head size of the image and displays an error

message (1) in the window "QT" in the case of reducing the size below the limit. In addition,

vibraimage program includes a permanent face detection algorithm, which ensures elimination of

errors from a lack of a real image of the person in the frame during testing.

Temporary noise signal from the video camera includes a video camera noise and

illumination instability and can significantly affect the test results. In this case, at the slightest noise

level exceeds the specified threshold, the system automatically displays an error message (2) in "QT"

window (see. Fig. 2.6).


19

Fig. 2.6. Error message 2 – low illumination

Despite the fact that the television camera may transmit to 30 frame/sec with the set

resolution, it does not guarantee that the computer receives and processes the incoming video data in

real time. And any deviation from the information processing in real time resulting in a loss of

information and hence reduce the reliability of the test. By reducing the actual input frames

frequencies and processing frequencies below the set limit, the system automatically displays a

warning error (3).

Window "Quality Test" (QT) indicates the time in %, for which the image quality of

100 %. When the quality test indicates 43 % means that only 43 % of the testing time have no errors,

and the 57 % of test time the image quality contained 1, 2 or 3 errors.

Note, before the start of the test should ensure that the program processed the image of a

human without errors.


20

2.3.2 Video setting

2.3.2.1 One camera

It is necessary to select in the main menu "Settings" => "Video" => ".../name used

camera/...". In figure 2.7 the process of selecting camera "Microsoft LifeCam Cinema" is shown.

If the camera is connected, selected and operated, then on the left of the name there will be an icon

"" (fig. 2.7), and the menu will be extended with the "Video capture filter" and "Video capture

format".

Select "Video capture filter..." in the submenu "Video" (fig. 2.8) for open menu of the

camera settings. Item "Video capture filter" appears in the menu only in case of the correct

installation of camera drivers and correct choice of operating camera.

Fig. 2.7. Select camera «Microsoft LifeCam Cinema»

After a choice of the "Video capture filter..." the window "Settings" will open. Settings

window differs depends on camera type. When adjusting the camera settings, you must fulfill the

following general requirements:

The "Brightness", "Contrast" and others parameters should be configured so that

the image of the object was the maximum contrast

Switch on "Flicker" mode for setting lighting power line frequency (repayment

flicker), in most countries it is 50 Hz.

If your camera supports, then switch on the black-and- white image "B / W mode".

If the camera works only in color mode, it is recommended to set "Saturation"

parameter to minimum value.


21

Depending on the experimental conditions and light to use automatic or manual setting

"Exposure" parameter. If constant lighting, it is recommended to use the manual

adjustment. If changes (for example, an object depends on the lighting street lighting),

it is better to use the automatic adjustment mode setting.

Parameters "Zoom" and "Focus" is recommended to use in the manual mode and

change their values not due to electronic image processing, but by approaching /

removing the camera from the object.

Fig. 2.8. Opening "Video Capture Format" window

To open the video recording settings window must be select "Video Capture format..." in

the submenu "Video" (Fig. 2.8). The frame rate is necessary to set 30 as the frame size ("output size")

of not less than 640 x 480 elements. When using larger frames size in the program need to constantly

monitor the speed of the frame to the computer and the processing speed of your computer

(see. ch. 3.6)

Note, use free program CamIP for the IP network camera connection

(http://www.psymaker.com/downloads/CamIP64.exe). Parameter setting procedure is described in

the CamIp manual http://www.psymaker.com/downloads/CamIP_eng.pdf

2.3.2.2 Multi cameras mode (Overview)

In professional version, there is option to use simultaneously from 1 to 10 cameras.

Limitations for it are power of hardware (CPU load should not exceed 80 %) and settings of used

Guardant dongle.

If you want to use more than one camera for vibraimage processing, you need to set the

number of cameras in the "Information panel" => "Mode S" => "Main menu" => "Cores" (fig. 2.9).

For example, for 2 cameras you will see 2 windows. You need to choose (fig. 2.10) and set new

http://www.psymaker.com/downloads/CamIP64.exe

http://www.psymaker.com/downloads/CamIP_eng.pdf


22

camera for each new window as it is described in 2.3.2.1. The more cameras you will choose, the

longer reboot of VibraImage program will be, for example, for 10 cameras it can be more than 1 min.

Fig. 2.9. Opening two cameras.

Fig. 2.10. Select camera «Microsoft LifeCam Studio" for 2nd image window

When you switch on several cameras in menu "View" item "Overview" appears (fig. 2.11).

Fig. 2.11. Item "Overview" menu "View"


23

By using item "Overview" user can open several cameras in addition window (fig.2.12). Also

in this window there is information about suspect level of the most dangerous person from each video.

Parameters of displaed video you can set when you open video as it is shown on the fig. 2.10.

Fig.2.12. Window "Overview" with 2 cameras.

2.3.2.3 Saved video

You can upload your video file in format AVI using menu "File" => "Open" or with

combination of buttons on your keyboard "Ctrl + O" or button on toolbar. To operate with

video, you should use items from submenu "Video" menu "Settings" (see ch. 3.2.3). To choose video

time there is toolbar "Video" (fig. 2.13) with slider for choosing time and button to stop video (on the

right side of the bar) that shows exact time from the start of the video.

Fig. 2.13. Toolbar "Video" with slider


24

3 VibraImage. Users manual. Basic function.

VibraImage software gathers, records, processes and analyzes electronic images of humans,

biological and mechanical moving objects with various frequency and amplitude of vibration

(fluctuations).

After starting the VibraImage program video images from camera or video file are displayed

in multifunction (basic) window.

3.1 Multifunction window

In heading of the basic window the following information is indicated (see Fig. 3.1):

type of video source: Video camera or AVI file;

model of video source: Video camera model or AVI file name;

name of running VibraImage module;

name of the current database record to which there is an operation.

Fig. 3.1. Multifunction window of VibraImage with style Windows XP

The program for the user’s convenience have the ability to change the style of the main

elements of the working window. To change the style, use the submenu "View" – "Application

styles" (Figure 3.2.).


25

Fig. 3.2. Style Office 2003

3.1.1 Basic window design

In total in the main window of the program in addition to the video area, you can see an

additional 16 windows that display information about the parameters of mental and emotional state

of a person, and program settings (on Figure 3.3 the windows labeled corresponding numbers):

1. Toolbar – main toolbar.

2. Toolbar VI – toolbar for different vibraimages mode.

3. VI, M, LD, C, GR, S, DB – information panel windows.

4. Histogram – window for vibraimages parameters histogram in real time mode.

5. LD Question – questionnaire window for lie detector mode.

6. Suspect – human suspect level window

7. Graph – window for parameters graph.

8. QT – image quality window.

9. Image capture – window for "danger" person photo.

10. LDr – lie level window.

11. Video – slider for time management of video only if videosource AVI file.


26

Fig. 3.3. Example of all type windows

The user can add or remove the window on the screen using the submenu "View" – "Toolbar"

(Fig 3.4.). But for different modes of program operation uses a different set of windows and the

simultaneous presence of all the windows on the screen is redundant.

When select one of the basic operation modes (micro, macro, mix or lie detection) and load

its default settings, the system automatically displays only the necessary for that mode window

(Fig. 3.5 – 3.7). Loading of the basic modes setting is performed using the sub menu "Settings" –

"Preset".

2 1 3 4 10 6 7 9 8 1 11


27

Fig. 3.4. Submenu for windows control

Fig. 3.5. "Micro" mode set


28

Fig. 3.6. "Macro" mode set

Fig. 3.7. "Lie detector" mode set


29

3.1.2 Windows position control

The user can control the placement of additional windows on the screen and the size using the

controls elements on the left side of each window title. For each window it is available control menu

(Fig. 3.8). This menu also appears when you click the left mouse button in finding the mouse pointer

in the desired window. In "Docking" mode, window position and size are fixed, and when

opening/closing the window will open in a given position. The mode "Floating" window position and

size can be changed by the user.

If the window is in a random location on the screen, then double-click the left mouse button

on the window, the window will move on the screen in the "default" position.

Fig. 3.8. Window control element

Each window can be closed, or by using the window menu or by using a separate control

element (Fig. 3.9).

Fig. 3.9. Control element "«close window"

Each window can be temporarily minimized and moved to the border of the main program

window (Fig. 3.10). Figure 3.11 additional windows hided and moved to the border of the main

window and they icons are highlighted in orange color.


30

Fig. 3.10. Control element "hide window"

Fig. 3.11. All additional windows are hide.


31

3.2 Main menu

The main menu contains the following items:

"File"

"View"

"Settings"

"Action"

"Help"

3.2.1 Menu «File»

Menu "File" contains following items:

Fig. 3.12. Menu "File"

Item "Open…" – it is intended for loading video or new face detection algorithms.

Item "Save settings as …" – it is intended for saving of the current system settings to

the external file.

Item "Load settings …" – it is intended for loading saved system settings from an external

file.

Item "LD Load text… " – it is use in LD mode for loading new LD questionnaire from an

external file.

Item "AVI: Start Capture" – start record AVI-file. If the database folder is not specified,

record of AVI files is blocked.

Item "Image capture …" – it is intended for saving current frame from area of images in a

folder of archive as BMP a file.

Item «Exit"- exit from program.


32

3.2.2 Menu "View"

Menu "View" (fig. 3.13) defines visible in the basic window information and contains

the following items.

Fig. 3.13. Menu "View"

Item "Toolbar" – switch on/off the toolbars and additional functional windows.

Fig. 3.14. Menu "View", submenu for windows selected


33

Item "Application Look" is applied to change style of working window and its components

(Fig. 3.15).

Fig. 3.15. Menu "View", submenu for windows style

Submenu "Mode" defines additional configuration and number of windows with an image

displayed in the image area. Images also can be selected using the corresponding buttons on

the toolbar "Toolbar VI" (on fig. 3.6 at left side).

Fig. 3.16. Windows that appear to the image area.

Submenu "Preset" defines the type of the display image: the real image (mode LD),

vibraimage (mode VI), the aura on the real image (mode AR), the aura on vibraimage (mode AV).

Also, you can configure the corresponding buttons on the Toolbar (fig. 3.7).


34

Fig. 3.17. Buttons and menu items defining type of displayed image

3.2.3 Menu "Settings"

Menu "Settings" (fig. 3.18) contains the following items:

The submenu "Language" contains the list of supported languages (see Fig. 2.2).

Fig. 3.18. Menu "Settings". Submenu "Defaults"

Submenu "Defaults" [Preset] is intended for set of system in one of an operating conditions

mode (micro, macro, mix or ld) with set parameters to default value (see fig. 3.5 – 3.7). Files of

default settings of the basic modes are stored in the catalogue \VibraImage10\defaults\

Fig. 3.19. Menu «Settings». Submenu «Video»


35

Submenu "Video" contains options of video modes. Its can differ depending on connected

devices. For example this menu contains the following items (fig. 3.19). You can choose as video

source one from many installing in PC video-devices or load external video file.

Note, for connection to system of network IP cameras (for example, in figure 3.19 CamIP

RTSP Example) and adjustments of their parameters the additional software CamIP.exe

http://www.psymaker.com/downloads/CamIP_installer.msi is used.

Subitem "Video Capture Filter…" – opens the window of video device setting (contrast,

exposition, and brightness). Each device has the especial window of settings.

Subitem "Video Capture Format…" – change video capture format.

The subitem «RGB8 compressor"is intended for management of a video file record format.

If this item is chosen, that, for economy of a space on a hard disk, the video file saved in a black-and-

white format.

The subitem "Disconnect" allows disconnecting all video camera or video file.

Subitems "AVI File…" and "AVI File (no sound)…" select for the analysis of an external

video file. The file can be loaded with a sound and without sound. The operation mode without sound

is used for VibraSound creation.

Subitems "Rotate CW" and "Rotate CCW" allow making turn of an input video image on

90 and 270 degrees before its processing in the VibraImagePro.

Subitems "Mirror X" and "Mirror Y" allow to reflect video file on axis X or Y

correspondingly.

Subitem "Save Settings" allows to save your camera settings if the video conditions don’t

change otherwise program settings will set by default at each new turn on the camera.

Submenu "Video mask"(fig. 3.14) allows to edit video data. If there is an additional mobile

object in the field of supervision it makes it difficult to measure the basic object. In "Edit mode",

you can cover "black" mask on addition object image. Also you can reset current mask ("Reset Video

mask" mode), save mask in external picture file in BMP format ("Export Video mask" mode) and

load external mask ("Load Video mask" mode).

Note, DON’T FORGET turn off "Edit mode" after masking. Otherwise, any click of

the mouse in the image will continue masking!

http://www.psymaker.com/downloads/CamIP_installer.msi


36

Fig. 3.14 Mask mode using

The item "Mitsar EEG" (in development) can be used in case of connection of the Mitsar-

EEG electroencephalograph. Then there is a possibility to display graphs of change in time of signals

from electrodes (EEG-x) (details in section § 5.1).

The item "DC21" (in development) can be used at work with fingerprint scanner Thus data

from the fingerprint device can be displayed in graphs (details in section § 5.2).

Item "Lock system" (in development) is used to lock of all toolbar buttons from stray

keystroke. To unlock the system, press the icon VibraImage " " in the top left corner of the screen.


37

3.2.4 Menu «Action»

Menu "Action" (fig. 3.18) contains following items:

Fig. 3.23. Menu "Action"

Item "Pause" – stop last accepted frame of data in image area of windows.

Item "Reset" – reset all saved up information and statistics about frames and start new cycle

collection of information.

At work the program fixes an operating time with object of research, and in case of work with

AVI a file - time from the beginning of record. Having chosen item "Reset timers" (or corresponding

toolbar button), it is possible to reset in 0 counter of the current operating time, and at work with AVI

a file - to begin viewing record with the beginning.

At a choice of item "Measurement"(or corresponding toolbar button) the system makes

accumulation, averaging and a display of parameters for the specified time period. The results display

is made in the information panel in a mode «M». In the same place in seconds value of the averaging

period «Duration" is set.

Item «Start H 10s "are intended for accumulation and viewing of the frequency information

about psycho - emotional condition of person for 10 seconds. For viewing results, it is necessary to

open sheets "H" in the basic window (see Fig. 3.54).

Item "Start LD block" (or corresponding toolbar button) begin calculation of parameters of

a lie level in a “manual mode”. It is necessary to press this button again to stop calculation in a manual

mode. The moment of start calculation in a manual mode will be noted on graphs by a vertical green

line, the moment of stop calculation - by red line).

The item "Markers"is used at work with graphs and intended for draw on graphs the markers

(0-9) and markers of questions (RQ, CQ, GQ).


38

3.2.5 Menu "Help"

Menu "Help" is in the main menu contains following items:

Fig. 3.24. Menu «Help»

Item "About VibraImage…" is intended to view the software version, the registered user

name (Owner), the key number protection (Serial) and expiry date of the license (Limited)

(fig. 3.25).

Fig. 3.25. Information about VibraImage and its owner


39

3.3 Image area control

VibraImage system allows the processing of a "live" video signal from the camera, and the

video data previously recorded and stored as AVI- file. By default, the system works with the signal

from your video camera. Switching between modes can be done through a toolbar buttons or through

the system menu "Settings - Video...".

Selecting an external video file via the file selection window, caused by using the command

"AVI file... " submenu "Settings - Video..." (see Fig. 3.19). Additionally, an external video file can

be loaded without sound using " AVI file (without sound)..." command. This mode is recommended

when working with VibraSound.

The main window of the basic VibraImage.exe module can be configured for observations in

several operating modes. The choice of an operating mode is made in the item "View" of the main

menu (fig. 3.26).

Fig. 3.26. Menu "View" for set working mode

Pause / start output of the current image is performed using the "Pause" command menu

"Action", or by using the corresponding toolbar buttons.

3.3.1 Choice of the main display mode

In the field of the image area (see Fig. 3.37 – 3.40), depending on the chosen mode (fig. 3.35),

the user can see the "real" video image, vibraimage, external vibraimage (aura), or external

vibraimage on real image.


40

Item "Presets" menu "View" (fig. 3.26) is intended to choice one basic mode in image area.

In "VI" mode["VibraImage mode"] displays vibraimage of person. Color for every

image pixel depends on its amplitude or frequency of vibrations (fig. 3.37, 3.38).

In "AV" mode["Aura - Vibraimage mode"] the contour of the object allocated around

the vibraimage. Vibra-aura line size depends on medium line vibration amplitude.

Vibra-aura line color depends on maximum line vibration frequency inside vibraimage

contour (fig. 3.39, 3.40).

In "AR" mode["Aura on the Real image"] the vibra-aura of the person is shown around

his real image (fig. 3.40).

In "LD" mode["Lie Detector mode"] image area shows real object image.

Fig. 3.37. VI mode.


41

Fig. 3.39. AV mode.

Fig. 3.40. AR mode.


42

3.3.2 Submenu "Mode"

Item "Mode"(fig. 3.42) selects additional settings of information in image area. All items in

this submenu also duplicated in the additional toolbar (see Fig. 3.41, left panel). Disabling the menu

item "Toolbar VI", the user can remove the screen that extra toolbar.

Fig. 3.41. Submenu "Mode"

Note

Pressed buttons in toolbar correlated with windows in the area of images (fig. 3.42).

The maximum number of windows equal 13. To delete a window with the set image processing it is

enough to let off the corresponding button the of "Toolbar VI" panel.

Note, when approaching the mouse pointer to one of the images on the screen may be

displayed help list indicating the display mode of the window. Enable / disable output tips made in

the menu "View" – "Mode" in item "Tooltips" (see Fig 3.42.). If you switch on the "Title" menu item

than in the upper left corner of each image window will display the name of his mode.


43

Fig. 3.42. Display concurrently multiple images windows with different processing methods

In "SRC" mode (the button ) shows source video from camera without processing

(fig. 3.43). It is additional possibility to display the aura on the real image of person

constructed on the analysis of pixels vibration amplitude (the button ) or frequency or

pixels vibration frequencies (the button ). The length of the beam vibra-aura in this

case will be determined by the average value of the points parameter in a row, and the

color of the beam vibra-aura – by the maximum value.

In "VI (2 Am)" (the button ) and "VI (2 F)" (the button ) modes display

vibraimage, processed during 2 frames and constructed on the basis of amplitude Am and

frequency F analysis of vibration. It is additional possibility to change color of

background image and to add vibra-aura to vibraimage (fig. 3.44).


44

Fig. 3.43. Select mode of processing image

In "VI (10 Am)"(the button of the toolbar) and"VI (10 F)"(the button of the

toolbar) modes display vibraimage, processed during 10 frames and constructed on the

basis of amplitude Am and frequency F vibration analysis. It is the additional possibility

to change color of a background image and to add aura to vibraimage. The same result is

possible to receive if to bring the mouse pointer to a window of the chosen image and to

press the right button of a mouse (fig. 3.44).


45

Fig. 3.44. Example, three type of images display. Switch on mode AR(F) and VI (10 F).

In "VI (N Am)"(the button of the toolbar) and"VI (N F)"(the button of the

toolbar) modes display vibraimage, processed during N frames and constructed on the

basis of amplitude Am and frequency F vibration analysis. The number of frames,

corresponding to parameter N, is set in "VI" information panel. It is additional possibility

to change color of background image and to add aura to vibraimage.

In "Delta Am"(the button ) and"Delta F"(the button ) display frame

difference on the basis of amplitude Am and frequency F vibration analysis in base

processing mode without filter preprocessing. It is additional possibility to change color

of background image.

Note. In this mode the vibra-aura will be based on the vibraimage which has been

accumulated for N frames!

In "View mode Delta FA"(the button ) and"View mode Delta FA"(the button

) modes display frame difference on the basis of amplitude Am and frequency F

vibration analysis in fast processing mode without filter preprocessing. It is additional

possibility to change color of background image.


46

In "mode Am" visualization and calculation of object parameters processed by pixel

vibration amplitude.

In "mode F" visualization and calculation of object parameters processed by pixel

vibration frequency.

3.3.3 Graph display

Selecting item "Graphs"submenu "View" – "Toolbar" switches on / off graph windows with

display changes in time vibraimages parameters (see Fig 3.45.).

Fig. 3.45. Graph windows display

Selecting, changing of some parameters will be displayed in the graphs make in the

information panel in the "GR" mode (see Fig. 3.56). To display the graph of the parameter in the

graph window you want to switch on the item "Display" = YES.

The number at the beginning of each graph shows the current value, and the two digits at the

end of the current graph show minimum and maximum value for the interval over which the automatic

adjustment scale on the Y-axis (vertical) is made.

Scale the output of the X-axis plots (horizontal) is given in the "Graph":

Parameter "Period (s)" sets in seconds time of display of a graph part on the screen.


47

Note, At viewing video file double click by mouse on the button changes value

"Period" so that on the screen the time axis corresponded to full length of video file.

Scale output on Y -axis (vertical) is determined for each graph separately in one of two modes:

If using mode "Auto" = YES, the vertical scale is automatically calculated.

If using the manual mode "Auto" = NO, the scale of the output of each individual graph

on the Y axis set parameters gMin (minimum value displayed on the screen) and gMax

(maximum value displayed on the screen), which the user must set yourself.

Fig. 3.46 Example, graph parameters for A1(fast).

Note (in development)

It is possible to playback recorded information (from AVI files) with graphs on the screen in

image area. For this purpose, it is necessary to execute the following actions:

Switch on "Graphs";

To bring the mouse pointer to interesting time on a time axis and twice to click the left

mouse button.


48

When you select a show mode of plots "Diff. mode" = YES on the graph will be displayed

not the absolute value of the parameter (mode "Diff. mode" = NO), and the difference between the

current value of the parameter and its average level in the previous measurement. The "Averaging

(s)" parameter in this case sets the number of seconds for the interval by which averaging parameter

values change.

In the draw the parameter values changes on the screen, the user can use two display modes:

No pre-filtering values ("Graph2" mode = NO).

With advanced filtering parameter ("Graph2" mode = YES). In this case, the parameters

"HF.flt." and "LF.flt." is set in % of the incoming frequency the filter cutoff frequency

for high (low) frequency for Battervort.

At the same time for easy viewing in the Histogram window displays three windows with the

results of the frequency analysis (see Fig. 3.47). The first screen displays the frequency analysis

vibraimage across the frame (red – amplitude, green – frequency of points vibration). In the second

window displays the traditional frequency analysis in 1 second human vibraimage, and the third – the

results of frequency analysis (with the use of the Fast Fourier transform) to change in time of the two

options that are selected in the "GR" information panel. Each parameter has the following settings:

"Green" – Spectrum Fourier parameter changes in time displaying graphs of green

color in the third window;

"Red" – Spectrum Fourier parameter changes in time displaying graphics red color

in the third window;

Fig. 3.47. Histogram window

3.3.4 Graph analyze

Item "Start H 10s" are intended for accumulation and viewing of the frequency information

about psycho-emotional condition of person for 10 seconds. For viewing results, it is necessary to

open sheets "H" in the basic window (see Fig. 3.48).


49

Fig. 3.48. Frequency analyses results

Note, the results of frequency analysis are automatically saved in the selected file folder in

the file Data_histH.png.


50

3.4 Toolbar

All toolbar buttons (Fig. 3.49) duplicated the corresponding items in the menu system. When

the tool tip determines the assignment of toolbar buttons.

Note, the selected toolbar button is highlighted in color or volume, depending on the main

window style.

Fig. 3.49. Toolbar.

– "Save current image" (Menu "File");

– "AVI: Start Capture" (Menu "File"). For stop AVI files recording needs push on

this button again

– "Open AVI file" (Menu "File");

– Camera – video from camera;

– "Stop/Start" (Menu "Action");

– "VI" mode (Menu "View");

– "AV" mode (Menu "View");

– "AR" mode (Menu "View");

– "LD" mode (Menu "View");

– Reset timer of video files to "0" (Menu "Action");

– Reset all accumulated information about frame difference. Start accumulation again

after reset. (Menu "Action");

– "Measurement" mode of accumulation and averaging of parameters for the certain

period (Menu "Action");


51

– "Start LD mode" to begin/stop data processing for a "Lie detector" mode (Menu

"Action");

– "Markers RQ, CQ, GQ" are used in Lie detection mode and serve for

installation markers on graphs at the time of "certain" type questions

– button which allows to open the database folder where you saved the images and

all results.

3.5 Vibraimage parameters

During the work VibraImage program calculates the following parameters:

The group of parameters A1-A4 registers amplitude of vibrations:

А1 – Frame difference between two consecutive frames

А2 – Frame difference accumulated in 10 consecutive frames

А3 – Frame difference accumulated in N consecutive frames

А4 – Value of parameter A1 filtered on 10 frames

The group of parameters F1-F9 registers frequency of vibrations (amount of changing points):

F1 – Calculated value of changed signal pixels amount in 2 consecutive frames

F1

(fast)

Calculated value of changed signal pixels amount in frames difference in fast

processing mode

dF1

(fast)

The average value of changes in the quantity of elements (the increment) for F1

(fast) parameter

F2 – Averaged value of changed signal pixels amount in 10 consecutive frames

F3 – Average value of elements quantity which have changed for the period of N frames

F4 – Changed pixels maximum frequency during N processed frames

F5 – Current tension level (%). Ratio of "high" frequency density to "low" frequency for

parameter F1. It's speed of element changing in frames difference.

F5

(fast)

The average value of the rate of elements change in the fast processing mode

calculation

F6 – Inhibition parameter. Average value of the F1 parameter period (in seconds),

determined during period F6N. Value of parameter F6N is set in section [Filters]

an "S" information panel and defines quantity of the frame processed in Fast

Processing mode


52

F7 – Root-mean-square deviation for F6 parameter

F8 – Not average (current) value of F6 parameter (in seconds), showing the current time

period of F1 parameter changing

F9 – Neuroticism parameter

The group of parameters S1 – S7 registers symmetry of vibrations between left and right parts of

person body:

S1 – Ratio (symmetry) of amplitude left to the right changed pixels inside the object in 2

consecutive frames

S2 – Difference between the left and right average amplitude of object vibration in 10

frames

S3 – Difference between the left and right average amplitude of object vibration in N

frames

S4 – Ratio of the changed pixels quantity in the left part of object to the changed pixels

in the right part in 2 consecutive frames

S5 – Ratio of the changed pixels quantity in the left object part to the changed pixels

quantity in the right object part calculated in 10 frames

S6 – Ratio of the changed pixels quantity in the left object part to the changed pixels

quantity in the right object part calculated in N frames

S7 – Difference between the maximal frequency of vibrations of the left and right object

parts in N frames

The group of parameters P1-P30 registers features of mathematical Processing of vibrations:

P1 – Dispersion of vibration density for frequency distribution at 10 processing frames

P2 – Dispersion of vibration density for frequency distribution at N processing frames

P3 – Center density distribution displacement of frequency at 10 processing frames

P4 – Center density distribution displacement of frequency at N processing frames

Р5 – Level of lie

Р6 – Level of stress. P6A – calculation of parameter is executed on vibration amplitude,

P6F – on vibration frequency.

Р7 – Level of aggression. P7A – calculation of parameter is executed on points vibration

amplitude, P7F – on points vibration frequency.

Р8 – Level of energetic. P8A – calculation of parameter is executed on points vibration


Р9 – Level of information entropy (on base of Shannon theory). P9A – calculation of

parameter is executed on points vibration amplitude, P9F – on points vibration

frequency.


53

Р10 – Entropy index. P10A – calculation of parameter is executed on points vibration


P11 - Antikurtosis (æ). Information theory parameter characterized density distribution

form.

Р12 – Level of classic thermodynamics entropy (on base of Helmholtz theory). P12A –

calculation of parameter is executed on points vibration amplitude, P12F – on points

vibration frequency.

P13 – Characterizes shift of the histogram in the right part (high frequencies). Thus,

parameters define color of active vibraimage pointer. Vibraimage pointer is active if

its brightness move than "Level L" value.

P14 – Control parameter. Define relation between area of active vibraimage pointer for

install threshold of active vibraimage pointer ("Level S" parameters). Thus if the

number of active points grows, than the parameter value increases and danger level

also increases.

P15 – Control parameter. Define relation between area of active vibraimage pointer for full

frame square. Vibraimage pointer is active if its brightness move than «Level L"

value.

P16 – Compatibility for 2 person. Calculated on frequency histogram analysis

(concurrence with normal distribution) (fig. 3.50, 3.51). If the frame one person – it

parameter "Balance".

P17 – Compatibility for 2 person. Calculated on aura symmetry analysis. If the frame one

person – it parameter "Charm".

Fig. 3.50. Correct position of people at

check of compatibility.

Fig. 3.51. Incorrect position of people at

check of compatibility.

P18 – Average compatibility by P16 and P17 parameters. 5 gradations are distinguished:

love, sympathy, indifference, hostility, hatred. If the frame one person – it parameter

"Selfregulation".


54

Р19 - Suspect level

Р20 - Quantity indicator of a degree of change psycho physiology parameters in view of

various factors of the measured parameters importance since the part of parameters

is accelerated, and others are slowed down during one reaction.

Р21 - Parameter "Health" (Health level for general oncology);

Р22 - Parameter "Health" (Health level for prostate oncology);

Р23 - the average of the "Health" (Mean value of health level);

Р24 - Parameter "Sleepiness" is normalized value of the P17 to the parameter F3;

Р25 - characterizes a sleepiness state of a person on variability of parameter P17.

Р26 - Extraversion level

Р27 - Stability level

P28 - Satisfaction level

P29 - Depression level

P30 - Happiness level

Parameters X1 – X5. In VibraImage program the user can form itself formulas for

calculation of new parameters of vibraimage, using any vibraimage parameters listing above.

3.5.1 Т1-Т12 parameters

For improvement of calculation, analysis and data compatibility vibraimage includes

additional complex T1 – T12 parameters having psychophysiological sense. Complex vibraimage

parameters represent psychophysiological information about a person and informative component of

these options depends not only on calculation algorithms, but also depends on targets and conditions

of vibraimage system applications. For example, under different test conditions (state of rest, stress,

movement…), the same parameters can provide information about the physiological and

psychological state of a person, as well as the suspicious level of person.

The set of parameters T1 – T12 is selected so that a maximum information records all

micromotion human head. In this case the name of each parameter Ti characterizes various

physiological characteristics depending on the vibraimage system application. The name isn’t primary

characteristics for said vibraimage parameter, it can be considered as suppositive and the formula by

which this parameter is determined has more correct sense. Despite the suppositive names, given

description uses the following (historically developed) range of parameters:

Т1 – Aggression (Р7);

Т2 – Stress (Р6);

Т3 – Tension/Anxiety (F5X);


55

Т4 – Suspect (Р19);

Т5 – Balance (Р16);

Т6 – Charm (Р17);

Т7 – Energy (Р8);

Т8 – Selfregulation (Р18);

Т9 – Inhibition (F6);

Т10 – Neuroticism (F9);

Т11 – Depression (P29, DP);

T12 – Happiness (P30, HP).

3.6 Information panel

Indication of information panel (fig. 3.52) depends on using mode:

Fig. 3.52. Information panel tables menu

In the mode information about adjustments of system and results of data vibraimage

processing is displayed;

In the mode settings for LD the mode parameters are displayed.

In the mode the average values of vibraimage parameters which have been calculated

and are average for the certain period are displayed;

In the mode the correlation parameters are configured;

In the mode vibraimage parameters selected for graphs are displayed and stood;

In the mode settings of basic parameters for work with VibraImage are configured;

In the mode input and selection of the demographic information and a folder for

archive storage is configured;

Note, Values of parameters in fields which are allocated by a green font, can be changed

by the user (fig. 3.53, parameters N, K, L – it is possible to change in Information table). For this

purpose, it is necessary to bring the mouse pointer to the chosen field and twice to click the left button

of a mouse.


56

3.6.1 Information panel. VI mode.

In the "VI" mode information panel (fig. 3.53) displays following information:

Frame rate:

"In" – Number of the frames per second, received from the video source;

"Fast processing" – Maximum number of the processed frames per second used for

calculation. Selected by user;

"Base processing" – Number of the processed frames per second used in base algorithm.

Selected by user;

"Video Timer" – For camera mode- displays time of supervision. For recorded video - time

of current video-file record. For viewing a video-file - time from the file beginning);

"Stream errors" – The counter of mistakes which increases if time between the next accepted

frame astably. This mistake can arise, if productivity of a computer suffices or poor-quality

video is loaded;

Info:

N – Number of the frames for accumulation. Selected by user;

L – Palette Threshold. Defines a threshold in the displayed image, value of brightness less

threshold is considered «black». Selected by user;

Width and Height– Displays the current video camera or AVI file resolution;

Statistics:

IntegratedN(Am – Average frame amplitude vibraimage intensity processed for the N

frames.;

IntegratedN(f Average frame frequency vibraimage intensity processed for the N frames;

"Critical level %" – threshold of a psychoemotional status of the person exposed in % in case

of which exceeding on the remote terminal the warning message will be issued;

"Suspect" – Calculated level of suspect for object in frame;

"Aggression" – Calculated level of anger for object in frame;

"Stress" – Calculated level of stress for object in frame;

"Tension" – Calculated level of tension for object in frame;


57

Audio:

"Level" – current level of audio signal.

Fig. 3.53. Information panel in the VI mode.


58

3.6.2 Information panel. M mode.

In "M" mode an information panel (fig. 3.54) detects current and average for the period values

of psychophysiological parameters and their deviation from the established norm. The basic targets

of the given mode are use of vibraimage system for medical (physiology) diagnostics and

psychological researches and testing.

a) b)

Fig. 3.54. M mode of information panel

Value of the averaging period is set in seconds in a field "Duration". Start of the beginning

of information accumulation is made by a choice of item "Measurement" the menu "Action" or

pressing of the toolbar button . After start of an accumulation and averaging mode in the top

of information panel there is a running line "Progress", displaying a course of data accumulation

process.

с


59

Information panel in "M" mode shows the following information:

Basic T1 – T12 parameters describing psycho-emotional condition of the person:

Aggression, Stress, Tension/Anxiety, Suspect, Balance, Charm, Energy, Self regulation,

Inhibition, Neuroticism, Depression, Happiness.

VibraImage parameters A1 – A4, F1 – F9, S1 – S7, P1 – P4, Р21 – Р30;

Fast processing VibraImage parameters A1 fast, A4 fast, F1 fast, F5 fast;

For each parameters displays the following numerical values:

V – The value of the parameter average for the set period

S – root-mean-square deviation of parameter

VI – The variability of the parameter over a specified period

cMin – The minimal value of parameter for the period

cMax – The maximal value of parameter for the period

NMin – The minimal value of parameter for a normal condition of the

person

NMax – The maximal value of parameter for a normal condition of the

person

Note

Values of cMin, cMax parameter, are displayed only when measurement mode "M" starts and

the information for the specified period of time is saved up.

Note, after ending of the information accumulation some lines of an information panel can be

allocated by color:

– parameters, which values less than the set limits are allocated.

– parameters, which values more than the set limits are allocated.


60

3.6.3 Information panel. LD mode.

In the mode "LD" information panel (See Fig 3.55) defines the basic "lie

detection"information processing mode and displays the following information :

VibraImage parameters A1 – A4, F1 – F9, S1 – S7, P1 – P4;



V – Current parameter value;

cMin – The minimal value of parameter for the period

cMax – The maximal value of parameter for the period

bMin – The average basic minimal value of parameter for a normal condition of

the person

bMax – The average basic maximal value of parameter for a normal condition of

the person

Note

Values of cMin, cMax, bMin and bMax parameter, are displayed only when "LD mode" has

been began/ In other case that value equal "0".

For each parameter set following numerical values, which using in Lie detector calculation:

Calculate Yes – this parameter using in LD level calculation, No- not using

R1V "Weight" of parameter (Rate1) if its current value became more than

the set base maximum bMax OR became less than the set base

minimum bMin. Use in Р5 parameter calculation.

R2V "Weight" of parameter (Rate2) if its current value became more than

the set base maximum bMax AND became less than the set base


R1C "Weight" of parameter (Rate1) if its current value became more than

the set base maximum bMax OR became less than the set base


R2C "Weight" of parameter (Rate2) if its current value became more than

the set base maximum bMax AND became less than the set base


Level In % determines on how many value of parameter should exceed the

set limits that the system "considered" this change.


61

Fig. 3.55. Information panel in LD mode. Explanation of the parameters bMax, bMin, cMax, cMin.

3.6.4 Information panel. GR mode.

The "GR" information panel (See Fig 3.56) allows you to customize the output graphs of

parameters changes and displays the following information:

Fig. 3.56. "GR" mode of information panel.


62

"Graph" section

"Period (s)" – define graphs visualized period (in seconds) on the screen

"Average (s)" – specifies the number of seconds in interval by which averaging

parameter values is made.

Test signal sin(2π*nt);

"Integral" section

Total intensity of the points oscillation amplitude across the frame, accumulated over 2,

10 and N frames: Integrated2(Am), Integrated10(Am), IntegratedN(Am);

Total intensity of the points oscillation frequency across the frame, accumulated ove 2,

10 and N frames: Integrated2(F), Integrated10(F), IntegratedN(F);



Corelation parameters С1 – С4;

User programming parameters Х1 – Х5;

For each parameters displays the following values and settings:

V – Current value of parameter

Show – Show graph – Yes, delete graph – No

Graph2 – Graph2 = Yes – graph line will show with using filters. Graph2

= No – filter no used.

Diff. mode – Choice of this mode – YES, graph will show difference between

current value of parameter and its average level for Diff time.

Choice of this mode – NO, graph will show current value of

parameter

Auto – When the parameter set "Yes", calculation of the scale on the Y

axis of the graph make automatically.

gMin – Defines the minimal value of parameter shown on the screen

gMax – Defines the maximum value of parameter shown on the screen

HF.flt.% The filter of high frequencies on Battervort. Frequency of a cut

is set in % from entering graph frequency.

LF.flt.% The filter of low frequencies on Battervort. Frequency of a cut

is set in % from entering graph frequency.

GR. Selected parameter displays in down spectrum histogram by

green graph (fig. 3.57)

Red Selected parameter displays in down spectrum histogram by red

graph (fig. 3.57)


63

Fig. 3.57. FFT diagram


64

3.6.5 Information panel. С mode.

Information panel in "C"mode (fig. 3.58) allows setting the mode "Correlation"and displays

the following information:

The correlation between parameters is calculated on base Pearson method. If one of parameter

is select in his line draw field. Select this parameter to check the correlation is performed by

double-clicking the left mouse button over this field.

Fig. 3.58. "C" mode of information panel.

"Settings" section:

"Enable correlation" – defines the switch on/off "C"mode;

"Mediane" – define what parameter value (average or mediane) will use in correlation

calculation.

"Period" – defines what period occurs correlation parameters;

"Auto shift" – determines the maximum shift in time not influencing correlation

coefficient,

"Sort" – allows you to rank display parameters of the maximum current value of the

correlation coefficient to a minimum


65

"HF flt", "LF flt" and "Average flt" – defines mode for the additional processing (filtering)

of source data before calculation.

"Correlation" section:

Total intensity of the points oscillation amplitude across the frame, accumulated over 2,

10 and N frames: Integrated2(Am), Integrated10(Am), IntegratedN(Am);

Total intensity of the points oscillation frequency across the frame, accumulated ove 2,

10 and N frames: Integrated2(F), Integrated10(F), IntegratedN(F);



Test signal sin(2π*nt);

Corelation parameter С1 – С4. Frame is divided into four zones and parameter estimation

is performed between zones. For example, when using mobile versions VIMobile

estimated background vibration (vibration due to human brush), and the man himself

vibration.

User programming parameters Х1 – Х5;


66

3.6.6 Information panel. S mode.

Information panel in "S"mode (fig. 3.61) allows adjusting vibraimage parameters and displays

the following information:

Frame rate

Fast processing Frequency (fps) for processing «fast"parameters of vibraimage,

noted by a word "fast"

Base processing Frequency (fps) for processing "base" parameters of

vibraimage, noted by a word "base"

FPS proc.period Frequency of the frames (fps) during calculation period

Downrate Reduce input frame rate. At value 3, will be processed every

third frame.

Main settings

N(2) Minimum number of accumulated frames. By default, 2

N(10) Average number of accumulated frames. By default, 10

N Maximum number of accumulated frames. By default, 100

K Gain factor.

L Threshold of a palette. Defines a threshold of displayed image,

value of less brightness considers as "black"

Apply global filters If this parameter is "Yes", than other parameters calculated with

filtering.

Cores The number of simultaneously displayed cameras. Depending

on the dongle less than 10.

Filters

Single points Removes single points, surrounded by black

Extended It is intended for reduction of noise of a video camera. Delete

video noise in bit. By default, 8.

This filter is important, when the object is motionless, and

values changed because of camera noise.

Extended (fast) Delete video noise for fast processing.

Stretch Scale normalization filter to a range 0 – 255 after its

"trimming" by filter Extended


67

Max speed contour At the included mode, calculation fast parameters are made

only inside of aura contour, at switched off – on the whole

frame.

Am scale Multiplication factor used for vibraimage visualization in a

"amplitude" mode

Space Reduce vibraimage on borders of motionless contrast objects.

Color image No – Black and white real image in image area. Yes – color

image in image area.

Crops

Crop X, Crop Y If real image size more than 640x480 pixels, than will be use

only 640 x 480 pixels from centre part of image.

Crop X pos, Crop Y

pos

When cropping images define the coordinates (the position of

the upper left corner) the clipping region.

F6

F6 HF Sets in % frequency of a cut for the filter of high frequencies at

processing F1_fast parameter.

F6 LF Sets in % frequency of a cut for the filter of low frequencies at

processing F1_fast parameter.

F6 N Number of averaging frame at calculation of F6 parameter

FPS filter It is used for exact synchronization with a binding to the

concrete frame at work with Avi files. Frequency of the input

frame from the camera divided on set Base processing frequency

and for processing will undertake each N frame.

E-Monster Switch to the E-monster mode. The program opens the person

face deformed by latent emotions though externally he can

constrain these emotions. If the emotional condition of the

person is like to normal, then the the program image is like to

real video. Accordingly, than more emotions overflows the

person, then more especially deformed his image in Monsters

Detector mode (E-Monster).


68

Fig. 3.59. Face in E-monster mode

Auto downrate Automatic calculation of Downrate parameter is made in view

of frequency of the input frames, Base processing frequency and

computing capacity of a computer.

Fixed contour In this mode vibra-aura around the human contour will be built

around a fixed path, and not to repeat the contours of the body.

Stab. Х Image stabilization in the X coordinate is entered when

significant vibrations image on the X axis

Stab. Y Image stabilization in the Y coordinate is entered when

significant vibrations image on the Y axis

Suspicious thresholds

Ag, St, Tn

Suspicious level in the Aggression parameters (Ag), "Stress"

(St), "Tension" (Tn) is set. When exceeding level of danger the

system gives out a sound signal and fixes a frame.

Disable Note: Canceling of parameter calculation is use for increase

calculation speed of other parameters.

Disable Am Canceling of points fluctuation amplitudes calculation

Disable F Canceling of points fluctuation frequencies calculation

Disable 2x(fast) Canceling of 2 frames parameters fast calculation

Disable VI(10) Canceling of 10 frames parameters calculation

Disable VI(2) Canceling of 2 frames parameters calculation

Disable FFT Canceling of Fast Fourier Transformation frequency

processing

Disable Entropy Canceling of Entropy processing

Disable Audio Canceling audio analysis


69

Motion detection

Motion detector Delete emotion calculation for object with motion amount less

than threshold

Level Threshold level of Integrated10 for emotion calculation.

Auto reset Reset emotion calculation for macro movement

Skip frames Skip frames with the frame difference more than threshold.

Lie detection

Enable Enable LD mode.

Stat periods Before you begin the process of "lie detection" system during

the "Base period" (in seconds) collects information to

determine the maximum and minimum current values of human

parameters that then at "lie detection" time during the "Stat

period" define "abnormal"change individual values

parameters.

Base periods

Lie threshold Threshold (in %) for the detection of lie level in view of every

calculated parameters and their «weights»

Audio sens. (s) After the ending of answer the system continues to expect "lie"

calculation during the specified time interval.

Audio level The sound level is used to start / stop lies detection process in

the "Audio" mode.

Opposite mode Alternative method of lie level calculation.

LD mode: Selection of mode for lie detection

Audio Calculation of lie level starts when the level of entrance audio

signal exceeds the established threshold. LD calculation stops,

when the level of audio signal becomes less than the

established threshold

Manual Accumulation of the information is made in time "Base

periods". Calculation of lie level is made only after pressing

button "Start LD" , the end of processing – after repeated

pressing this button


70

Auto Calculation of a lie level works constantly, current values of

parameters (Stat period) are compared to values processed for

previous Base period

Compare Off – at the analysis of lie, as test, the interval "Base periods"

directly till the moment of started lie detection is used.

On – at the analysis of lie, as test, the interval "Base periods"

which has been marked by the user beforehand is used. When

the user includes accumulation the preliminary information, in

this field value "Capture"

Text Switch on/off display "text questions" in "LD Question"

window

AVG filter

Anger Number of frames for aggression level averaging

Stress Number of frames for stress level averaging

Tension Number of frames for tension level averaging

Suspicious Number of frames for suspect level averaging

Macro mode

Macro mode Define on base of which formula danger level calculated. NO –

danger level calculated on base of Anger, Stress and Tension

levels. YES – danger level calculated on base of P13, P14 and

P15 parameters values.

Level L Threshold of a palette for danger calculation only (not for

displayed image. threshold of displayed image define

parameter L). Value of less brightness considers as "black" and

not used in danger calculation.

Level S Threshold of a area (in % from full frame square). Defines area

of "active brightness" pixels. If area of pixels (in %), which

brightness more than «Level L"value, less than "Level S"

value, than danger parameters in Status window equal 0.

Aura mode Reserved for future use

Macro mode + Yes – the danger level is considered for every single person in

the frame.

No – the danger level is averaged over the entire frame.


71

Face detection

Face detection Yes – face detection mode is used. No – without face detection

Detection quality Quality of face capture. 1 – capture one large person face in

the frame (loading of the processor is minimal), 4 – search of

all (even small) persons face in the frame (loading of the

processor is maximal).

Scale 1: X Sets the aspect ratio of the picture before detection of persons

Min size

Max size

Sets in pixels the size of rectangle for search of persons

Config The program gives the user an opportunity of loading the new

algorithms of person search. In the given line the path to a file

of new search algorithm is displayed. In more detail procedure

of loading of new algorithm is described in section 6.2 "Macro

Mode"

Draw No – not draw rectangle around face, Yes – draw rectangle

around more danger single person, All – draw rectangle for all

danger person in frame. For non-danger person rectangle draw

green color, but if person suspect level more than "Critical

level", than rectangle draw red color.

Quality test

Enable Switch on mode of automatical check of image quality (see p.

2.3.1)

Light level Parameter use for define image noise level when illumination is

low.

FPS max, FPS min Maximum and Minimum allowable input frame rate.

Face delay This parameter determines how long (in seconds) the program

can not recognize a human face in the frame before you will get

an error message

Alerts

Critical level % Stands critical (upper) level of emotion parameters for alarm

signals

Customer level % if suspect level lower than cutomer level then person will be

detected as "dangerous"

Area threshold%,

Area level %

Used to account for the small area factor of moving objects

relative to the frame area during the suspect level calculation.


72

Auto capture image

Auto capture image (s) At excess of the preset level psycho-emotion danger in the

specified catalogue BMP files of the "dangerous" person from

display screen will saved automatically. Record will be made

one time for the specified quantity of seconds. (see p. 3.7.4)

Hide after (s) After this period in seconds captured images will not displayed

Save image files Determines to save or not photo file of "dangerous person"in

the database

Save face XML Save information about position "dangerous person" on image

Save faces Save image inside detected contour

Print suspect On/Off displaying parameters A (Agression), S (Stress), T

(Tension), Suspect on captured image

Fig. 3.60 Print suspect

Save original Save original image without vibraimage processing

Image format Choose format of saved image file (BMP, PNG, JPEG) By

default PNG.

Show N image At work in Macro mode in "Capture window" will be

consistently displayed N images of "dangerous" objects, but if

for the specified interval of time has passed some "suspicious"

objects.

Sound (Susp) Defines, the sound signal will be used at work if "danger"

person appear or not.

Sound (A), Sound (S),

Sound (T)

Level for sound of a audio signal at excess of aggression, stress

or suspect levels the setting limits.

Maker’s beep On/Off maker’s beep in LD mode


73

Reset beep On/Off reset sound beep.

Audio file upload Audio file

FTP Storage

enable FTP Switch on/off FTP network protocol

configuration file way for configuration file of FTP

Fn

X1-X5 In VibraImage the user can form itself formulas for calculation

of new parameters of vibraimage, using any vibraimage

parameters. For example (fig. 3.61).

Fig. 3.61 User’s formula for parameter X1 calculation


74

VibraSound

Disable std. sound

YES - VibraSound mode is switch on.

NO - VibraSound mode is switched off, the sound acts either

from a microphone or from a video file.

Vibra sound To switch on the VibraSound must select one of the values CG,

CR, HG, HR, SG, SR

If one of these items is chosen than VibraSound sound will be

switch on and will be modulated by curves of signal change in

one of frequency distribution windows (fig. 3.57). Letters C,

H, S define, from what window the signal for "sound" will be

used: C – the first window, H – the second, S – the third.

Letters G and R – show what color of graph will define

"modulation" of a sound: G – green color, R – red color.

Network service

Enable service sanction of information transfer to network between a computer

on which program VibraImage.exe is started, and the terminal.

Critical level %

Customer level %

Full video stream

Lower (customer) and higher (critical) threshold of psycho

emotional conditions of the person at which excess on the

removed terminal the warning message will be given and the

picture of danger object (if parameter "Full video stream" = NO)

is sent or the video information (if parameter "Full video stream"

= YES) will be transferred.

Compression When transferring video the compression will be applied.

Parameter value define the compression rate

Local TCP port VibraImage.exe program interrogates the given port for data

exchange with the terminal.

Remote host – name of the removed terminal

IP network address of terminal computer on which program

VINetStatus.exe is started.

TCP port, UDP port Ports for software of terminal, through which it changed by

information with the computer, on which started program

VibraImage.exe. Through UDP port goes an exchange by short

messages. Through TCP port goes an issue video data.


75

Capture

Max length (s) Defines the maximal length (in seconds) for recorded video file.

After file limit finished and closed, a new file creates.

Purge old files Defines system action when the empty space on a hard disk will

finish. "YES" – the oldest video files will be removed.

Timer The system can begin record at the appointed time.

Capture channel Mode of vibraimage video (SRC, SRCAm, SRCF etc.)

The VibraImage system implemented the ability to work in a complex network monitoring

mode, when on the local module (a computer connected to the camera) VibraImage.exe is running,

which makes the diagnosis and condition of the person on the psycho-physiological parameters, and

on the other computer (terminal) one of the two modules running VINetStatus.exe or

VINetServer.exe.

More detailed information about the settings for the network mode operation, see the

"Behavior Detection System 8 PRO", http://www.psymaker.com/downloads/VI8_1ManualEng.pdf

section "Network monitoring"

3.6.7 Information panel. DB mode.

In "DB"mode information panel (see Fig 3.62.) used to manage the experimental data records

and displays the following information:

Fig. 3.62. DB panel.

"DB folder" – Way to the database folder for written video files and files of statistics;

"Selected record" – Data on current object of research. List of all saved entries will be

displayed below.

"New record" – Information about the object of research is introduced in any form by

double-clicking the left mouse button over this field.

http://www.psymaker.com/downloads/VI8_1ManualEng.pdf


76

3.7 Save of measurements results

Note, until the specified database folder not set, then AVI file recording, BMP and other files,

settings and results saving to the archive will be blocked. All results are stored in a single "_Default"

folder created in the directory where the program \ VibraImage10 \ database \ installed.

The way to the catalogue of an archive database where video files, files of images and files of

statistics will be save, is specified in a field "DB folder" in "DB" information panel. The list of

objects, the information about which is in the specified catalogue displays as the list in the bottom of

an information panel. In line "Selected record" show curent record with which the system operates in

a given time.

Item "New records...” use for a new entry into the database. A further saving of files in the

archive will be made in the folder associated with the name of your entry. To make a new entry in

the archive, you must bring the mouse pointer to the line "New record" and double-click the left

mouse button.

Fig. 3.63. Example, new records is created in database

3.7.1 Save of current images

The structured store of observable images in format BMP files according to the entered

demographic data is carried out with the help of a command "Image capture …" menu "File" or

the corresponding button of the toolbar.

NOTE, in archive as separate BMP files will be written down images from all open windows

in the field of supervision. For example, in the field of supervision 3 windows with processing image

are open (VINA and VIN

F) and in archive result 2 files of images will be save:

2014-04-22 11_48_51_vi1_F.bmp

2014-04-22 11_48_51_vi1_A.bmp


77

3.7.2 Save of video file

Save of the current image which appears in the basic window, in format AVI file is carried

out with the help of a command "AVI: Start Capture" menu "File". Stop AVI- file recording

process is carried out repeatedly selecting this menu item. The same actions can be executed with the

help of the corresponding button of the toolbar.

Note, that if in the image area open multiple windows with different ways vibraimage

processing (see Figure 3.64), the user in the section "Capture channel" of informational column in

the "S" mode should be selected from any open window will be recorded the information to videofile.

Note, data is written to a file with all of the switched processing modes. If you want to record

only the video image without processing, it is necessary to select SRC recording channel.

Fig. 3.64. Select vibraimage channel for videofile saving

For increase of video files recording reliability in "S" information panel designed the field

"Max length (s)" (records in seconds). If record lasts over the specified interval current AVI the file

will be closed and save on a disk, and record will be continued in a new file. At filling the whole disk

if the set "Purge old files" parameter the record of new video-files will be made atop of old. The

first "oldest" will leave by date of creation video-files.


78

3.7.3 Save of results and settings files

1. After completion of the process of "Measure" (mode "M") and collect information about

the psycho – emotional state of a person in a specific database directory the following files are

automatically recorded:

Data_time_histH.xml – system settings and change the basic parameters of the psycho -

emotional state of a person in the course of the experiment.

Data_time_M.xls – report file with results of analysis psycho -emotional state of a person

for the specified period.

2. In addition the user can save in an external file with extension *.xml system settings at the

moment of the beginning of the information analization.

Item "Save settings as …" the menu "File" is intended for saving the current system settings

to external XML file.

Item "Load settings …" is intended for loading before saving settings from external

XML file.

3. After completing the questionnaire in lie detection mode automatically in the selected

database directory \ VibraImage10 \ Database \ *** creates files with the test results :

Data_time_histT.png – an analysis of changes in the human psycho - emotional state

at the time of testing.

Data_time_histH.xml – system settings and change the basic parameters of the psycho

-emotional state of a person

Data_time_LD.txt – lie detector report and result files

Data_time_row.txt – Full record values recorded vibraimage system parameters. This

file can be used for statistical research and testing of algorithms for determining the

psychophysical and psychoemotional human condition.


79

3.7.4 Auto capture image in Macro mode

In Macro mode there is some settings for auto capture image (fig. 3.65) for automatically

saving image files of the "dangerous" person at excess of the set level psycho-emotion danger in the

specified catalogue:

Fig. 3.65 Submenu auto capture image in S information panel.

Item "Auto capture image" configure the number of images saved from the screen in a time

period "Hide after (s)" in seconds.

Item "Save image files" determines whether stored in the database directory photo file

of "dangerous person"or not.

Item "Save face XML" Suspicious person face’s data (fig. 3.66 c) or not.

Item "Save faces" determines save image with a detected «suspicious"person in frame

(fig. 3.66 b) or not.

Item "Save original" determines save original image (fig 3.66 a) or not.

Item "Save settings as…" the menu "File" is intended for saving the current system settings

to external XML file (fig 3.66 d).

Item "Image format" determines format of auto capture image (PNG, JPG or BMP).


80

a) Original image b) Image with a detected "suspicious"

person in frame

c) "Suspicious" person face d) Suspicious person face’s data

Fig.3.66 Result files of Macro mode

Suspicious person face’s data file fig.3.66 (d) includes the following information:

<face face_rect="274,127,461,326 " – facial coordinates in pixels of left down and right

up points from the frame;

level = "0,631029" – suspicious level of captured person;

img_size = "640,480" /> frame size in pixels.


81

4 The basic modes of the VibraImage system

VibraImage system has 3 basic operation mode:

1. Micro mode – it is intended for supervision, research and the analysis psycho emotional

conditions of the one person in the frame.

2. Macro mode – it is intended for supervision, research and the analysis psycho emotional

conditions of the people in crowd.

3. "Lie detector"or LD mode - it is intended for lie detection of the one person in the frame

center.

4. Mix mode – it is intended for supervision, research and the analysis psycho emotional

conditions of the people in crowd with accuracy close to Micro mode.

The user can choose a system operating mode, having set options by default, selecting the

appropriate line in the sub-menu "Settings" – "Default"(see Fig. 4.1).

Fig. 4.1 Select "Micro" mode

When you select one of the basic modes of operation (micro, macro or lie detection) and load

its default settings, the system automatically displays only the necessary window (Fig. 4.2).


82

Fig. 4.2. "Micro" mode uploaded

4.1 Micro mode. Emotions (personality traits) definition

The main targets of the MICRO mode ("M") are receiving significant psychoemotional and

psychophysiological personality portrait and carrying out functional diagnostics test person. It is

possible to use MICRO mode for security system applications and identify suspicious people on the

protected objects. Usually, for security system applications MICRO mode is using without M button,

and detection of the suspicious level (Suspect indicator) is based on calculating T4 parameter in real

time mode.

MICRO mode gives highest accuracy in the measurement of psychophysiological parameters

relative to Mix and Macro modes. With correct vibraimage settings is possible to achive minimal

error rates as (2 % < FRR < 10 %) in the MICRO mode.

It is known that the psychoemotional and psychophysiological state of a person is constantly

changing under the influence of external and internal factors. In the "M" mode are measured average

values of psychophysiological parameters T1 – T12 (emotion12print) for the fixed time period and

their deviation from the established norms.

There are different science opinions about emotions, behavior and personality traits. General

description about these points is described in Wikipedia and science publications, see

https://en.wikipedia.org/wiki/Emotion

https://en.wikipedia.org/wiki/Behavior

https://en.wikipedia.org/wiki/Personality_psychology

https://en.wikipedia.org/wiki/Emotion

https://en.wikipedia.org/wiki/Behavior

https://en.wikipedia.org/wiki/Personality_psychology


83

Elsys Corp suggested own concept about personality and mental features which includes

several main points:

1. Preferable math methods than words for personality traits indication, because math formula

gives only one sense for indication. The word has different interpretation because different users give

different sense to the same word.

2. The list with formulas for indication of every vibraimage emotion12print algorithm is

described in VibraStat program manual. It is not necessary to obstruct the current Manual by unused

for typical user information.

3. For T1 – T12 parameters was selected 4 main parameters for indication positive emotions

(personality traits), 4 main parameters for indication negative emotions (personality traits) and 2 main

parameters for indication of physiological characteristics. In our understanding we selected the most

important and informative parameters for selected groups and used the terms based on current

psychology science level.

4. From vibraimage point of view we suggested the different math methods for head vibration

calculation because the main math task of vibraimage is to detect all parameters of head vibration so

as we supposed that head vibrations reflect all personality traits and emotions.

5. Of course the list of selected parameters is not finished. Based on customers’ requests is

possible to extend this list and add some parameters which are actual like sleepiness level or tiredness

etc. The most part of a new emotional parameters could be calculate based on existing emotion12print

(T1 – T12) after additional reseaches and statistics capturing.

The analysis determined the expectation M, standard deviation S, and variation V = S/M for

the following psychophysiological parameters measured in ("M") mode:

Т1 – Aggression (Р7)

This parameter is determined by the frequency histogram and represents the maximum

allocation of the frequency and SD vibration frequency of the human face. The higher value of the

maximum distribution and higher SD value gives the greater value of the parameter T1.

a) b)

Fig. 4.3 Agression; a) T1= 18 %, b) T1= 60 %

http://www.psymaker.com/downloads/VibraStatRus.pdf


84

Т2 – Stress (Р6)

Parameter is determined by degree of the external vibraimage (vibra-aura) asymmetry, means

asymmetry of micromovements from the left and right parts of the person’s head. The great difference

in amplitude and frequency movements for the left and right parts of the face (head) characterizes the

increased T2 parameter level.

a) b)

Fig. 4.4 Stress; a) T2 = 17 %, b) T2 = 45 %

Т3 – Tension/Anxiety (F5X)

Parameter is determined by the relation of high-frequency part of a range of vibrations to the

general power in a range of micromovements frequency for human head. High value of high-

frequency vibrations density characterizes high value of the T3 parameter.

a) b)

Fig. 4.5 Tension; а) T3 = 28 %, б) T3 = 48 %


85

Т4 – Suspect (Р19)

The parameter is determined as the sum average of the first three conditionally negative

emotions (T1, T2, T3) and characterizes the general level of conditionally negative emotions in a

person status.

a) b)

Fig. 4.6 Suspect; a) T4 = 20 %, b) T4 = 65 %

Т5 – Balance (Р16)

The parameter is determined by the frequency histogram and characterizes the level of

similarity of the current frequency histogram to the Gaussian distribution law. The high level of

frequency histogram similarity to the normal law is characterized by a high level of balance, and

significant deviation from the Gaussian distribution is characterized by a low level of the parameter

T5.

a) b)

Fig. 4.7 Balance; a) Т5 = 10 %, b) Т5 = 80 %


86

Т6 – Charm (Р17)

The parameter is determined by the symmetry (left – right) of the head and face

micromovements, the maximum symmetry of movements (including frequency and amplitude)

represents a high level of charm T6.

a) b)

Fig. 4.8 Charm; a) Т6 = 85 %, b) Т6 = 40 %

Т7 – Energy (Р8);

The parameter is determined by the frequency histogram and characterizes the difference of

the maximum density of the vibration frequency and vibration frequency SD for the face and human

head. The higher value of the maximum density and lower SD or variation of vibration gives the

higher value of energy T7.

a) b)

Fig. 4.9 Energy; a) Т7 = 3 %, b) Т7 = 70 %


87

Т8 – Selfregulation (Р18);

The parameter is determined as the sum average for conditionally positive emotions (T5, T6)

and characterizes the general level of conditionally positive person emotions at the measurement time.

a) b)

Fig. 4.10 Selfregulation; а) Т8 = 30 %, б) Т8 = 80 %

Т9 – Inhibition (F6);

It has a real physical dimension (time in seconds) and characterizes the minimum time of the

person reaction for the shown event (the stimulus). The value of the parameter T1 = 0.1 means that

the reaction time is 0.1 s. The greater the reaction time corresponds to a higher level of inhibition.

a) b)

Fig. 4.11 Inhibition; a) Т9 = 12 %, b) Т9 = 25 %


88

Т10 – Neuroticism (F9).

The parameter characterizes the SD measured value of the inhibition level (T9) at the

measurement time (default 60 seconds). High level for inhibition SD of psychophysiological state

characterized by instability and indicates high level of neuroticism T10.

a) b)

Fig. 4.12 Neuroticism; a) Т10 = 10 %, b) Т10 = 35 %

Т11 – Depression (P29);

The parameter is determined by the frequency histogram. It characterizes the SD of histogram

and how much energy testee spend for the state. The high level of SD with big meaning energy of M

is characterized by a high level of depression. Depression will be minimally if vibro-aura has 1 colour.

a) b)

Fig. 4.11 Depression: a) Т11 = 16 %, b) Т11 = 40,2 %


89

Т12 – Happiness (P30).

The parameter displayes position of test result on I-E diagram. Low level of energy

consumption and high level of the information content of the exchange mean high level of T12. If

energy consumption increases and PPS (mood) decreases than T12 becomes smaller.

a) b)

Fig. 4.12 Happiness: a) Т12 = 43,3 %, b) Т12 = 90,9 %

Note:

The set of parameters T1 – T12 is selected for capturing of the maximum information content

for human head micromotion. At the same time the name of each Ti parameter can characterize

different physiological characteristics, depending on the application of the vibraimage system. The

primary characteristic for each parameter is not his name, the name can be considered secondary, but

only math formula (equation) for psychophysiological parameter calculation is primary.

Mathematical formulas, on which a calculation of parameters T1 – T12 are shown in the description

of the program of statistical processing of the measurement results (VibraStat).

Note:

1. Every from T1-T12 psychophysiological parameters measured by vibraimage system

are specified to range 0 – 1 (0 – 100) % using fixed coefficients experimentally selected.

2. Mathematical formula by which measured psychophysiological parameter is

determined is primary, and a code name (for example, Agression) is secondary. Psychophysiological

meaning of each parameter T1 – T12 may be varied depending on the experimental conditions.

3. The set of measured parameters T1 – T12 determines the total psychophysiological

(psychosomatic, functional) status of a person based on the integral coefficient K.

http://www.psymaker.com/downloads/VibraStatRus.pdf


90

Note:

This description is valid for the parameters to the default settings of the system and perform

basic rules for getting vibraimage:

uniformity and stability of the lighting;

use of low-noise television cameras;

frontal location of the object in front of the camera;

maximum "inscribing" the subject's face in the monitor;

mechanical stability of video camera.

4.1.1 "M" mode of information panel

In a "M" mode an information column (fig. 4.13) allows to control average for the period

parameters value of psycho-emotional person conditions and their deviation from the established

norm. The basic applicability of the given mode is use of vibraimage system for medical diagnostics

and psychological researches. Start of the beginning of information accumulation is made by a choice

of item "Measurement" of the menu "Action" or pressing of the toolbar button . Value of the

averaging period is set in seconds in a field "Duration". After start of an accumulation and averaging

mode in the top of an information column there is a running line "Progress", displaying a course of

data accumulation process.

Fig. 4.13. "Measure" mode start

с


91

After gathering information in the information column in the "M"mode for all vibraimage

parameters (A1 – A4, F1 – F9, S1 – S7, P1 – P4) and all the parameters that characterize the psycho-

emotional state of a person (T1 – T12), displays the following information :

V – The value of the parameter average for the set period;

S – root-mean-square deviation of parameter;

Vi – The variability of the parameter over a specified period;

cMin – The minimal value of parameter for the period;

cMax – The maximal value of parameter for the period;

NMin – The minimal value of parameter for a normal condition of the

person;

NMax – The maximal value of parameter for a normal condition of the

person.

Note, after ending of the information accumulation some lines of an information panel can be

allocated by color:

– parameters, which values less than the set limits are allocated.

– parameters, which values more than the set limits are allocated.

Statistically set norms (corresponding to the normal state of man) for supervised psycho-

emotional parameters Aggression, Stress, Tension/Anxiety, Suspect, Balance, Charm, Energy, Self

regulation, Inhibition, Neuroticism, Depression, Happiness are shown in Figure 4.14 in columns and

NMin NMax. Note, that each parameter has its own range of normal values and deviations.

Set of the T1 – T12 parameters is selected so that with the maximum information content to

record all micromovements of a human head. Thus, the name of each Ti parameter can characterize

different psychophysiological characteristics depending on use of any VibraImages programs.


92

Fig. 4.14. Information panel in "M" mode.

4.1.2 Psychophysiological state analysis results

Note, that the analysis results are automatically saved in the database folder in the form of

following files:

Data_time_M.xlsx – report file with the base results of psychophysiological state

analysis of a person for the specified period.

Data_time_histH.png – frequence histogram


at the time of testing

Data_time_histH.xml – system settings and change the basic parameters of the

psycho - emotional state of a person. Note, The parameters T1 – T12 defined in the M

mode, may be processed in VibraStat program

Note, that the base results of psychophysiological research are given in Data_time_M.xlsx

file (see Fig. 4.15).

http://www.psymaker.com/downloads/VibraStat.zip


93

Fig. 4.15. Base results of the human psycphysiological state analysis

The parts of base results could be looked more detail by additional tables and pictures.

After gathering the information will be available the results of "Frequency Analysis" and the

analysis of changes in the psycho - emotional state of a person. To do this, the appropriate sheets (see

Fig. 4.16) must be opened in the main image window.


94

Fig. 4.16. Frequence histogram in sheet "Н"

In a window with the frequency histogram will be showed the graph of amplitude histogram

(the graph is painted by red color), the histogram of frequency is painted by green color.

Each histogram is characterized by the following parameters:

М – the center of weights of frequency distribution (average value of microvibrations

frequency);

S – root-mean-square deviation of frequency distribution;

D – a dispersion of frequency distribution.


95

Fig. 4.17. Information-energy diagram of the PPS

The results of the analysis of the information-energy state are showed in "T" sheet. The point

on the graph shows the current psycho (information) – energy state of a person. The Y axis is

displayed in % mental state (information comfort of his mental state). The X axis in kcal / min

displays how much energy a person spends on controling its psycho - emotional state.

Note, if you open the "T" sheet and start the process of gathering information , in the

open window you can see how the human condition changed during the experiment.


96

а) changing around the average value b) stable condition, indicating a high degree

of self-control person

Fig. 4.18 (a, b). Change person psycho-energy conditions for the chosen period

Change of psychoenergy state of the person during a controlled time frame is visually reflected

in a graphics (fig. 4.18). Only the person who is in weakened, or on the contrary in a status of high

concentration (fig. 4.18-b), can be in the fixed psychoenergy state during such insignificant time, as

1 minute. The majority of people is made by noticeable oscillations of psychoenergy state, even for

short periods, depending on the thoughts (fig. 4.18-a) and under the influence of an environmental

situation.


97

4.2 Macro mode. The suspicious people detection in crowd

VibraImage system allows controlling macromovements (macrovibrations) as microvibration.

Macromovements analysis uses the same principles as the control of micro-movements, at the same

time it allows to monitor the status of the people in the crowd. If micromovements of human head

can not be seen without a technical system, it was well known that movements and psychomotorics

reflect emotional state of person since such behavioral reactions are well observed by psychologists

and profilers. However, visual inspection of the movements is really subjectivity, at the time, as the

vibraimage system macromovements control completely objective and is determined by the

calculation formulas and the selected system configuration. The optimal camera location and the

choice of checking place are determined with considering the lens parameters, the distance from the

camera to the object and the amplitude of motion of the object.

Macro mode gives lowest accuracy in the measurement of psychophysiological parameters

relative to Mix and Micro modes. With correct vibraimage settings is possible to achive minimal error

rates as (10 % < FRR < 20 %) in the Macro mode.

When choosing the location of the TV camera relative to the envestigated group of people is need to

use the following recommendations:

The maximum display of human on the frame is preferable, and the camera should not be

unduly moved from the envestigated group.

People in the envestigated group must be approximately on the same distance from the

television camera.

In the analysis of the emotional state should use an equivalent comparison principle, the

correct is a comparison of people making near the same motion, for example, feed the ticket compared

with the person submitting the ticket, the person transposing luggage compare with a person

committing the same act, etc.

Note, that in order to improve the accuracy of the human state measurement, reccomends to

control its movement in maximum details, therefore, observe the minimum number of people in the

frame. Question of the measurement accuracy for the psychophysiological state should be decided

separately for every controlled object. In this case, for more accuracy it is recommended to use

personal control in MICRO mode for suspicious people detection in the high important places.

4.2.1 "Macro" mode parameters

Load basic MACRO modes parameters of operation is carried out using a submenu "Settings"

– "Defaults". When one of the basic modes of operation (micro, macro or lie detection) select and

load its default settings, the system automatically displays only the necessary window mode

(Fig. 4.19). To work in the "Macro" are necessary images window, "Suspect" level window, which

will display the value of danger level, and "Image capture" window detected potentially dangerous

people photos.


98

Fig. 4.19. Macro mode windows

Figures 4.20, 4.21 shows a comparison of the basic settings are set automatically when you

select Micro and Macro mode :

When micromotion control system also monitors the status of the person at the three

different accumulation times (from 0.1 to 20 seconds), characterized by the number of frames N = 2,

10, 100. Recommended accumulation amount frames in macro mode comprise N = 5, 10 and 15

frames that the input frequency 15 f/s, corresponding 0,3-0,6-1,0 second. Comparison of the number

of movements made by a person in a given time, gives a clear picture of the psycho-emotional state

of a person. If a person is excited or aggressive state, it makes a lot of movement than those who are

at rest, and it stands out vibraimage color coloring compared to other people.

"Palette threshold" is set at the control macromovements above (L = 150) than in

the control micromotion (L = 2).

Frequency of "base processing"under the control macromovements set substantially

higher than in the control micro-movements, to the 15 f/s instead of 5. This is due to the fact that

when micromovements no point in increasing the sampling rate, as TV system noise does not allow

stable fixing micro-movements with a higher frequency. Another thing macromovements control -

movement of the hands, feet or body when walking, turning or other fixed macromovements

confident enough television camera, and significantly higher than the noise level.

In macromovements analysis mode to increase the computing capacity of a PC, the

calculations are disabled several parameters and the "Disable " information column "S".


99

Fig. 4.20. Default setting for Micro mode Fig. 4.21. Default setting for Macro mode


100

Especially for setting display modes when using the Macro mode in the information column

"S" introduced a number of parameters:

Macro section:

Маcro mode – If "Macro mode = Yes" than danger level calculation is made on the

basis of values of parameters Р13, Р14, Р15 (the description of parameters is see lower). In

"Micro" mode danger level calculation is made on the basis of the analysis of values of

aggression (Р7), stress (Р6) and tension parameters.

Level L – sets a palette threshold at danger level calculation. Vibraimage points which

brightness less than the specified threshold, are considered «black"and are not used at

calculation of a danger level. The vibraimage point is considered active, if its brightness more

than the set threshold"Level L". Parameter Р15 defines the relation between the area of

«active"vibraimage points to the area of all frame. Parameter Р13 characterizes shift of the

histogram to the right in area of high frequencies. So that parameter defines primary color of

"active"points of vibraimage.

Level S – defining the area of "active" vibraimage points. If the area of points (in %),

which value of brightness is more than value "Level L", is less than value "Level S", than

danger level value displayed in status window equally 0. So, if in the frame it is not a lot of

"active" points, the level of danger is not calculated.Parameter Р14 defines in % excess of

the area of active vibraimage points above the set threshold of "active" point"Level S". So,

if the number of "active" points grows, value of this parameter too grows also a level of danger

increase.

Aura mode – automatic cut output vibration aura when working in macro mode.

Macro mode + – when mode is switch, the danger level is considered for each

individual person in the frame. In off mode - the danger level is averaged over the entire frame.

"Macro mode+" = NO recommended when working of face detection algorithms is not

effective in this particular case.


101

Fig. 4.22. Macro mode basic settings.


102

"Alerts" section:

"Critical level" – sets a threshold of "danger level" at which excess the person is

considered "dangerous"

"Customer level" – sets a threshold of "danger level" below which the person is

considered "dangerous"

"Auto capture image (s)" – If set «non zero"value, then the image of "dangerous"

object at his detection will be automatically save in an external file. The chosen value of the

given parameter determines in seconds the period of saving the pictures in a file.

Simultaneously the image "dangerous"will be displayed in "Image capture" windows.

"Show N image" – If set value N distinct from 0 in "Image capture" window will

be displayed at once N images of the "dangerous" people which have been found out for the

specified interval "Auto capture image (s)". If set value N = 1 – that for the specified interval

in "Image capture" will be displayed only one image, and we can pass other "dangerous"

person!

"Auto capture image (s)" – value of this parameter (other than 0) specifies the

number of seconds between saving images to a file and display them in "Image

capture"window.

"Area threshold %" and "Area level %" – these settings are recommended only for

experienced program users. Area and significance (level) coefficient factor are given in % and

is introduced to take into account the factor of small area of moving objects relative to the

area of the whole frame when calculating the danger level.

4.2.2 Face detection mode

Switching on the "Face detection" is made in the same section of the "S" information panel

(see Fig. 4.23).


103

Рис 4.23. Macro mode. Face detection is switch on

The parameter "Detection quality" defines quality of persons face capture. 1 – capture only

one large person in the frame (loading of the processor is minimal), 4 - search of all face (even small)

persons in the frame (loading of the processor is maximal).

Parameter "Scale 1:X" sets picture compression ratio before process of search of persons. By

default, value 2.0, i.e. video of a format 640 х 480 will be transformed by the program to a format

320 х 240. Compression of a format is necessary for reduction of loading of the central processor in

case of simultaneous increase in speed of the main processing (base processing). In case of value 0

compression isn't made. The lower the compression, the more CPU usage. The greater the

compression, the lower face recognition algorithm works.

Parameters "Mines size" and "Max size" set the sizes of rectangular (in pixels) for persons

face searching. The given parameter is necessary for set depending on concrete medium-sized people

on the computer screen.

The parameter "Config" is intended for loading new algorithms of persons search. At

installation of Vibraimage program on your computer will be created the subdirectory

"…\VibraImage10\Ocv\" in which files of various algorithms of persons search settle down. For

loading new algorithm, it is necessary to execute the following actions:

1. In "File" menu select item "Open". Then open folder \VibraImage10\Ocv\ and choose

new algorithm for calculation.

2. In line "Config" appear path to selected file.


104

Note, that each algorithm at work require different amounts of computer resources and

implementing different quality capture individuals. When choosing the algorithm is recommended

not to exceed the CPU utilization of more than 70 %. By default, when you install the system

VibraImage very little resource-loaded algorithm ocv_face.xml. For fast computers recommended

load frontalface_default.xml algorithm. But, note, the choice of the algorithm and the quality of the

capture of persons recommended when setting up the system after it is installed in a particular

location.

If parameter "Draw" = No – not draw rectangle around face. If "Draw" = Yes – draw

rectangle around "more danger" single person, "Draw" = All – draw rectangle for all person in frame:

For non-danger person rectangle draw green color, but if person suspect level more than

«Critical level», than rectangle draw red color (see Fig. 4.24).

If a potentially "dangerous" man except the red outline appears around the head and a red

outline around the body, this person requires more attention from the security services,

because the system repeatedly fix it increased the suspect level.


105

Fig.4.24. Attention, "Critical level" = 55 is exceeded

4.2.3 First start and settings selection for Macro mode

Before working in the "macro"mode is recommended to (or control) the following settings in

VibraImage system:

1. In the System menu "Settings" – "Defaults"switch on "Macro" mode and load the default

settings or to the "File" menu to load own "Macro" mode settings from an external file

("Load Settings")

2. In "DB" information panel:

Set the path to the database directory, which will be saved video files and results files.

Choose "Selected record" or create "New record".

3. In “S” information panel in "Face detection" section:

If you need to load a new algorithm to search persons.

Set the minimum and maximum dimensions of the frame to search for persons.

Set the required quality of face recognition.

Set the desired value scale compression of images

"Draw" parameter set to "Yes" or "All".

4. In "S" information panel in "Alerts" section:


106

Set the value of "Critical level", which corresponds to the current mode of

observation.

Switch on the sound notification of the dangerous man by setting "Sound

(Suspect)" = Yes.

Set parameter "Auto capture image (s)" = 1 sec.

Set parameter "Show N images" = 3 to display both 3 photos of potentially dangerous

people.

5. In "S" information panel in section "AVG Filter" sets parameter «Suspicious» = 5 – 10.

6. In "S" information panel in section "Capture" sets parameters values:

In fields "Max length(s)"sets maximum length (in seconds) of recorded video file.

The recommended value is 300 seconds.

In the "Purge old files (Mb)" field to specify the amount of free disk space, at which

the system will record new video files over the old ones. Recommended value

20000 Mb.

7. If necessary, select the item «Save settings as..."in "File" menu and save the current system

settings in an external XML file.

8. If you want to save the AVI file than using "AVI: Start Capture" item of "File" menu or

using the appropriate control panel button.

9. Start working in Macro mode.

Attention!!!, if you are changing system settings when working in the "Macro" mode, then

you need to constantly monitor the following settings:

1. After start of Vibraimage program and person vibraimage displaying on the screen

loading of the computer central processor power must be less than 60 %.

2. Speed of input frame processing. Speed of "fast processing" should be not less than

25 frame per second at resolution not less 640 х 480 pixels. Speed of "base processing"

should be not less than 14 – 15 f/s.

If you change the "macro" mode settings and specified speed is not respected, it is necessary

to set other parameters that require less computer resources.

Note, when a detailed system configuration at a particular place of its installation may require

advanced settings "Area threshold", "Area level", "Level S" and "Stab. X, Y".


107

4.3 Mix mode. The suspicious people detection with high accuracy

Mix Mode is similar to both Micro and Macro. Goal of Mix is to take accuracy from Micro

and applicability from Macro. Face detection must be enabled in this mode. Vibraimage analysis in

Mix mode occurs inside the contour of faces detected by face recognition algorithms. For more

information on the settings for the face detection mode, see section 4.2.2. In the information panel in

Mode S in the face detection section, the config option is shown twice. At first program is processing

video by the first face detection algorithm. If it does not find the face, then the program starts the

second face detection algorithm placed in the down line config and selected for a facial detection. In

default setting the first face detection algorithm is selected ocv_face.xml and the second face

detection algorithm is selected profileface.xml. Suspicious person is immideatly indicated on the right

part of program window. Advanced users can do changes in default settings.

Mix mode gives accuracy in the measurement of psychophysiological parameters as in Micro

mode but for many people as in Macro mode. 10 print with psychophysiological parameters is shown

for person with maximum level of suspicious. With correct vibraimage settings is possible to achive

minimal error rates as (8 % < FRR < 15 %) in the Mix mode.

Requirements to video in Mix mode:

People should be in a frame on approximately one place not less than 5 seconds. Better if

everybody in line or in crowd goes through the checking place for this purpose.

Camera must be focused on the place where people stay the longest time (for example in

line on the first person).

In mix mode data are processed for all detected people in a frame.

4.3.1 Mix mode parameters

Load basic Mix modes parameters of operation is carried out using a submenu "Settings" –

"Defaults". The system automatically displays only the necessary window mode (Fig. 4.25). Images

window, Histograms window, information panel, "Suspect" level window, which will display the

value of danger level, and "Image capture" window detected potentially dangerous people photos

are necessary in the "Mix" mode. With option "Print Suspect" you can set look of the captured image

(see fig. 3.60 p. 3.6.6)

Each detected person has his own contour with real-time calculated micro mode parameters

(Aggresive, Stress etc.), Vibra aura and current suspect level under the contour (see fig. 4.25). The

most suspicious person in the frame is highlited by dotted line.


108

Fig. 4.25. Mix mode windows

Figures 4.26, 4.27 shows a comparison of the basic settings are set automatically when you

select Mix and Macro mode:

Frequency of "Base processing" under the control macromovements set higher than

in the control micro-movements, to the 10 f/s instead of 5. This is due to the fact that when

micromovements no point in increasing the sampling rate, as TV system noise does not allow stable

fixing micro-movements with a higher frequency. Another thing macromovements control –

movement of the hands, feet or body when walking, turning or other fixed macromovements

confident enough television camera, and significantly higher than the noise level.

"Downrate" 3 instead of 0

Micromotion control system also monitors the status of the person at the three different

accumulation times (from 0.1 to 20 seconds), characterized by the number of frames N = 2, 10, 100.

Recommended accumulation amount frames in mix mode set N = 2, 10 and 40 frames that the input

frequency 10 f/s, corresponding 0,2 –1 – 4 seconds. Comparison of the number of movements made

by a person in a given time, gives a clear picture of the psycho-emotional state of a person. If a person

has exciting or aggressive state, he makes a lot of movements in comparison with those who are at

rest, and his vibraimage color stands out from other people.

"Palette threshold" is set as in the control micromotion (L = 2)

In Mix mode to increase the computing capacity of a PC, the calculations of several

parameters are disabled and the "Disable" information column "S".


109

Fig. 4.26. Default setting for Mix mode Fig. 4.27. Default setting for Macro mode


110

Other parameters as in Macro mode (see p. 4.2.1)

"Auto capture image (s)"– value of this parameter (other than 0) specifies the number

of seconds between saving images to a file and display them in "Image capture" window.

4.3.2 First start and settings selection for Mix mode

Before working in the "mix"mode is recommended to (or control) the following settings in

VibraImage system:

1. In the System menu "Settings" – "Defaults"switch on "Mix"mode and load the default

settings or to the "File"menu to load own "Mix" mode settings from an external file ("Load

Settings ")

2. In "DB"information panel:

Set the path to the database directory, which will be saved video files and results files.

Choose "Selected record" or create "New record".

3. In "S" information panel in "Face detection"section:

If you need to load a new algorithm to search persons.

Set the minimum and maximum dimensions of the frame to search for persons.

Set the required quality of face recognition.

Set the desired value scale compression of images

"Draw" parameter set to "Yes" or "All".

4. In "S" information panel in "Alerts"section:

Set the value of "Critical level", which corresponds to the current mode of

observation.

Set the value of "Customer level", which corresponds to the lower level of danger.

Switch on the sound notification of the dangerous man by setting "Sound (Suspect)"=

Yes.

Set parameter "Auto capture image (s)" = 1 sec.

Set parameter "Show N images" = 3 to display both 3 photos of potentially dangerous

people.

5. In "S"information panel in section "AVG Filter"set parameter "Suspicious" = 0

6. In "S"information panel in section "Capture"set parameters values:

In fields "Max length(s)"set maximum length (in seconds) of recorded video file.

The recommended value is 300 seconds.


111

In the "Purge old files (Mb)" field to specify the amount of free disk space, at which

the system will record new video files over the old ones. Recommended value

20000 Mb.

7. If necessary, select the item "Save settings as..." in "File" menu and save the current

system settings in an external XML file.

8. If you want to save the AVI file than using "AVI: Start Capture" item of "File" menu or

using the appropriate control panel button.

9. Start working in Mix mode.

Attention!!!, if you are changing system settings when working in the "Mix" mode, then you

need to constantly monitor the following settings:

After start of Vibraimage program and person vibraimage displaying on the screen loading of

the computer central processor power must be less than 60 %.

Note, the default processing of Suspect level is going only by Aggression processing. The

settings for including Stress and Tension for processing are placed in S/Filters/State levels.

Note, the sensitivity of suspect capturing in Mix default settings mostly depends on N level.

Lower sensitivity gives higher then default (40) N level. Higher sensitivity of suspect capturing gives

lower N level.

Note, PRO program processor power in Mix mode depends on a number of persons in

processing video, more processed people in frame requests higher power from processor. It is

necessary to check current processor power not exceed 80 % and Base processing rate about 10 f/s.


112

4.4 LD mode. Lie detection

The VibraImage program of psychophysiological lie detection allows revealing verbal and

nonverbal lie in the automatic, automated and manual modes. The program allows fixing and

comparing psycho physiological parameters of the person during the various moments of time at use

of various modern techniques of interrogation. All means existing now lie detector register changes

various psycho physiological parameters of the person, thus it is considered, and that essential change

psycho physiological parameters is observed when the person worries, is excited and speaks a lie. In

a still condition of person his psycho physiological parameters and emotions vary less considerably

in time, hence, having compared a known still condition with the answer interesting us it is possible

to define, when the person speaks the truth and when speaks lie.

The program allows to fix and compare psycho physiological parameters of the person during

the various moments of time. VibraImage system makes measurement and the analysis in time more

than 40 independent parameters describing an emotional condition of the person. The standard

method of definition of lie is based on an estimation of emotional reaction of the person on the put

question.

The standard method of lie detection is based on an estimation of emotional reaction of the

person on the put question. In an operating time the operator marks on graph CQ questions (Control

Question), RQ questions (Relevant Question) and GQ questions (General Question), pressing on the

same buttons , , on the toolbar at time of the given questions. After the ending of the

test the operator can check results of work in a special created file.

4.4.1 Before starting LD mode

For correct lie detection by Vibraimage system is recommended to take into account the

following factors and conditions:

1. The image of the person should be high quality, the maximal facial size preferable and face

position must be in the center of the screen. For camera horizontal resolution across 640 pixels

the person face should be not less than 200 pixels.

2. The object (person) should be well and stable illuminated also (black-and-white- preferable,

or color) the image of the person should be precise and contrast. As lie detection depends on

detection of the microvibrations and the object micromovements fixed in reflected from object

light, therefore poor light exposure of object can increase error rates.

Natural illumination of object can be used if speed of natural light changes does not exceed

1 lux/sec. Illumination of object by fluorescent lamps with illumination in the range 400 –

600 Lux in object plane is preferable.

3. In a video camera options, it is necessary to switch on a mode of fluorescent lamps noise

suppression (flicker mode 50 Hz and 60 Hz).

4. In camera options it is recommended to use black-and-white image mode.


113

5. Presence of the other people, taking place in the frame near to the researched object, can

influence and increase error rates of lie detection.

6. The video camera used for surveillance, and/or object on which the camera is fixed, should be

motionless and have no vibrations. The vibration or movement of camera can increase error

rates of lie detection

7. Speed of input frame from the camera should be not less than 25 – 30 frame per second at

resolution not less 640 х 480 pixels.

8. After start of Vibraimage program and person vibraimage displaying on the screen loading of

the computer central processor power must be less than 60 %.

9. The set of a microphone is recommended to use external, not built-in in the camera or

notebook.

10. At work with videofiles it is recommended to use files in length of 5 – 10 minutes and for

exact lie diagnostics it is recommended to analyze the same file repeatedly some times.

11. Press button before next lie detection of the same file. button works as reset and

stabilized detection results. Double click on this button fixed graphs time equal to the video

file period.

Note

At repeated viewing the same videofile the deviation in repeated values the same parameters

up to 5 % is acceptable because live video is the same as live object error rate less than 5 % is normal.

For stable work in a "Lie detector" mode is recommended use personal computer CoreDuo2 3 GHz

(not less than 4Gb RAM) or more powerful. At such computer speed of input frame from the camera

should be equal speed of fast parameters processing FPS_in = FPS_fast > 25 – 30 frame/s.

4.4.2 Switch on LD mode

Load basic LD modes parameters of operation is carried out using a submenu "Settings" –

"Defaults". When one of the basic modes of operation (micro, macro or lie detection) select and load

its default settings, the system automatically displays only the necessary window mode (Fig. 4.28).

To work in the "LD" mode are necessary images window, "QT" image quality window, "LDr" lie

level window, "Graph" window with changing main parameter, and "LD question" window for

show questionnaires question.

Window "Quality Test" (QT) indicates the time in %, for which the image quality of 100 %.

When the quality test indicates 92 % means that only 92 % of the testing time have no errors, and the

57 % of test time the image quality contained 1, 2 or 3 errors.

Note, before the start of the LD detection should ensure that the program processed the image

of a human without errors and work is allowable only at quality more than 80 %.


114

Fig. 4.28. "LD" mode settings load

Next, using the toolbar button , or via the submenu "Presets" menu "View" (see Fig. 4.29)

need to switch on the LD mode image display.

Fig. 4.29. System ready to LD mode


115

Attention, at work in a LD mode is recommended to supervise under graphs of change in time

following psycho physiological parameters describing all types of impellent activity: А1 fast, F3, F6,

S2, P2, P5 and Р20.

A1 (fast) – shows maximum fast reaction of person for question or situation, so it changes

before any other VI parameters, but goes down also immediately as it changed. This parameters shows

macro movement and sometimes used for deleting artifacts from the lie detection process.

F3 – shows general mental energy level of examinee, in default settings this parameter

calculates for time period of 20 seconds, so it is slowly changing parameter reflects psycho

physiological state. High level of this parameter indicates high level of exciting, aggression or activity

so it could be correlated with lie.

F6 – shows inhibition of person and also correlated with respiratory tracing or breathing

activity, because it is physiology linked with inhibition process.

S2 – shows asymmetrical of movements in middle time (2 sec) period, so it includes left/right

hemisphere activity components and it high changes usually indicates lie.

P2 – shows Mean-Square-Deviation (MSD) of frequency histogram and low meaning of this

parameter usually indicates normal state, so high meaning of this parameter could be correlated with

lie.

P5 – indicates Lie level auto calculated for selected parameters, in Default settings for Lie

indication need to have significant changes at least in 8 vibraimage parameters, typically in Lie

detection system registers significant changes in 12 or more parameters, given in Lie Report.

P20 – Quantity indicator of a degree of change psycho physiological parameters in view of

various factors of the importance of measured parameters since the part of parameters is accelerated,

and others are slowed down during one reaction. Parameter Р20 is defined at the moment of P5

maximum and display in "LDr" window.

When working with graphics, special attention should be paid to signal changes in the graph

of parameter P5 (lie), which define the most "suspicious"moments in human behavior. Each question

and answer (preferably separated by a time interval of not less than 10 seconds) is characterized by a

level change phycho-physiological parameters tested person. This level is characterized by two

integral indicators – the level P5 (see Fig 4.59.) and parameter P20 in the window "LDr", which

provides a quantitative assessment of human responses to the question. The higher this parameter, the

more likely lies in the response.

4.4.3 LD working mode

Select the method of of the beginning lie calculating [LD mode] is made in the "ST"

information column in field "LD mode" (see Fig. 4.30).


116

Fig. 4.30. LD mode settings.

The system uses the following ways to start the lie level calculation:

1. Audio – lie level calculation is performed when the input audio signal exceeds the threshold,

and stops when the audio signal level becomes less than the set threshold. On graph at the start

of data collection displays vertical green line, the time of completion – a vertical red line.

This mode is recommended as the primary when working with a lie detector.

2. Manual – the accumulation of the preliminary information is available at the "Base periods".

Calculation of a lie level is made only after selecting the "Start LD block" item in menu

"Actions" (or corresponding toolbar item). To complete the calculation interval of lie

detection, you must repress the same button or choose the same menu item. Time of lie start

calculation is marked by a vertical green line, calculate the end – red.

Lie detection in the manual mode are usually used, if the quality of live or recorded sound is

unsatisfactory and can not be on the level of sound to separate the questions and answers of

the test person from outside noise.

3. Auto – calculation lie level is made constant, the current values of the parameters are

compared with the values accumulated in the preceding period.

When operating in lie detecting mode in an "S" information column (see Fig. 4.27) is set the

interval "Base period" (in seconds) during which the system collects data about the object under


117

study, accumulates the information to determine the maximum and minimum current values

parameters to then at "lie detection" during the "Stat periods" define "abnormal" change the values

of the individual parameters of the object. If the value of the parameter during the "Stat period"

exceeds the set limit, then it parameter is taken into account when lie level calculating with a certain

coefficient (weight (Rate) of this parameter).

The base case "Base period" immediately precedes the moment of the beginning of the

analysis lies. But the system provides the ability to collect initial information about the object at any

time. When you select a item "Compare" = Capture will be made beginning start the sampling

interval at an arbitrary time. To complete the collection interval, you must change the settings

"Compare "value.

Now when you lie detection analysis the state of the object will be compared with the

information stored in previous time in one of two ways:

"Compare" = Off – at the lie analysis, as a test, using the interval "Base period"

immediately before the start of lie detection.

"Compare" = On – in the lie analysis, as test, the interval "Capture period", which was

prepared preliminary.

4.4.4 Additional settings in "S" information panel

1. For stable work in a "Lie detection" mode in section "Filters" of the "S" information panel

it is necessary to set parameter "FPS filter" = YES. The parameter "FPS filter" provides stability

of input video frame stream frequency due to resources of a computer. If the parameter "FPS filter"

= No, then parameter «Downrate" in "S" information panel sets factor of division of input frame

frequency FPS_in for all processing mode (base and fast). If the parameter "FPS filter" = Yes, then

parameter "Downrate" sets factor of division of input frame frequency only for base processing

mode. If "Downrate" = 0, then division factor calculated by system automatically. If input video

frame stream frequency not stability, then additional parameter "Stream errors" in "VI" information

panel displayed quantity of entrance frequency "failures".

2. Additional parameter "Audio sens. s." in an "S" information column sets in seconds, how

many after the person answer ending still to continue to analyze his condition

3. The parameter "Lie threshold" in an "S" information column sets in % a threshold for the

indicator of a lie level in view of all designed parameters and their "weight". At excess settlement

value of this threshold "lie level" is registered and displayed.

4. Each person differently reacts to lie by virtue of the psycho physiological features. The part

of people when lie, "worries" also their reaction (value of parameter Р5-lie) on the "important"

questions (RQ questions) exceeds reaction to control questions (CQ questions), and the system


118

registers a condition of lie (DI). For such people parameter "Opposite mode" = NO (it is a mode by

default). And the part of people – on the contrary, internally "is clamped (strains)" and their reaction

(value of parameter Р5-lie) on the "important" questions (RQ questions) less reactions to control

questions (CQ questions), and the system does not register a condition of lie (NDI). For such cases

for increase of reliability of lie detection results the parameter "Opposite mode" = Yes (it is a mode

is recommended for experienced users).

Note, VibraImage system requests correct adjustment of input audio signal (procedure of

adjustment see above). The moment when the person starts to speak, is used by system for the analysis

start of the data in Audio mode. Vibraimage parameters during speaking (Stat period) are compared

to the data received earlier (Base period), for example, when the person was silent or neutral answer

questions.

Therefore, it is necessary to adjust preliminary an "Audio level" so that the surrounding level

of a sound was below threshold, and the level of a sound at the task of a question and reception of the

answer was higher threshold.

Fig. 4.31. Audio level adjusting

To adjust sound level is necessary in an "VI" information column to measure the sound level

(fig. 4.31) for the two states: "the silence in the room" and "the sound of the human voice to the

camera". Then in the settings of "lie detection" in the "S" information column set the parameter

"Audio level" (fig. 4.31) so that its value was in the middle position between the minimum value of

the input signal that corresponds to the silence in the room, and a maximum value, which corresponds

to the sound voice man facing the camera.


119

Values of system options recommended (by default) for work in a lie detection mode:

Stat period = 10 s

Base period = 5 s

Lie Threshold = 0 %

Opposite mode = No

Audio sens = 2 s

N = 100

4.4.5 Settings in «LD"information panel.

If you have enough experience works with the lie detector, you can manually configure the

numerical values of the parameters A1 to P29, opening the appropriate «LD"information panel (see

Fig. 4.32).

Fig. 4.32. LD mode of information panel


V – Current parameter value;

cMin – The minimal value of parameter during the "Stat" period;

cMax – The maximal value of parameter during the "Stat" period;


120

bMin – The average basic minimal value of parameter for a normal condition of

the person during "Base" period;

bMax – The average basic maximal value of parameter for a normal condition of

the person during "Base" period;

For each parameters set following numerical values, which using in Lie detector calculation:

Calculate Yes – this parameter using in LD level calculation, No- not using

R1V "Weight" of parameter (Rate1) if its current value became more than the

set base maximum bMax OR became less than the set base minimum

bMin. Use in Р5 parameter calculation.

R2V "Weight" of parameter (Rate2) if its current value became more than the

set base maximum bMax AND became less than the set base minimum


R1C "Weight" of parameter (Rate1) if its current value became more than the

set base maximum bMax OR became less than the set base minimum


R2C "Weight" of parameter (Rate2) if its current value became more than the

set base maximum bMax AND became less than the set base minimum


Level In % determines on how many value of parameter should exceed the

set limits that the system "considered"this change.

The following are examples which illustrate the principle of collecting information. Fig. 4.33

has no difference in the "threshold" values of S2 in intervals "Stat period" and "Base period".

In fig. 4.34 during the interval of definition lies (Stat period) value S2 has exceeded the maximum

threshold.


121

Fig. 4.33. S2 parameter value is within the limit

Fig. 4.34. One of the parameters was significantly higher than both the established limit


122

4.4.6 Backster’s test

The basis of lie detection is a technical comparison of the principle of psycho-physiological

reactions responses zones (introduced Clive Backster), it is quite easy to understand and allows each

person to accurately determine the truth and lie even with minimal experience in working with

VibraImage system.

Principals of comparative testing and averaging for responses of question-answer zones,

coined in the 60th years of XX century by Cleve Backster

(http://www.backster.net/images/accuracy.pdf), gave requested high accuracy for

psychophysiological detection of deception and have done lie detector the reliable instrument in

expert hands. The comparative zones are based on the fixed structure of question-answer testing,

including general, comparative and relevant questions in one test. So fixed test structure allows

combine analyzing of response to several similar questions, so it is possible to calculate average

response to several control questions and separately calculates average response to several relevant

questions. This testing structure gives more accuracy for any measurement, so it is acceptable also

for lie detection, too. Standard lie detection test structure includes 9 – 14 questions, one of these

questions relevant (most important) is presented by several times (during one test), because was

proved that during one test is correct to present the only one relevant question. Several relevant

questions in one test give more errors, because examinee could concentrate only on one question

during the test.

Let’s consider the test structure on the simple actual test sample: You are interesting where

your partner was at night, when he tells that was working in office. In this case the question "Really,

were you in the office last night?" is relevant question and the main important question of this test.

All test must include several questions for replying one meaning answers as Yes or No, like the

suggested sample:

1. Did you have breakfast yesterday, as usual?

2. Was the cold weather on the morning street?

3. Did you tell lie to your friends?

4. Did you work in office this night?

5. Let’s go to cinema this weekend?

6. Did you ever tell lie to me or my family?

7. Really you were in office this night?

8. Did you take your purse from home at this morning?

9. Did you steal something before?

10. Is it true, that you were working this night?

http://www.backster.net/images/accuracy.pdf


123

General (blue) questions (GQ) have diverted meaning and have not influence to calculation

result, but they are necessary for reducing concentration attention of examinee on the relevant

questions. Response to the control (green) question (CQ) is very important to the test calculation,

control question usually asked about past criminals, which are happened in everybody life. The verbal

answer on control question is not so important (Yes or No), more important is psychophysiological

response corresponding to this reply. If quantitative average response to control questions is more

than analogical quantitative average response to the relevant (red) questions (RQ) that means person

tells true. If quantitative average response to relevant questions (RQ) is more than analogical

quantitative average response to the control questions (CQ), that means person tells lie.

4.4.7 Lie detector with questionnaires

Program VibraImage has a special type series of thematic questionnaires intended for human

psychophysiological person testing, such as passing an interview before obtaining a credit.

You can select an existing questionnaire suitable for you ("Loyalty", "Alcohol", "credit",

"bribe", "Family" and others.) or create your own. An example of the questionnaire is shown in

Fig. 4.35.

The aim of the survey "Loyalty" is the definition of human loyalty basic principles of security

of modern society, and combating terrorism. The questionnaire includes graphics (incentives) that

increase psychophysiological effect on the test.

The aim of the survey "Credit" when issuing a credit is the lack of definition lies in the

intention of the applicant for the loan and detection of fraud in obtaining credit.

The aim of the survey "Bribe" is to determine the reliability of the test person answers that

he did not take bribes at the current position.

The survey "Family" is to detect lies with whether or not he had the answer to the question

of the subject the previous evening, at work, or located elsewhere.

Questionnaire "Insider" is intended to test, to hire personnel, the possibility of selling

company secrets to competitors.

The questionnaire R_Test allows rank (to determine the significance of) the test

psychophysiological response to questions.

Questionnaire "Alco" is intended to identify those who are likely to use alcohol.

The questionnaire "Computer" is designed to identify individuals who are prone to

compulsive gambling.

Questionnaire "Violences" is intended to identify individuals who are prone to violence in

the family.

The user may develop owns questionnaires on topics of interest to him and put them in the

installation directory \ VibraImage10 \ in the same file format ld_xxxxxx.ldg.


124

Fig. 4.35. "Lie detection" mode operation. The questionnaires text display.

Adding questionnaire windows "LD Question" (Fig 4.36) to the screen is done by selecting

the menu item "View" – "Toolbar".

Download the survey questionnaire can be by selecting "LD load text... " in the "File" menu.

Allow withdrawal question text on the screen is made in the "S" information panel in "lie detection"

section by setting the parameter "Text" = Yes.


125

Fig. 4.36. "Lie detection" mode operation. The choice questionnaires.

Pressing the button in the window allows you to start working with the questionnaire.

Double-click returns to the beginning of the work as a questionnaire and video.

Рис 4.37. Questionnaires process

Answers to these questions can be given a voice, if a premade microphone audio level

adjustment, or manually by pressing the button "Yes" and "No" when the self-test.

In self-test mode, the test man is in front of the monitor, which sees the image requirements

and questions. By selecting the button "Yes" or "No" on the screen (Fig. 4.37), responds to the test

questions are imposed in real time. When tested with a selection of the responses by pressing the

"Yes"/ "No" as a result of the test will also be analyzed in the time delay between a stimulus (question

asked, the image) and the response (answer).


126

Please note, to answer this question only when the color of the question changes from black

to green. This time on the graphs corresponds to the green vertical line started lie detection. The

moment when the current question disappears from the screen corresponds the vertical line the red

color and end of the lie detection interval.

The proposed method allows to receive and to use for the automatic conclusion of psycho-

physiological information obtained 5 different independent methods during the three minute test:

1. Comparative information on psycho-physiological reaction of the test (similar to the

classical polygraph) in answering the relevant (Rc) and control (Rr) questions, that

includes an evaluation of the reaction of the test at the maximum level (max result)

of vibraimage parameters:

Rc > Rr; NDI (test is passed positively if total psychophysiological reaction at the

answer to control questions is higher, than at the answer to relevant questions);

Rc = Rr; INC (the test result isn't defined if total psychophysiological reaction at

the answer to control questions is approximately equal to reaction at the answer to

relevant questions);

Rc < Rr; DI (test is passed negatively if total psychophysiological reaction at the

answer to control questions is lower, than at the answer to relevant questions).



includes an evaluation of the reaction of the test at the average level (average result)

of vibraimage parameters (calculation is similar to a method 1).



includes an evaluation of the reaction of the test at the integrated level (integrated result)

of vibraimage parameters (calculation is similar to a method 1).

4. Information on the time delay in answering the questions. If the subject does not press any

of the buttons during the time set on this question, the system transitions to the next

question. According to the set algorithm absence of any response to the relevant questions

leads to a negative test result (calculation is similar to a method 1).

5. Information about changes in the dynamics of psycho-energetic (information-energy)

diagram of the test person at the answer to control and relevant questions. In more detail

the algorithm of calculation of this parameter is stated in the following section 5.1 of this

description.

According to set algorithm, the answer is YES to any of the relevant questions leads to a

negative test result.


127

The calculation of the result of the test is carried out automatically with all the data. The data

calculation method 5 are used as the basic information. Results of the first four estimates change the

numerical value of reaction to relevant questions received by a method 5 according to the following

formula:

sRr=sR(5)r +0,1*sR(5)r*(∑NDI – ∑DI)

The result of psychophysiological testing is defined according to the following conditions:

NDI: sRr – sRc>0 or

NDI: sRr>0

DI: sRr– sRc<0

INC: 0,01<sRr – sRc < 0,01

4.4.8 Questionnaires stucture

According to the upgraded Bakster’s test of control questions questionnaire including three

blocks of control and relevant (test) questions (impact on the person can be strengthened by the

graphic information shown on the screen, the image of the pictures corresponding to a question) is

shown to the examinee person, general questions at the beginning and in intervals between which are

located. An example of such questionnaire indicating the time delay between the questions and the

type of questions used program is given below:

1. <GQ delay="10"length="7"text_delay="2"text_length="0"img="images/1.JPG"> Is your age over 20

years old?</GQ>

2. <GQ delay="5"length="7"text_delay="2"text_length="0"img="images/2.JPG"> Are you married or

single?</GQ>

3. <GQ delay="5"length="7"text_delay="2"text_length="0"img="images/3.JPG"> Are you ready to

answer truly the questions?</GQ>

4. <CQ delay="5"length="7"text_delay="2"text_length="0"img="images/4.JPG"> Earlier have you

been condemned for violations of the law?</CQ>

5. <RQ delay="5"length="7"text_delay="2"text_length="0"img="images/alco/5.JPG"> Do you justify

terrorist acts?</RQ>

6. <GQ delay="5"length="7"text_delay="2"text_length="0"img="images/6.JPG">Have you a

hobby?</GQ>

7. <CQ delay="5"length="7"text_delay="2"text_length="0"img="images/7.JPG"> Do you consider

yourself an honest and calm person?</CQ>

8. <RQ delay="5"length="7"text_delay="2"text_length="0"img="images/8.JPG"> Are you ready to

commit a terrorist act?</RQ>

9. <GQ delay="5"length="7"text_delay="2"text_length="0"img="images/9.JPG"> Are you a

believer?</GQ>

10. <CQ delay="5"length="7"text_delay="2"text_length="0"img="images/alco/10.JPG"> Are you ready

to do anything for money or people close to you?</CQ>

11. <RQ delay="5"length="7"text_delay="2"text_length="0"img="images/alco/11.JPG"> Are you ready

to support a terrorist, if he is your friend?</RQ>

12. <GQ delay="5"length="1"text_delay="2"text_length="0"img="images/alco/12.JPG"> Thank you for

your cooperation</GQ>


128

To reduce the uncertainty of comparative testing must have approximately the same time

interval upon presentation of the control and relevant questions, so the length of questions and pauses

when the synchronous presentation of a variety information needs to be given increased attention.

Tag "delay" sets the interval in seconds between questions. Tag "lenght" – the time interval of the

show text of the question. Tag "text_delay" delay before the question text painted. Tag

"text_lenght" determines the speed of text painting green, if value "0" the text is painted with a

constant speed depending on the number of letters in question, at other text is painted for a specified

time.

Note the "Img" tag in the structure of the questionnaire is optional. But properly selected

image (incentives) that the respondent sees on the screen increase its psycho-emotional response to

this question (see Fig. 4.38).

Fig.4.38. The image and question on the monitor in front of the examinee.

4.4.9 Create new questionnaires

User can be similar questionnaires on topics of interest to him and put them into the program's

installation folder in the same file format ld_xxxxxx.ldq by selecting "LD edit text..." in the main

menu. Then the window "LDQ" of creation of a new questionnaire will appear (fig. 4.39), where you

can enter questions and save profile by clicking "Save As".

To improve the efficiency of the questionnaire and increase the reaction of the test, you can

add an image corresponding to the question subject by clicking "img..." to the right of the question

in the window "LDQ" and selecting them from the pictures stored on your computer.


129

Fig. 4.39 Creation of a new questionnaire

4.4.10 Psychophysiological detection of deception in semi-automatic mode without questionnaires

Using the proposed standard method of comparison areas (Bakcler test) , the user can create

their own thematic tests.

During the test operator notes control (by marker CQ) and relevant questions (by marker RQ)

by clicking on the corresponding toolbar button when passing these questions. After the test the

operator (the person asking the questions) presses the button [!] on the toolbar and instantly receives

a test result in "LDr" window: True (green column – NDI), False (red column – DI) or uncertain

(yellow column – INC).

Example of comparison zones test quantitative psychophysiological responses to control and

relevant questions shown in Figure 4.40.


130

Fig. 4.40. Lie detection process with markers.

4.4.11 Psychophysiological detection of deception in semi-automatic mode, random questions

In "LD audio mode" user needs firstly to adjust "Audio Threshold" so that background

audio level must be lower than Audio Threshold and audio level of questions and answers must be

higher than Audio Threshold. In this case every question-answer response divided by time period not

less than 10 seconds from the next question-answer response is characterized by level of changes for

every measured psychophysiological parameter. The total changes in psychophysiological parameters

are characterized by two general indicators – P5 integral parameter indicated on the down graph, and

P20 differential parameter indicated on the vertical column. More quantity of P20 parameter after

response indicates more high level of psychophysiological response and gives more lie probability

for two response comparison.

4.4.12 Recording the main test LD results

Upon completion of the survey the system will automatically go into "Pause" mode to enable

the user to analyze the results on the screen (see Fig. 4.41). In the lies level window "LDr" will display

the final test result. For example, DI – the final test result is found "Lie"and the graphs at the answer

to questions 9 and 10 recorded high value P5 parameter (lie).

In "Lie level" window (LDr) on test results may be display 3 variants:

1. True (green column – NDI), then the test person has successfully passed the test.

2. False (red column – DI), it means that the test person has not passed the test.

3. Uncertainty (yellow column – INC), the test result is not clear, the test should be

repeated or modified.


131

Fig. 4.41. LD test results

Note, Automatically save the results to a file is only available when operating in

"questionnaires" mode.

After completing the questionnaire in lie detection mode automatically in the selected

database directory \ VibraImage10 \ Database \ *** creates files with the test results:

Data_time_histH.png – frequency histogram.










132

4.4.12.1 Graphics of psychophysiological state changes

Changing of psychoenergetic state of a person to a controlled period of time clearly displayed

on the graph (see. fig. 4.42) and in file Data_time_histT.png. Only a person who is in a relaxed or

in a state of high concentration may be in a fixed psychoenergetic state during such insignificant time

as 1 minute. Most of the people make a noticeable fluctuations of psychoenergetic state, even for

short periods of time, depending on their thoughts and under the influence of the environment.

Color line of psychoenergetic state changes corresponds to the "color" of the test question:

general questions – blue;

control questions – green;

relevant questions – red.

Fig. 4.42. Periodic change psychoenergetic state along a certain trajectory, usually

characteristic for an interview, type a question-answer

Actual psychophysiological state is displayed in the form of a point and change of person’s

psychophysiological state in time is displayed in the form of a straight line or a curve between two

points. The example of psychophysiological state change from a state 0 in various states 1, 2, 3, 4, 5

is given in figure 4.43 and each transition has its emotional and psycho-physiological sense.


133

Fig. 4.43 Psychoenergetic (information-energy) diagram of the psychophysiological state.

Transition 0 – 1 is characterized by an increase in energy consumption and improvement of

psychological state. The reason of this psychophysiological state change can be a good or pleasant

news (the stimulus), it leads to a more intensive exchange processes (increase in energy

consumption), and the psychological condition and mood notably improved.

Transition 0 – 2 is characterized by an increase in energy consumption and an even level of

psychological state. The reason can be, for example, an increase in mental and physical activity,

which lead to more intensive exchange processes (increase in energy consumption), at the same time,

the psychological state and mood are unchanged, as conducted by the impact did not cause emotional

changes.

Transition 0 – 3 is characterized by an increase in energy consumption and impairment of

psychological state. The reason can be unpleasant information that leads to a more intensive exchange

processes (increase in energy consumption), and the psychological condition and mood became

notably worse.

Transition 0 – 4 is characterized by a decrease in energy consumption and impairment of

psychological state. The reason can be unpleasant information that leads to a slowing of metabolic

processes (reducing energy consumption), and the psychological condition and mood became notably

worse.

Transition 0 – 5 is characterized by a decrease in energy consumption and improvement of

psychological state. The reason can be pleasant news, which soothes and slows down the metabolic

processes (reducing energy consumption), and the psychological condition and mood are notably

improved.


134

Vibraimage technology allows to obtain multi-dimensional relationship of a

psychophysiological state characteristics and to measure not only the energy change but also the

direction of this change.

For example, The psychophysiological reactions of the person at the answer to the control

(CQ) and relative questions (RQ) are compared. In answering the question person

psychophysiological state, displayed on the diagram changes from the point with coordinates (E1, I1)

to a point with coordinates (E2, I2).

ER = E1 – E2

IR = I2 – I1

Below we consider the situation where the respondent did not like the question, he's going to

say a lie on it. Energy state in such case increases, i.e. ER < 0, and the psychological comfort is

reduced, and IR > 0.

Comparison of the sum of these indicators for answers to relevant and control questions allows

to define truthfulness of the answer or psycho-energetic expenses at reaction to the shown answers or

incentives.

R = IR + ER

If a difference Rr – Rc = dR < 0, then the person has told a lie (DI) or reacted negatively to

the shown incentive.

Hereinafter the lower indexes «r"designate value of measurement for relevant questions, and

"c" – for control questions.

The results of the human psycho-physiological reactions than the test on the 3 group of control

and relevant questions is contained in a lie detection report file in the section "IE result".


135

4.4.12.2 Recording the main test results

The main results of change of psychophysiological state when carrying out

psychophysiological testing saved in the text file which structure is given in figure 4.44.

################################################################

Area 1 ###### 1 RQ 02.02.2016 10:48:53 video: 91.7935

Have you been delayed at work today?

################################################################

Start time 02.02.2016 10:48:53 Video timer (start) 01:32

Stop time 02.02.2016 10:49:03

Video timer (stop) 01:42

LD time 02.02.2016 10:49:00

LD video timer 01:38 ################################################################

Name cMin bMin cMax bMax vRates cRates

A1X 0,000150238 7,55247e-005 0,0771637 0,0282315 1 -2 A1 0,00409047 0,000426037 0,549241 0,066692 1 -1

A2 20,1334 10,0224 86,2681 19,5487 1 -1

A3 A4X 0,000251693 0,000198452 0,0242119 0,00419498 1 -1

A4 0,0278119 0,00656809 0,253695 0,0292217 1 1

F1X 3,61082e-005 1,96954e-005 0,00541951 0,00272781 1 1 F1D -0,00291492 -0,00152639 0,00382747 0,0026162 2 2

F1 0,00142904 0,000123698 0,048903 0,0132878 1 -1

F2 54,607 40,606 78,4315 55,9861 1 1 F3

F4 102,544 94,83 151,742 124,894 1 -1

F5X 0,16845 0,321748 0,399377 0,484708 1 1

F5

F6 0,150574 0,124949 0,199305 0,152812 1 -1

F7 0,0596623 0,031001 0,114005 0,0664505 1 1 F8 0,0384835 0,0491532 0,386444 0,268609 2 2

F9

S1 -131,267 -83,3541 139,172 86,3353 2 1 S2 -18,3586 -9,66255 1,47161 7,26032 1 -1

S3 -0,916659 -0,710579 0,775945 -0,212643 2 2

S4 S5

S6 -0,131085 -0,119924 0,0736296 -0,0764681 1 1

S7 -25,2939 -26,4201 -10,6387 -14,2742 1 0 P1

P2 23,6709 25,6102 26,8731 26,7899 2 -1

P3 0,266011 0,207058 1,40152 0,509807 1 1 P4

LD 4

################################################################

Audio

Level 31,1 Threshold 5,0

Delay (s) 0,00

################################################################

R(m) 4

R(a) 46.4286

tR(i) 357.615

###### 1 RQ 02.02.2016 10:49:03 END

Fig. 4.44. Example of the beginning of the text file with the first relevant question (RQ).


136

"Area 1" contains information about the test questions. The text of the question, its serial

number, the type of the question (GQ general,CQ control, RQ relevant), and the time when, during

the question was the maximum value of the parameter P5 (LD Time).

Also for each question are given values of the parameters that have exceeded the established

bMin and bMax limits, and the "weight parameters"in the calculation of the lie level – vRates (for P5

calculation) and cRates (for P20 calculation).

Than shows the sym cRates for all parameters, whitch values are deliated from norm, for

example, LD = -2 – 1 – 1 – 1 + 1 + 1 + 2 – 1 + 1 – 1 + 1 – 1 + 1 + 2 + 1 – 1 + 2 + 1 + 0 – 1 + 1 = 4

At the end of the field shows the resulting measurement valuesfor each answer, calculated in

three ways :

R(m) 4 (max result) – results from the analysis of the parameter P20;

R(a) 46.4286 (average result) – results from the analysis of the parameter P5;

tR(i) 357.615 (integrated result) – results based on the analysis of the area under the

graph of the parameter P5.

At the end of the common text file shows the results of all measurements (Fig. 4.45).


137

######################## max result

RQ(m) 7,00 3

RQ(m) stat: 4,00 0,00 3,00

CQ(m) 7,00 3

CQ(m) stat: 5,00 1,00 1,00

LD(M) INC

######################## average result

RQ(a) 39,29 3

RQ(a) stat: 46,43 28,57 42,86

CQ(a) 34,52 3

CQ(a) stat: 33,93 32,14 37,50

LD(a) DI

######################## integrated result

RQ(i) 275,93 3 RQ(i) stat: 357,62 190,76 279,41

CQ(i) 211,47 3 CQ(i) stat: 214,99 189,43 229,97

LD(i) DI

######################## dT result

Q1: Tc=3.967 Tr=5.666 DI Q2: Tc=6.067 Tr=5.233 NDI

Q3: Tc=1.534 Tr=1.900 DI

dT result: sTc=11.568 sTr=12.799 INC

######################## IE result

Qc1: E1=0.298 E2=0.263 ERc=0.035

I1=0.527 I2=0.553 IRc=0.026

Qr1: E1=0.262 E2=0.278 ERr=-0.016 I1=0.554 I2=0.615 IRr=0.061

Rc=0.062 Rr=0.045 dR=-0.017 DI

Qc2: E1=0.300 E2=0.260 ERc=0.040

I1=0.557 I2=0.586 IRc=0.028 Qr2: E1=0.260 E2=0.256 ERr=0.003

I1=0.589 I2=0.587 IRr=-0.001

Rc=0.068 Rr=0.002 dR=-0.066 DI

Qc3: E1=0.217 E2=0.234 ERc=-0.017 I1=0.530 I2=0.522 IRc=-0.007

Qr3: E1=0.236 E2=0.292 ERr=-0.056

I1=0.527 I2=0.636 IRr=0.109

Rc=-0.024 Rr=0.053 dR=0.076 NDI

IE result: sRc=-0.063 sRr=-0.181 DI

IE final: sRc'=-0.063 sRr'=-0.181 DI=0 NDI=0

######################## global result

LD result INC

Fig. 4.46. Example of LD results file.


138

The decision is considered the sum of "weights"on relevant RQ question and CQ control

question. If Σ (RQ)> Σ (CQ), a person tells a lie (DI).

Max result – assessment of psycho-physiological reactions to stimuli is carried out taking

into account the various factors of vibraimage parameters significance (RateC).

Average result – average assessment of psycho-physiological reactions to stimuli is carried

out taking into account the equal factors of vibraimage parameters significance (RateV).

Integrated result – integral assessment of psycho-physiological reactions to stimuli is carried

out taking into account the equal factors of vibraimage parameters significance (RateV).

IE result. Analysis of changes in psycho-energetic state of a person in the process of response

(Fig. 4.39). We compare the physiological response to the control and relevant questions.

dT result. At the end of the file is an analysis of the time delay (in seconds) in answering to

the control (Tc) and the relevant (Tr) questions. Then longer a person is thinking about the answer,

than more likely a lie.

Note, if the camera settings and shooting conditions are wrong, then at the end of the question,

and at the end of the file appears message on the specific reasons for the error with the quantitative

contribution to the overall quality.

Warning: Low quality (1) ! [0.35%]




139

4.4.13 Ranking mode of reactions to questions

In contrast to the mode of comparative testing (comparison test zones proposed by Clive

Bakster) for many variants of psychological and psychophysiological testing necessary to obtain

information about the degree of importance of the various questions for the test person. In this case,

using a questionnaire R_Test program shows the absolute (not relative) the test reactions to questions.

In the text of the questionnaire all the questions marked with the tag <EQ>, for example :

<EQ delay="5"length="7"text_delay="1"text_length="0"> Are you often change the decision

?</EQ>

After completing the questionnaire in lie detection mode automatically in the selected

database directory \ VibraImage10 \ Database \ *** creates files with the test results :

Data_time_histH.png – frequency histogram.









Data_time_LD_e.txt - An additional file with the results of ranking the importance

of questions for the test

An example of the calculation results of the file with the ranking table is shown in figure 4.47.


140

----------------matrix table--------------------------------------

R A I S S1 At It M

1 9 2 12 12 12 4 7

2 6 4 4 4 5 2 6

3 5 9 1 5 6 5 9

4 4 1 5 10 4 10 3

5 2 5 10 6 9 9 12

6 1 8 6 9 10 6 10

7 10 6 9 2 2 8 8

8 12 10 2 3 3 3 11

9 8 7 3 8 7 12 4

10 7 11 8 7 1 1 2

11 11 3 7 1 11 7 1

12 3 12 11 11 8 11 5

----------------results of ranking--------------------------------------

R: 4 (24), 9 (30), 6 (31), 5 (32), 12 (37), 2 (40), 10 (40), 1 (55), 3 (60), 8 (60), 7 (61), 11 (76)

---------------- formula calculation for 7 algorithms-------------------------------------

A: P5 [ t' = t(max(P5)) ]

M: P20 [ t' = t(max(P5)) ]

I: Ʃ P5

S: A/(t(max(P5))-t(P5>0))

S1: A/t(max(P5))

At: A/dt

It: I/dt

Fig. 4.47. The results of the ranking of psycho-physiological reactions in answering to questions

The number of rows in a matrix table is the number of questions in the questionnaire. The top

line in the table shows the number of questions that caused the maximal response of the subject.

The number of columns is 7 – as the number of used calculating algorithms (A, I, S, S1, At,

It, M). Formula each algorithm are shown in the lower part of the log file. In each column the number

of questions in order of their importance (human response). The higher the number of the question in

the column cells, the more psycho-physiological reaction to it showed during the test.


141

In the "results of ranking" section shows the importance of the overall performance of each of

the questions asked. For example, the question №4 is rated the lowest from all the remaining question

and equal to 24, i.e. in answering this question the testing human showed the biggest reaction.

4(24) – question №4 (its reaction = 1 (string number) *1 (the number of repetitions of the

question number in the string)+ 2*3 + 4*2+ 9*1 = 1+6+8+9 = 24)

4.4.14 Video recording during testing and mark standing

To save the results of the lie detection, system settings and all the changes in an external file,

is necessary to set the "Save LD" = YES in the information panel in the DB mode (see Fig. 4.61), as

well as at the beginning of the test, press the video record button in the toolbar. Note, the video

recording must be performed even in the case where no information source is a video camera, and the

outer AVI file. Along with the video record will be generated a text file with the results of lie

detection, and system settings.

After the end of the experiment should stop file recording by pressing the button in the toolbar.

Fig. 4.48. Including files recording mode with the results of lie detection

A detailed analysis and methodology of work of psychophysiological lie detector using

vibraimage system is contained in a special supplement to this description (optional). Special

description of lie detection is provided to users who have completed training in lie detection.

Thus, the analysis of the video file is recommended to perform the following steps:

1. Select the directory for writing the research results.

2. Set the options "Save XML" = YES and "Save LD" = YES to create a results file .

3. If necessary, change the lie detector settings in the tabs of the dashboard .

4. Choose the method of calculating the level of lies .

5. Enable lie detection .

6. Open the video image for analysis.

7. Set the parameter "Set marker" = YES for manual entry markers (CQ, RQ, GQ).

8. Double-click the button to the axis of the graphs corresponds to the dimension of the

horizontal full length video file.

9. Press the button to start recording the results.

10. Once you click to jump to the beginning of the test file.

11. Start the analysis of the video file, placing CQ, RQ, GQ marks in the right places.

12. When the end of the video file, press the button

13. Reset input parameter "Set marker" markers = NO

14. In the selected directory will be created file * _LD.txt with the results of lie detection and

* .xml file with the system settings for viewing in VILogViewer.


142

5 Operation with external devices

The VibraImage 10 program have the ability to synchronize other devices recording

physiological parameters of the person with the VibraImage system. The synchronous registration of

different physiological processes allows expanding significantly possibilities of research of

psychophysiological and physiological characteristics of the person. Joint and synchronous

registration with the vibraimage of a pulse wave (DC21U scanner) and an electroencephalography

(Mitsar-EEG-201) allows watching visually correlation and correlation of functioning of different

physiological systems of the person.

5.1 Operation with EEG devices

Technology electroencephalography (EEG) is the most famous and informative for

psychophysiological testing. Therefore, it is EEG was chosen as the technology for comparative

testing vibraimage. Software VibraImage implements a joint synchronous registration and processing

of the signals of electrical activity (EEG) and motor activity (vibraimage). It should be noted that the

registered signals due to mechanical inertia of vibraimage are lower frequency than the EEG signals,

so the correct definition of the correlation between the signals should be carried out in the frequency

range up to 10 Hz.

To working EEG (for example Mitsar-EEG-10/70-201) it is not require the installation of

additional software or drivers. Enough after connecting EEG to choose an item "Mitsar-EEG". When

you connect EEG in information panels "GR" and "С" there will be additional points output of

diagrams and correlation of the following parameters:

EEG_FP1, EEG_FP2, EEG_FPZ, EEG_F3, EEG_F4, EEG_F7, EEG_F8, EEG_FZ, EEG_Т3,

EEG_Т4, EEG_Т5, EEG_Т6, EEG_С3, EEG_С4, EEG_СZ, EEG_P3, EEG_P4, EEG_PZ,

EEG_PG1, EEG_PG2, EEG_O1, EEG_O2, EEG_OZ, EEG_NZ, EEG_BIO1-EEG_BIO8,

EEG_AADIFF, EEG_EVENT.

The figure 5.2 shows an example of viewing graphs of electrical impulses from the EEG in

VibraImage 10.


143

a) b)

Fig. 5.1 New items when connecting EEG:

а) – in the “GR" information panel mode, b) – in the "C" information panel mode

Fig. 5.2. View information from the EEG


144

5.2 Operation with a fingerprint scanner and registration of the pulse wave.

Under development.

To use the fingerprint scanner is required initially to install the drivers. The procedure to install

drivers fingerprint scanner DC21U described in detail in the description Biofinger system

(http://www.psymaker.com/downloads/BiofingerManualEng.pdf) in the section "Fingerprint scanner

DC21U driver installation".

Note, to install the DC21U drivers, you must have administrator rights.

You can get to work after connecting a fingerprint scanner to your PC. In the VibraImage 10

program you need choose an item «DC21"in the submenu "Settings". After that there will be a

program window DCРulse (fig. 5.5). It is possible to view and process all diagrams of the program

DCPulse reflecting pulse in different points of a fingerprint figure in the VibraImage 10. When you

connect a fingerprint scanner in information panels "GR" and "С" there will be additional points

(fig. 5.4) output of graphs and correlation of the following parameters:

Pulse AVG_ALL, Pulse SIGMA_ALL, Pulse AVG_ZONE1, Pulse AVG_ZONE2, Pulse

SIGMA_ZONE1, Pulse SIGMA_ZONE2, Pulse AVG_LINE1 - Pulse AVG_LINE3, Pulse

SIGMA_LINE1 - Pulse SIGMA_LINE3, Pulse SIN, Pulse PHASE T, Pulse PHASE A, Pulse PULSE

10, Pulse AVG_X0 - Pulse AVG_X9, Pulse SIGMA_X0 - Pulse SIGMA_X9.

a) b)

Fig. 5.4 New items when connecting fingerprint scanner DC_21:

а) – in the "GR" information panel mode, b) – in the "C" information panel mode.

http://www.psymaker.com/downloads/BiofingerManualEng.pdf


145

Fig. 5.5 Window DCPulse program.


146

6 Vibraimage. General info

Values of amplitude and frequency of vibrations of a person head differ in each point of space

and are displayed as pseudo color image. Integrated processing of parameters values of vibration in

each point can give the general information on parameters of the person movement.

As against amplitude analyses, each point frequency vibraimage has physical dimension

frequencies (Hz) as really displays frequency of signal change in each element of the image.

Therefore, the resulted color scale (fig. 6.1) scaling in Hz, i.e. violet color frequency vibraimage

displays a range of vibrations (0 – 1) Hz, dark blue displays a range of vibrations (1 – 4) Hz, green

the range of vibrations displays (4 – 8) Hz, red displays a range of vibrations (8 – 10) Hz.

Red- activity and aggression color.

Yellow – trouble and tension color

Green- normal activity and top condition color

Blue- rest and calm color

Fig. 6.1. Pseudo color scale of frequency distributions

External (around of a head) interline display of the maximal frequency and average amplitude

vibraimage looks as aura and more informatively displays a condition of the person, than internal

vibraimage. Color of vibra-aura is coded by the same color scale, as vibraimage (fig. 6.2), and

displays the maximal frequency in each line. The size of aura is defined by average amplitude for the

given line. Any non-uniformity in color and the size of aura characterizes movements of object and

its emotion condition. The normal condition of the person(see Fig. 6.2) is characterized more uniform

external vibraimage (vibra-aura), and for an stress condition (see Fig. 6.3)of the person are

characteristic the big space and color non-uniformity of vibra-aura.


147

Fig. 6.2. External vibraimage (vibra-aura) of

person in normal condition

Fig. 6.3. External vibraimage (vibra-aura) of

person in tension condition

Brief aura form analysis

1. Any aura asymmetry (form, color) characterized deviation from mental or physiological

norms.

2. Color irregularity of vibra-aura characterizes psycho-physiological imbalance of a person

status.

3. Any breaks in aura uniformity characterized deviation from mental or physiological norms.

4. Ideal aura has mono color, symmetrical and uniform. Any real aura differs from ideal and the

question of interpretation is to characterized real aura deviations.

Note!

This brief aura interpretation correspond default vibraimage system settings and based on

main rules for right vibraimage scanning:

uniform and stable object illumination;

high quality and low nose camera application;

frontal plane object before camera;

maximum facial image size on monitor;

mechanical stabilization of camera.

For more information about the basics of vibraimage technology, refer to the book Vibraimage

of Viktor Minkin, St. Petersburg, Renome publishing, 2017

More detailed information on basic modes of operation, preparation for work with the system,

the analysis of various human conditions, see the "Behavior Detection System VibraImage 8.

Manual", http://www.psymaker.com/downloads/VI8_1ManualEng.pdf

http://www.psymaker.com/downloads/VI8_1ManualEng.pdf


148

7 Warranty

Maintenance service and service regulations of VibraImage 10 system is carried out according

to this Manual and instructions of used hardware maintenance (a computer, the camera, etc.).

ATTENTION!

Information in this document is subject to change without notice and does not represent the

commitment on the part of Elsys Corp. No part of this manual maybe reproduced or transmitted in

any form or by any means, electronic or mechanical, for any purpose without written permission of

Elsys Corp. The software VibraImage 10 described in this document is furnished under license

agreement and maybe used only in accordance with the terms of the license agreement. It is against

the law to copy the software or any other medium except as specifically allowed in license agreement.

The licensee may make one copy of vibraimage software for backup purposes.

7.1 Disclaimer of Warranties

You expressly acknowledge and agree that, to the extent permitted by applicable law, use of

the Vibraimage software and services is at your sole risk and that the entire risk as to satisfactory

quality, performance, accuracy and effort is with you. To the maximum extent permitted by applicable

law, the VibraImage 10 software and services performed by the VibraImage 10 software are provided

"as is" and "as available", with all faults and without warranty of any kind, and Elsys and Elsys’

licensors (collectively referred to as "Elsys" for the purposes of sections 7 and 8) hereby disclaim all

warranties and conditions with respect to the VibraImage 10 software and services, either express,

implied or statutory, including, but not limited to, the implied warranties and/or conditions of

merchantability, satisfactory quality, fitness for a particular purpose, accuracy, quiet enjoyment, and

non-infringement of third party rights. Elsys does not warrant against interference with your

enjoyment of the VibraImage 10 software and services, that the functions contained in or services

performed by the VibraImage 10 software will meet your requirements, that the operation of the

VibraImage 10 software and services will be uninterrupted or error-free, that any service will continue

to be made available, that defects in the VibraImage 10 software or services will be corrected, or that

the VibraImage 10 software will be compatible or work with any third party software, applications

or third party services. Installation of this software may affect the usability of third party software,

applications or third party services. You further acknowledge that the VibraImage 10 software and

services are not intended or suitable for use in situations or environments where the failure or time

delays of, or errors or inaccuracies in, the content, data or information provided by the VibraImage 10

software or services could lead to death, personal injury, 1 or severe physical or environmental

damage, including without limitation the operation of nuclear facilities, aircraft navigation or

communication systems, air traffic control, life support or weapons systems. No oral or written

information or advice given by Elsys or an Elsys authorized representative shall create a warranty.

Should the VibraImage 10 software or services prove defective, you assume the entire cost of all

necessary servicing, repair or correction. Some jurisdictions do not allow the exclusion of implied

warranties or limitations on applicable statutory rights of a consumer, so the above exclusion and

limitations may not apply to you.


149

7.2 Limitation of Liability

To the extent not prohibited by applicable law, in no event shall Elsys be liable for personal

injury, or any incidental, special, indirect or consequential damages whatsoever, including, without

limitation, damages for loss of profits, corruption or loss of data, failure to transmit or receive any

data, business interruption or any other commercial damages or losses, arising out of or related to

your use of or inability to use the VibraImage 10 software and services or any third party software or

applications in conjunction with the VibraImage 10 software, however caused, regardless of the

theory of liability (contract, tort or otherwise) and even if Elsys has been advised of the possibility of

such damages. Some jurisdictions do not allow the limitation of liability for personal injury, or of

incidental or consequential damages, so this limitation may not apply to you. In no event shall Elsys’

total liability to you for all damages (other than as may be required by applicable law in cases

involving personal injury) exceed the amount of twenty five dollars (U.S. $25.00). The foregoing

limitations will apply even if the above stated remedy fails of its essential purpose.

Copyright 2001-2019 Elsys Corp. All rights reserved.

Version VibraImage 10.2.0.163

August 2019

Updates and questions on www.psymaker.com

Russia, 194223, Saint-Petersburg, Toreza, 68

ph./fax: +7 (812) 552 67 19

e-mail: [email protected]

www.elsys.ru

www.psymaker.com

http://www.psymaker.com/

mailto:[email protected]

http://www.elsys.ru/

Documents

ELSYS Corp. - Behavior Detection System VibraImageBehavior Detection System VibraImage Manual Version 10.2.0.223 ELSYS Corp. Saint-Petersburg 2020