Barbara Worsham, PI

Barbara Worsham, PIVice President Animation, Graphics & Video

Rimkus Consulting Group, Inc.

More than 25 years experience in animation, graphics,

and video for litigation.

Expertise includes enhancing video using state-of-the-art

computer software.

Has testified in depositions and trials at the state and

federal levels regarding forensic animation or video

enhancement.

PRESENTER

ENHANCEMENT IN MOVIES AND TELEVISION

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 4

THE CSI EFFECT

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 5

Unrealistic expectations of image quality.

“It’s possible to get a clear image from a reflection on a door

handle; I saw it on CSI...”

WHY DOESN’T SECURITY VIDEO SHOW THE

DETAIL THAT IS IN TV AND MOVIES ?

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 6

HIGH QUALITY VIDEO COSTLY

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 7

~259 GB

per Day

Store Video

xxx Days?How Many

Cameras?

VIDEO QUALITY VS. STORAGE COSTS

5 WAYS BUSINESSES TRY TO SAVE COSTS

#1 Record a Smaller size image

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 8

5 WAYS BUSINESSES TRY TO SAVE COSTS

#2 Compress the Video – Lossy Compression

Details are lost

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 9

IPVM.com resolution vs compression tested

SUBJECT IN

320 X 240

SECURITY VIDEO

ENLARGED

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 10

MORE PIXELS = MORE INFORMATION

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 11

324 pixels 223,104 pixels

COMPRESSED VIDEO EXAMPLE

Compression artifacts can lead to incorrect conclusions

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 12

Close up of compression artifacts –

“blocking” or “quilting”

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 13

BUSINESSES TRY TO SAVE COSTS

#3 Discard half of the scan lines

Storage cut in half

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 14

5 WAYS BUSINESSES TRY TO SAVE COSTS

#4 Lower the frame rate

Additional storage savings

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 15

Frame Rate

•How many images are displayed in 1 second of video

Standard Video

•30 frames per second

Security Video

•30 frames per second to 1 frame per secondor LESS.

DIFFERENT FRAME RATES ANALYZED

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

Slip/Trip or turned ankle?

16

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 17

1 frame per second

56 KB

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 18

5 frames per second

142 KB

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 19

10 frames per second

212 KB

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 20

30 frames per second

353 KB

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 21

10 frames per second is adequate to capture slip/fall

212 KB

FRAME RATE PROS/CONS

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 22

Low•Low frame rate (1 fps) –

•may miss detail - slip/fall

High •High frame rate (30 fps) – Costly Storage

OK•5-10 fps good for most scenes

•15+ fps for best fast moving object (cars)

5 WAYS BUSINESSES TRY TO SAVE COSTS

#5 Cameras set on Motion Detection

Camera records only when it detects movement

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 23

CAMERAS SET FOR MOTION DETECTION

Camera set to capture 1 frame per second AFTER motion is detected

1 hour recorded using motion detection

4 minutes long.

1 hour of standard continuous video.

1 hour long. 24

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 25

If “CSI” enhancement is not real -What can I expect from Enhancement?

What types of video can be enhanced?

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 26

WHAT IS VIDEO ENHANCEMENT?

Resolution

De-blur

De-interlace

Contrast

Noise

Stabilization

•Low

Resolution

•Poor

Lighting

•Noise

•Shake

Sharpen -

Adjusted

Resolution

Corrected

Lighting

Reduced Noise

Stabilized

Enhancement

Filters applied

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 27

ENHANCEMENT

If the information is in the photo or video, then

enhancement can make detail more clear

Enhancement does NOT create informationV I D E O E N H A N C E M E N T A N D A N A L Y S I S 28

BASIC ENHANCEMENT EXAMPLES

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 29

Low Resolution

and Noise

Enhanced

Low Resolution

and Noise

Unenhanced

30

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 31

Low Light

Unenhanced Image from VideoEnhanced Image from Video

Low Light

Unenhanced

Image from Video

Enhanced

Image from Video

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 32

Unenhanced EnhancedStabilization

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 33

SURVEILLANCE VIDEO –

VHS TAPE FORMAT

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 34

Surveillance Video - VHS Tape

SLOW MOTION

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 35

VHS VIDEO - REAL TIME – MAY MISS DETAILS

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 36

STILL IMAGE EXPORTED FROM VIDEO

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 37

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

ORIGINAL UNENHANCED VIDEO

38

FALL OCCURS

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 39

Fall Occurs

LOCATION OF CANE TIP ON FLOOR

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 40

EMPLOYEE MOPPED AREA TOWARDS DOOR

Red Line Indicates where Cane Slipped on Floor

Blue Line Indicates Mop Handle

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 41

EMPLOYEE MOPPED AREA TOWARDS COUNTER

Red Line Indicates where Cane Slipped on Floor

Blue Line Indicates Mop Handle

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 42

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 43

How surveillance video can aid the engineer’s analysis

Speed and Location

of vehicles

Did Slip and fall Occur?

What caused

the slip/fall?

VIDEO – VIEW LOOKING SOUTH

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 44

VIDEO – VIEW LOOKING NORTH

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 45

42.5 mph

Locations and

Speeds of

Vehicles

When light

Turned RED

22.5 mph

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 46

• Frames

per

second

• Distance

traveled

47

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 48

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 49

Shoes supplied by ClaimantShoes worn at time of fall

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 50

LICENSE PLATES

Cameras that aren’t designed to capture license plates will rarely capture license plates.

CONVENIENCE STORE VIDEO IMAGE

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 51

HOME SECURITY VIDEO OF DRIVEWAY

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 52

Cell phone video – video held on license plate

for several seconds

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

License Plate Enhancement

Unenhanced Video Image Enhanced Video Image

53

Even Specialized Cameras have Difficulty

Capturing License Plates at Night

54

SECURITY VIDEO CAPTURED FALL

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 55

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 56

Plaintiff Claimed that she was reaching for railing

Planter blocked her access to railing

Position foot on top step.

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 57

WAS SHE REACHING FOR THE HANDRAIL WHEN SHE

FELL?

UNIQUE STONE PATTERN

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 58

OUTLINE OF STONE PATTERN OVER VIDEO

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

Security Video

Lady Falls Leaving Premises

59

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 60

FIELD SKETCH WITH DIMENSIONS

61

1

2

3456

7

89

123

4

5

6

78

9

49 ½ “ from railing62

SECURITY CAMERA VIDEO OF ACCIDENT

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 63

Tanker Truck Ran Over Pedestrian

Pedestrian – claimed she was in the crosswalk.

Driver - claimed he did not see pedestrians before pulling forward.

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 64

The intersection was modeled in 3D.

The computer’s camera was placed in the same

location as the security video camera

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 65

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 66

The 3D computer model matched the exact

location and timing of the pedestrians in the

security video.

Security Video View 3D Model View

Computer camera matched to security camera’s view

rotates to overhead view

3D Model View

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 67

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 68

Security Video View 3D Model View

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 69

RED ZONE = AREA WHERE 4’9” PEDESTRIAN

NOT VISIBLE TO TRUCK DRIVER

3D Model View

TRUCK DRIVER’S VIEW

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 70

TRUCK DRIVER’S VIEW

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 71

Pedestrians feet/lower legs were visible in front of truck

Security Video

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

72

3D Model

Pedestrians Feet/Lower Legs Were Visible In Front Of Truck

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

73

Pedestrian’s Feet Are Not VisibleUnder Truck If Pedestrians Are Standing At Edge Of Crosswalk

Scenario According To Plaintiff Testimony

V I D E O E N H A N C E M E N T A N D A N A L Y S I S

74

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 75

Best Practices

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 76

SWGIT - Scientific Working Group Imaging Technology, Recommendations and Guidelines for Using

Closed-Circuit Television Security Systems in Commercial Institutions

LIGHTING ISSUES

Afternoon = subject is backlit

Afternoon = lights are added so

that subject’s face is visible

Morning= lighting OK

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 77

from https://www.fbi.gov/news/videos/caught-on-

camera

Lights that are on timers must be checked.

Are lights coming on at correct time?

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 78

from https://www.fbi.gov/news/videos/caught-on-camera

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 79

•Verify time and camera of the incident.

•Verify that incident is in exported video file.

Review recordings

•Videotaping the computer monitor with your cell phone does not count as retrieving the video

NOTE:

•Don’t Save to a Different File Format

•(AVI to MOV or DVD/vob file format)

Collect native file with proprietary

player

Best Practices for Video Enhancement

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 80

•Original 7 frames per second changed to 15 frames per second)

Don’t change the frame rate

•2 hours Before through 2 hours after the incident

Get ALL camera views available

•Exports low quality video

• If operator unsure, suggest calling the supplier to retrieve best quality.

Operator may be Untrained

Best Practices for Video Enhancement

• Type of video, codec, player, MD5 Hash

Document Enhancement

• Replicate the results 100% of the time

Enhancement Software Report

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 81

Documenting Video Enhancement

82

83

Original unenhanced video

• If needed, show enhancement process step by step. Each enhancement step explained

Enhanced video

Enhanced video shown side by side with original

Show Enhanced video only

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 84

Enhanced Video in the Courtroom

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 85

Summary

•Good chance of retrieving one or more videos of incident

Security Cameras and Cell Phone Cameras

•Enhancement and analysis requiredCameras are not set

correctly–

•Video of incident may be uploaded Check YouTube –

•Enhancement possibilities on how the video appears on your screen

Don’t Judge Original Video

•For movies and television “CSI”

•Can provide valuable information beneficial to the case.

Enhancement and Analysis

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 86

Camera Positioning Issues

FBI VIDEO

“CAUGHT ON CAMERA” EXCERPT

V I D E O E N H A N C E M E N T A N D A N A L Y S I S 87

https://www.fbi.gov/news/videos/caught-on-camera

2016 HOSPITALITY LAW CONFERENCEFebruary 22-24, 2016,

Video Enhancement and Analysis

Barbara Worsham, PI

Rimkus Consulting Group, Inc.

bmw@rimkus.com

800-580-3228.