Embed Size (px)
Citation preview
Barbara Worsham, PIVice President Animation, Graphics & Video
Rimkus Consulting Group, Inc.
More than 25 years experience in animation, graphics,
and video for litigation.
Expertise includes enhancing video using state-of-the-art
computer software.
Has testified in depositions and trials at the state and
federal levels regarding forensic animation or video
enhancement.
PRESENTER
ENHANCEMENT IN MOVIES AND TELEVISION
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 4
THE CSI EFFECT
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 5
Unrealistic expectations of image quality.
“It’s possible to get a clear image from a reflection on a door
handle; I saw it on CSI...”
WHY DOESN’T SECURITY VIDEO SHOW THE
DETAIL THAT IS IN TV AND MOVIES ?
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 6
HIGH QUALITY VIDEO COSTLY
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 7
~259 GB
per Day
Store Video
xxx Days?How Many
Cameras?
VIDEO QUALITY VS. STORAGE COSTS
5 WAYS BUSINESSES TRY TO SAVE COSTS
#1 Record a Smaller size image
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 8
5 WAYS BUSINESSES TRY TO SAVE COSTS
#2 Compress the Video – Lossy Compression
Details are lost
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 9
IPVM.com resolution vs compression tested
SUBJECT IN
320 X 240
SECURITY VIDEO
ENLARGED
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 10
MORE PIXELS = MORE INFORMATION
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 11
324 pixels 223,104 pixels
COMPRESSED VIDEO EXAMPLE
Compression artifacts can lead to incorrect conclusions
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 12
Close up of compression artifacts –
“blocking” or “quilting”
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 13
BUSINESSES TRY TO SAVE COSTS
#3 Discard half of the scan lines
Storage cut in half
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 14
5 WAYS BUSINESSES TRY TO SAVE COSTS
#4 Lower the frame rate
Additional storage savings
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 15
Frame Rate
•How many images are displayed in 1 second of video
Standard Video
•30 frames per second
Security Video
•30 frames per second to 1 frame per secondor LESS.
DIFFERENT FRAME RATES ANALYZED
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
Slip/Trip or turned ankle?
16
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 17
1 frame per second
56 KB
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 18
5 frames per second
142 KB
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 19
10 frames per second
212 KB
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 20
30 frames per second
353 KB
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 21
10 frames per second is adequate to capture slip/fall
212 KB
FRAME RATE PROS/CONS
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 22
Low•Low frame rate (1 fps) –
•may miss detail - slip/fall
High •High frame rate (30 fps) – Costly Storage
OK•5-10 fps good for most scenes
•15+ fps for best fast moving object (cars)
5 WAYS BUSINESSES TRY TO SAVE COSTS
#5 Cameras set on Motion Detection
Camera records only when it detects movement
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 23
CAMERAS SET FOR MOTION DETECTION
Camera set to capture 1 frame per second AFTER motion is detected
1 hour recorded using motion detection
4 minutes long.
1 hour of standard continuous video.
1 hour long. 24
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 25
If “CSI” enhancement is not real -What can I expect from Enhancement?
What types of video can be enhanced?
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 26
WHAT IS VIDEO ENHANCEMENT?
Resolution
De-blur
De-interlace
Contrast
Noise
Stabilization
•Low
Resolution
•Poor
Lighting
•Noise
•Shake
Sharpen -
Adjusted
Resolution
Corrected
Lighting
Reduced Noise
Stabilized
Enhancement
Filters applied
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 27
ENHANCEMENT
If the information is in the photo or video, then
enhancement can make detail more clear
Enhancement does NOT create informationV I D E O E N H A N C E M E N T A N D A N A L Y S I S 28
BASIC ENHANCEMENT EXAMPLES
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 29
Low Resolution
and Noise
Enhanced
Low Resolution
and Noise
Unenhanced
30
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 31
Low Light
Unenhanced Image from VideoEnhanced Image from Video
Low Light
Unenhanced
Image from Video
Enhanced
Image from Video
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 32
Unenhanced EnhancedStabilization
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 33
SURVEILLANCE VIDEO –
VHS TAPE FORMAT
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 34
Surveillance Video - VHS Tape
SLOW MOTION
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 35
VHS VIDEO - REAL TIME – MAY MISS DETAILS
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 36
STILL IMAGE EXPORTED FROM VIDEO
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 37
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
ORIGINAL UNENHANCED VIDEO
38
FALL OCCURS
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 39
Fall Occurs
LOCATION OF CANE TIP ON FLOOR
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 40
EMPLOYEE MOPPED AREA TOWARDS DOOR
Red Line Indicates where Cane Slipped on Floor
Blue Line Indicates Mop Handle
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 41
EMPLOYEE MOPPED AREA TOWARDS COUNTER
Red Line Indicates where Cane Slipped on Floor
Blue Line Indicates Mop Handle
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 42
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 43
How surveillance video can aid the engineer’s analysis
Speed and Location
of vehicles
Did Slip and fall Occur?
What caused
the slip/fall?
VIDEO – VIEW LOOKING SOUTH
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 44
VIDEO – VIEW LOOKING NORTH
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 45
42.5 mph
Locations and
Speeds of
Vehicles
When light
Turned RED
22.5 mph
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 46
• Frames
per
second
• Distance
traveled
47
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 48
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 49
Shoes supplied by ClaimantShoes worn at time of fall
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 50
LICENSE PLATES
Cameras that aren’t designed to capture license plates will rarely capture license plates.
CONVENIENCE STORE VIDEO IMAGE
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 51
HOME SECURITY VIDEO OF DRIVEWAY
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 52
Cell phone video – video held on license plate
for several seconds
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
License Plate Enhancement
Unenhanced Video Image Enhanced Video Image
53
Even Specialized Cameras have Difficulty
Capturing License Plates at Night
54
SECURITY VIDEO CAPTURED FALL
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 55
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 56
Plaintiff Claimed that she was reaching for railing
Planter blocked her access to railing
Position foot on top step.
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 57
WAS SHE REACHING FOR THE HANDRAIL WHEN SHE
FELL?
UNIQUE STONE PATTERN
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 58
OUTLINE OF STONE PATTERN OVER VIDEO
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
Security Video
Lady Falls Leaving Premises
59
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 60
FIELD SKETCH WITH DIMENSIONS
61
1
2
3456
7
89
123
4
5
6
78
9
49 ½ “ from railing62
SECURITY CAMERA VIDEO OF ACCIDENT
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 63
Tanker Truck Ran Over Pedestrian
Pedestrian – claimed she was in the crosswalk.
Driver - claimed he did not see pedestrians before pulling forward.
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 64
The intersection was modeled in 3D.
The computer’s camera was placed in the same
location as the security video camera
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 65
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 66
The 3D computer model matched the exact
location and timing of the pedestrians in the
security video.
Security Video View 3D Model View
Computer camera matched to security camera’s view
rotates to overhead view
3D Model View
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 67
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 68
Security Video View 3D Model View
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 69
RED ZONE = AREA WHERE 4’9” PEDESTRIAN
NOT VISIBLE TO TRUCK DRIVER
3D Model View
TRUCK DRIVER’S VIEW
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 70
TRUCK DRIVER’S VIEW
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 71
Pedestrians feet/lower legs were visible in front of truck
Security Video
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
72
3D Model
Pedestrians Feet/Lower Legs Were Visible In Front Of Truck
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
73
Pedestrian’s Feet Are Not VisibleUnder Truck If Pedestrians Are Standing At Edge Of Crosswalk
Scenario According To Plaintiff Testimony
V I D E O E N H A N C E M E N T A N D A N A L Y S I S
74
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 75
Best Practices
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 76
SWGIT - Scientific Working Group Imaging Technology, Recommendations and Guidelines for Using
Closed-Circuit Television Security Systems in Commercial Institutions
LIGHTING ISSUES
Afternoon = subject is backlit
Afternoon = lights are added so
that subject’s face is visible
Morning= lighting OK
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 77
from https://www.fbi.gov/news/videos/caught-on-
camera
Lights that are on timers must be checked.
Are lights coming on at correct time?
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 78
from https://www.fbi.gov/news/videos/caught-on-camera
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 79
•Verify time and camera of the incident.
•Verify that incident is in exported video file.
Review recordings
•Videotaping the computer monitor with your cell phone does not count as retrieving the video
NOTE:
•Don’t Save to a Different File Format
•(AVI to MOV or DVD/vob file format)
Collect native file with proprietary
player
Best Practices for Video Enhancement
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 80
•Original 7 frames per second changed to 15 frames per second)
Don’t change the frame rate
•2 hours Before through 2 hours after the incident
Get ALL camera views available
•Exports low quality video
• If operator unsure, suggest calling the supplier to retrieve best quality.
Operator may be Untrained
Best Practices for Video Enhancement
• Type of video, codec, player, MD5 Hash
Document Enhancement
• Replicate the results 100% of the time
Enhancement Software Report
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 81
Documenting Video Enhancement
82
83
Original unenhanced video
• If needed, show enhancement process step by step. Each enhancement step explained
Enhanced video
Enhanced video shown side by side with original
Show Enhanced video only
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 84
Enhanced Video in the Courtroom
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 85
Summary
•Good chance of retrieving one or more videos of incident
Security Cameras and Cell Phone Cameras
•Enhancement and analysis requiredCameras are not set
correctly–
•Video of incident may be uploaded Check YouTube –
•Enhancement possibilities on how the video appears on your screen
Don’t Judge Original Video
•For movies and television “CSI”
•Can provide valuable information beneficial to the case.
Enhancement and Analysis
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 86
Camera Positioning Issues
FBI VIDEO
“CAUGHT ON CAMERA” EXCERPT
V I D E O E N H A N C E M E N T A N D A N A L Y S I S 87
https://www.fbi.gov/news/videos/caught-on-camera
2016 HOSPITALITY LAW CONFERENCEFebruary 22-24, 2016,
Video Enhancement and Analysis
Barbara Worsham, PI
Rimkus Consulting Group, Inc.
800-580-3228.
