IBM Video Correlation and Analysis Suite such as crime, natural disasters & terrorism Coordination of efforts and effective use of resources and assets to ensure streamlined interagency

This presentation contains materials that are either copyright © 2011 IBM Corporation or copyright © 2011 Cisco Systems, Inc. All rights reserved. 11

IBM Video Correlation and Analysis Suite

Lee Carbonell

IBM Global Solutions Center – Dallas, Texas


The demand for effective public safety is increasing at unprecedented levels and ensuring it is very difficult

Public safety officials are faced with many types of threats

� Bio-hazards: Chemical Spills, Nuclear Disasters, Pandemic Viruses

� Crimes: Assaults, Drug Trafficking, Murders, Robberies

� Illegal Immigration: EU countries’ many points of entry, Border controls in US

� Natural Disasters: Earthquakes, Tsunamis, Volcanoes

� Terrorism: United States 9/11, Madrid Atocha Train Station 2004, London Bombings 2005, Mumbai India 2008


Public Safety is a major focus for Smarter Cities and the need for progress is clear

66% of people

According to the British Crime Survey, 66% of adults believe crime has risen nationally in the past few years

$3 Million

What a male teenager heading for a life of crime will cost society

18,000 Homicides

In the US using Iowa State University’s methodology, the 18,000 plus homicides recorded in 2007 would cost roughly $300 billion

$3.4 Billion

In New Zealand Government spending on police, corrections, and justice has roughly doubled $3.4 billion in the past 14 years, adjusted for inflation, with little overall effect on crime

$943 per Person

In Canada, the tangible social and economic cost of crime was $31.4 billion, or $943 for each man, woman and child in the country

$778 Billion

The American Academy of Actuaries disclosed that a future large terrorist attack in New York City could result in $778 billion in insured losses


Challenges to Effective Public Safety

� Antiquated technology – Many public safety surveillance systems are at various levels of disrepair and based on outdated technology.

� Disparate systems – Public safety systems often have no integration with other emergency systems, making coordinated response difficult.

� Multiple Providers/Jurisdictions – Perpetrators operate outside of the boundaries of traditional jurisdictions, therefore multi-level agency cooperation is now critical.

� Shrinking Budgets – As budgets tighten, Security Staff and First Responders are being asked to do more with less.

� Ever Changing Threats – Dynamic situational awareness is now required in order for agencies to nimbly respond to a wide variety of threats.


Smarter Cities drive sustainable economic growth

Leveraging Information to enable better decisions� Visualize

• Key Performance Indicators

• Significant events and alerts

• Geospatial mapping

• External information feeds

� Analyze information to identify patterns and trends that warrant action

� Define workflows to speed responsiveness, minimize service

disruptions, avert incident escalation and reduce impacts of

emergency situations

Anticipating Problems to resolve them proactively and integrating the most repeatable best practice patterns

Coordinating Resources for rapid and effective response to issuesProactively trigger pre-defined workflows

Facilitate cross-agency decision making and collaboration in order to enhance citizen service delivery

Optimize intra-agency resource and task scheduling to maximize efficiency and improve service levels

Automatically flag event conflicts between city agencies

Efficient control and utilization of cross-agency resources to reduce the time to resolution of emergency and

crisis situations


Provide improved response capabilities through a communication and collaboration framework that includes real-time information exchange, video for situational awareness and analytics for effective decisions

What are the essential elements of Command, Control & Collaboration?

� Plan and prepare for, respond effectively and recover from

incidents such as crime, natural disasters & terrorism

� Coordination of efforts and effective use of resources and

assets to ensure streamlined interagency collaboration &

elimination of duplicate resource requests

� Unified Communications solutions connect people to people,

agency to agency

� Interoperability solutions create transparency between radios,

telephones, computers and the network

� Mobility solutions provide information anywhere at any time,

especially when combined with Digital Video Surveillance

� Cisco video solutions enhance command control and incident

management reporting and collaboration

Benefits

� Command, Control and Collaboration provides functionality for day-to-day operations in addition to emergency situations

� Coordinated efforts across the region provides streamlined interagency collaboration through incident planning/response and recovery

� Improved response time through live collaboration and reporting

� More accurate and faster assessment of damage

IBM’s Smarter Cities solution for public safety drives command, control & collaboration


IBM’s Smarter Cities Solution IBM’s Smarter Cities Solution

IBM’s Smarter Cities and Cisco’s Video Surveillance hardware, software and services combine to create the world’s leading Public Safety Solution

IBM’s Intelligent Operations CenterIBM’s Intelligent Operations Center

IBM’s Public Safety Solution

IBM’s Smarter Cities Programming Model

Live Video

Integrated Solution Overview

• Live video surveillance integrated

with incident and response

management

• Video archive search and

playback using extracted video

features such as human

appearance, shapes and colors

• Video event management and

alerting to trigger agency response

to threats and crime

• Fully integrated hardware and

software from IBM and Cisco for live

video surveillance, video analytics

and city wide operations

IBM Video Correlation & Analytics

Suite

Incident & Event Mgmt

Agency Collab-oration

Cisco’s Video Surveillance SolutionCisco’s Video Surveillance Solution

Video Cameras

Video Surveillance Manager


• Improved “time to threat elimination”

• Increased responder safety• Robust evidence repository

8

IBM Video Correlation and Analysis Suite & Cisco Physical Security Solutions maximize customers’investment

CAPTURE ANALYZE DECIDE ACT

Cisco High Definition IP Cameras & Video Management System capture and record high quality video for superior live monitoring and review

IBM offers superior hardened storage and Cisco networking infrastructure to transport and archive critical video and data

IBM’s powerful Video Correlation and Analysis Suite generates meaningful events from terabytes of incoming video, correlated with multiple database sources including Cisco Access Control and Building Management systems

Safer, Smarter solutions from IBM and Cisco present Decision Makers with rapid, reliable, actionable intelligence

Deploy valuable and constrained assets against the most critical incidents, with superior intelligence

Deliver the right information to the right people in emergency situations when time is critical

• Video surveillance is a force multiplier

• Leverages existing infrastructure• Increased Threat Deterrence• Optimized Infrastructure

• Reduced false alarms• Minimized manual data correlation

• Real-time analysis• Faster forensic retrieval

• Decreased “time to decision”• Real-time situational awareness• Reliable actionable intelligence


Video Surveillance and Video Analytics Situational Awareness and Incident Management• Real-time access to video and analysis

• Real-time voice & data communications and collaboration

• Efficient person to person reporting and information sharing

Responder Support Systems

• Mobile converged communications

• Information available anyplace and anytime

• Real time video and rich media information access

Unified Communications• Integrated messaging and communication systems

• Interactive video and rich media collaboration

• Phone, radio and PC Interoperability

Video Surveillance• Integrated fixed and mobile Video Surveillance information

• IBM Video Correlation and Analysis Suite

• Video content management and storage

Incident at 3rd

& 4th Incident at 3rd

& 4th

Incident at 3rd

& 4th Incident at 3rd

& 4th

An ExampleFor 500 city camera’s we predict:

~ 25 Million events/day

~ 2.7 Terabytes storage/day

Assuming data retention of 5 weeks:~ 875 Million events total~ 100TB storage total

An ExampleFor 500 city camera’s we predict:

~ 25 Million events/day

~ 2.7 Terabytes storage/day

Assuming data retention of 5 weeks:~ 875 Million events total~ 100TB storage total


Benefits of IBM’s Video Analytics

� Prioritization for Real Time Camera Monitoring

� Challenge: Customers are installing thousands of cameras, but only have a handful of operators to monitor them. Which cameras should be watched?

� VCAS Value: VCAS technology can monitor thousands of camera and identify the cameras that need to be scrutinized by operators - based on predefined threat conditions.

� Rapid Video Search

� Challenge: During investigations the customer may need to search through thousands of hours of video to locate a specific person or vehicle (e.g. the London Tube bombings). This effort requires hundreds of people working over weeks to locate event of interest.

� VCAS Value: VCAS content based video indexing technology allows operators to rapidly search through thousands of hours of video for specific events (e.g. red cars or person with blue jacket). The search effort can be reduced by up to 30x ascompared to manual searching of video.

� Intelligence Gathering

� Challenge: Discovering activities, like counter surveillance and abnormal behavior patterns, using traditional video camera infrastructure is considered almost an impossible task to accomplish manually.

� VCAS Value: The searchable event database of VCAS can be used as a basis for discovery functions, which allow an operator to assess potential threats.

� Customized Solutions

� Challenge: Video can be used to perform several high value tasks - monitoring rail-road crossings, monitoring cashiers, assessing parking lot occupancy and monitoring patients in an elder care facility. These special purpose solutions need customization of the base VCAS framework at multiple layers.

� VCAS Value: The VCAS framework lends itself to rapid customization and solution development. This enables customers to start with the base VCAS solution and use the same framework to develop customized high value solutions in partnership with IBM.

10


IBM Products & Services

IBMServersIBM Blade Center chassis with X-Series Blades

GeoCOPGeoSpatial Common Operating Picture –web-based voice, video, and data overlay technology that connects people, applications, and knowledge with operational processes.

StorageWide range of storage options, depending on the customer’s needs

Design & Deployment ServicesProven Services from the world's largest business and technology services provider

Video AnalyticsAward winning video analytic solution, tailored for surveillance applications

Networking ServicesWired and/or wireless networking solutions for every environment

Crime Information WarehouseIBM’s best of breed data analytics applied to crime data

Managed Technical SupportA single point of accountability to simplifysupport for multi-vendor relationships

Security ServicesProvider of the broadest range of security solutions in the industry

Project Management ExpertiseGlobally developed methods proven over decades of system integration experience


Cisco Physical Security Products

• Dispatch console

• Mobile client

• Rich media

• High availability

• Push-to-Talk (PTT) to IP phone

Access Control

• Box, dome, PTZ

• Wi-Fi

• Indoor & outdoor

• Onboard analytics

• Forensic search

• Bulk camera UPG

• Health dashboard

• Open standards

Video Surveillance

IP CamerasNotification

and Response

Standard Definition and High Definition

IP Cameras

Video Surveillance Operations Manager

Physical Access Manager

• Biometrics

• Mapping

• Web services API

• High availability

• Integrated video

IPICS


Smart Vision Suite (SVS)


IBM Smart Video Analytics – Real-Time Alerting and Content-based Search

Coordination CenterIBM Smart Vision SuiteCameras

Searchable

Video Index

1. Law Enforcement

2. City Operations

3. Store Security

4. Store Operations

Analyze Decide ActCapture

Video

Operational Operational

DashboardDashboard

Response

Event

Response

Event

Search / Pattern

Analysis

Real-time alerts

Analyze

& Index

Scalable indexing and feature-based searching of video contents

SVS


IBM Smart Video Analytics Turns Cameras into Information Sources

SVS


SVS


Smart Vision Suite (SVS) provides automatic alerts –

e.g., detection of loitering vehicles based on virtual trip-wires in scenes

SVS


Smart Vision Suite (SVS) provides content-based searching –e.g., finding blue cars on bridge over given time period

SVS


SVS

SVS Visual Activity / Event-based Alerting


SVS

SVS Customer Use Cases


Challenges of video analytics in practice, e.g, urban settings

Tracking

Object

Classification

Feature

Classification

Background

Subtraction

Variations in scenes and conditions

SVS

Anomalies Crowded Scenes


SVS


Video Analytics in Market


ObjectVideo(http://www.objectvideo.com/)

Content Analytics Search

Alerts


AGENTvi(http://www.agentvi.com/)

Analytics

Search

Alerts


IoI(http://www.ioimage.com)

Analytics Alerts

Search


aimetis(http://aimetis.com)

Analytics AlertsSearch


BRSLabs(http://www.brslabs.com/)

Analytics

Alerts


IntuVision(http://www.intuvisiontech.com/)

Panoptes

VideoRecall


KitWare(http://www.kitware.com/)

DARPA VIRAT, PerSEAS

Open Source SW

IARPA ALADDIN


PittPatt(http://www.pittpatt.com/)


IBM Video Analytics

FAME - IBM Video Analytics Integration

SVS

IMARS

HARRIS FAME System

• Image/video analytics

extract alerts and

metadata and insert

markers in FAME

• Extracted metadata

becomes searchable in

FAME

Scenario capabilities:1. Automatic alert if backpack left within pre-defined area

2. Observe a building for the approach and departure of a

specific pre-described vehicle and send an alert when a

matching vehicle approaches or leaves the building

3. Automatically determine traffic pattern changes and issue

alerts (e.g., response to IED emplacement in certain area)


The End

33

Documents

IBM Video Correlation and Analysis Suite such as crime, natural disasters & terrorism Coordination of efforts and effective use of resources and assets to ensure streamlined interagency