Synesis video analytics deployment across railways

IV All-Russia Theoretical and Practical Conference«Geographically Distributed Security System»

Deployment of video analyticsacross extended railway infrastructure

Nikolai Ptitsyn, Synesis LLC, np@synesis.ruwww.synesis.ru

Kaliningrad, Russia 22 – 24 March 2011

Oktabor’skaia railwayfrom Saint-Petersburg to Moscow

Monitoring railways: key objectives1. Objects People, vehicles, debris

2. Alert situations Object appearingObject stopping/loiteringAbandoned item/debrisVideo quality degradation

3. Strong noises Trains, shadows, precipitation

4. Response time Below 2 seconds

Project challengesPROBLEM SOLUTION

1. Automatic recognitionof alert situations

Video analyticsbased on the latest machine

vision findings

2. Efficient all-weather operations

Integratedthermal and television

surveillance system

3. Very extended installation(over 650 km / 400 miles)

Fully embeddedvideo analytics

4. False alarms caused by multiple detections per

person from multiple cameras

Multiple camera tracking video analytics

Edge equipment

1. Video analytics module with two CCTV cameras

2. Thermalcamera with

video analytics

Television and thermal video analytics combined

Video analytics encoder

ARM9: 365 MHzDSP С64x+: 720 MHzHDVICP (video co-processor)256 Mb RAM

CCTV video analytics

• People tracking range up to 80 meters

TRAIN IGNOREDPEOPLE DETECTED

Thermal camera with embedded

• Thermal sensor 384 * 288 @ 25 fps• Range up 800 meters with 100 mm lens

Video analytics modulefor thermal camera

PAL/NTSC decoderor HD sensor

People/debris detection on railways with thermal camera

• Surveillance range 100 to 800 meters• 7° (W) x 5° (H) for 100 mm lens

TRAIN IGNOREDPERSON DETECTED

Object surveillanceusing multiple sensors

CCTVcamera 1

CCTVcamera 2

Thermal cameraServer

Why multiple camera analytics?

1. Minimizes redundancy and false alerts while preserving all-whether sensitivity

2. Synchronizes television and thermal image3. Tracks objects from camera to camera for– Accurate object positioning on the maps– Automatic channel switching– Automatic angle of view suggesting– Map object searching

Multiple camera tracking testswith 9 CCTV cameras

Multiple camera trackingvideo analytics results

Trajectoryestimatedfrom fivecamera data

Project challengesPROBLEM SOLUTION

1. Automatic recognitionof alert situations

Video analyticsbased on the latest machine

vision findings

2. Efficient all-weather operations

Integratedthermal and television

surveillance system

3. Very extended installation(over 650 km / 400 miles)

Fully embeddedvideo analytics

4. False alarms caused by multiple detections per

person from multiple cameras

Multiple camera tracking video analytics