Reference Design Architecture for Milestone … · 2016-11-24 · 3 Reference Design Architecture for Milestone XProtect® and Spectra Logic Verde DPE Verde DPE Recommended Configurations

Reference Design Architecture for

Milestone XProtect® and Spectra Logic Verde DPE

June 2016

TABLE OF CONTENTS Introduction .................................................................................................................................................. 4

Solution Overview ..................................................................................................................................... 4

ReThinking IP Video Retention ................................................................................................................. 4

Reference Architecture Design ................................................................................................................. 4

Milestone XProtect Architecture Overview .................................................................................................. 5

Milestone XProtect Platforms................................................................................................................... 5

Table 1, XProtect Archiving Features .................................................................................................... 5

XProtect Overview .................................................................................................................................... 5

XProtect Best Practices for Video Storage ................................................................................................ 5

Milestone XProtect Corporate Architecture ............................................................................................. 6

Figure 1, Milestone Corporate Architecture ......................................................................................... 6

Spectra Verde DPE Architecture Overview ................................................................................................... 7

Physical Hardware .................................................................................................................................... 7

Disk Drive and Recording Technology ...................................................................................................... 7

Table 2, Verde DPE Capacity ................................................................................................................. 8

Network Connectivity and Access Protocol .............................................................................................. 8

Figure 2, Verde DPE Rear Panel ............................................................................................................ 8

XProtect / Verde DPE Reference Design ....................................................................................................... 9

IP Camera Video Flow ............................................................................................................................... 9

Figure 3, IP Camera Video Flow ............................................................................................................ 9

IP Camera Video Long-Term Retention Scaling ...................................................................................... 10

Figure 4, Multi-Recording Server, Single Verde DPE Master Node. ................................................... 10

Figure 5, Multi-Recording Server, Dual Verde DPE Master Nodes ..................................................... 11

Live to Archive Database Write Performance ........................................................................................ 12

Figure 6, Verde DPE write performance ............................................................................................. 12

Archive Database to Smart Client Read Performance ............................................................................ 12

Figure 7, Verde DPE read performance .............................................................................................. 12

XProtect / Verde DPE Reference Design Tools ........................................................................................... 13

Estimating IP Camera Video Recording Storage ..................................................................................... 13

Figure 8, Spectra’s XProtect Calculator / Configuration Tool ............................................................. 13

3 Reference Design Architecture for Milestone XProtect® and Spectra Logic Verde DPE

Verde DPE Recommended Configurations ................................................................................................. 14

50 Cameras, 90, 180, 365 Days of Retention .......................................................................................... 14

Table 2, 50 Camera Parameters .......................................................................................................... 14

125 Cameras, 90, 180, 365 Days of Retention ........................................................................................ 15

Table 3, 125 Camera Parameters ........................................................................................................ 15





1000 Cameras, 90, 180, 365 Days of Retention ...................................................................................... 18


Project Design Assistance ........................................................................................................................... 19

Spectra Logic Contact Information ............................................................................................................. 19

World Headquarters ............................................................................................................................... 19

European Headquarters.......................................................................................................................... 19

Asia/Pacific/Japan Headquarters ............................................................................................................ 19

Legal Information ........................................................................................................................................ 19

Reference Design Architecture for Milestone XProtect® and Spectra Logic Verde DPE 4

INTRODUCTION SOLUTION OVERVIEW This Reference Design Architecture document outlines requirements necessary to address the retention of IP video assets. It also addresses best practices in implementing a reliable and affordable design architecture to automate long-term archiving using Spectra Logic Verde DPE enterprise NAS with the Milestone XProtect® platform.

RETHINKING IP VIDEO RETENTION The implementation of a video surveillance system is often necessary for security and safety needs, as well as for other purposes, including legal and regulatory compliance. IP video retention terms have shown a steady increase from months to years. The video surveillance market is rapidly deploying new technologies in both hardware and application software, providing useful features and benefits to traditional and nontraditional customers. Milestone XProtect supports the widest choice in network hardware devices, with system components such as servers, digital cameras, encoders and network storage. A key element of deploying an IP video surveillance system is a reliable and flexible data storage solution. Spectra Logic, as a solution provider partner of Milestone, integrates its family of storage archiving products within the XProtect open platform architecture. Users are no longer bound to block-based storage because Spectra provides both file and object-based storage, allowing IT and security managers to reduce costs and leverage unlimited options to manage the long-term retention of IP video assets.

REFERENCE ARCHITECTURE DESIGN Spectra Logic provides two products certified under Milestone’s XProtect Certification Program: Verde and Verde DPE. Scaling in capacity and performance, Spectra Verde DPE is designed to store recorded surveillance video from hundreds to thousands of IP cameras, providing long-term retention for XProtect’s archive databases.


MILESTONE XPROTECT ARCHITECTURE OVERVIEW MILESTONE XPROTECT PLATFORMS Spectra Verde DPE is certified with XProtect Corporate, Expert, Enterprise, Professional and Express – and supports their associated archiving features.

Archiving Features XProtect Express

XProtect Professional

XProtect Enterprise

XProtect Expert

XProtect Corporate

Video retention time Unlimited Unlimited Unlimited Unlimited Unlimited Recording capacity per device/day >1 TB(1) >1 TB(1) >1 TB(1) Unlimited Unlimited Archiving of recordings ✓ ✓ ✓ ✓ ✓ Archiving to network drives ✓ ✓ ✓ ✓ ✓ Dynamic archiving (disk spanning) ✓ ✓ ✓ - - Online access to archives ✓ ✓ ✓ ✓ ✓ Archiving schedules Hourly Hourly Hourly Hourly Hourly Storage definition and retention time per device ✓ ✓ ✓ ✓ ✓

Storage definition and retention time that can be applied to individual cameras or common for multiple devices

- - - ✓ ✓

Multi-stage video storage and data grooming - - - - ✓

Storage overview (used vs. available space) of available storage drives ✓ ✓ ✓ ✓ ✓

Event on premature deletion of video due to insufficient physical storage - - - ✓ ✓

Note: (1) Actual effective storage available will vary dependent on the stored video format and resolution

Table 1, XProtect Archiving Features

XPROTECT OVERVIEW This reference document is applicable to all XProtect platforms that support Milestone’s archive feature. XProtect Corporate is a powerful IP video management software (VMS) designed for large-scale, high-security deployments. Its single-seat management capability enables efficient administration across all cameras and servers, regardless of total system size or multiple-site distribution. For systems demanding critical situational awareness and precise response to incidents, XProtect Corporate features interactive maps linked to alarms and include support for XProtect® Smart Wall. XProtect Corporate provides the ultimate system reliability for high-security installations. Edge Storage support, combined with failover recordings and redundant management servers, ensure video recordings are never interrupted.

XPROTECT BEST PRACTICES FOR VIDEO STORAGE Milestone recommends utilizing XProtect’s video archiving feature as a video retention best practice, which moves recently recorded live video to larger, long-term archive video storage arrays on a scheduled basis. Milestone pioneered automatic long-term video archive and has implemented an automatic retention policy that requires minimal maintenance. All XProtect products have configurable retention periods supporting automated, scheduled archiving.


MILESTONE XPROTECT CORPORATE ARCHITECTURE

Recording Server

Failover Recording

Server

ManagementServer

FailoverManagement

Server

SQLServer

Management Client

Smart Client

PTZ IP Camera

Fixed IP Camera

Figure 1, Milestone Corporate Architecture. Milestone’s client / server architecture scales by adding additional servers over multiple sites. A typical network design supports multiple IP camera networks and multiple system networks.


SPECTRA VERDE DPE ARCHITECTURE OVERVIEW PHYSICAL HARDWARE

Spectra Verde DPE is available in two physical node types: master and expansion. Together with Milestone, the Spectra Verde DPE system meets evolving storage and performance requirements by easily adding capacity and performance through the addition of nodes. A single master node connects to a maximum of 9 expansion nodes. A maximum of 35 disk drives are available on the master node, and up to 96 disk drives are available per expansion node, for a total of 899 disk drives per rack. When a recording server’s write throughput exceeds a master nodes’ capability, adding a second master node allows the archive streams from XProtect’s recording server to balance across the master nodes.

DISK DRIVE AND RECORDING TECHNOLOGY Spectra Verde DPE deploys 8TB, Shingled Magnetic Recording [SMR] disk drives. Its ZFS file system uses a Z3 (triple parity) band with 20 data drives and 3 parity disk drives on a band. Data integrity and chain of custody using SHA-265 Hashing and triple parity achieves a 1067 BER.

Spectra Verde DPE 4U Master Node 4U Expansion Node

Minimum Capacity RAW 200TB 200TB

Maximum Capacity RAW 200TB 800TB

Maximum System Capacity RAW 10 Nodes = 7.4PB

Master Node

Expansion Node

Multi-Node


Table 2, Spectra Verde DPE Capacity table shows the raw capacity for each node and maximum capacity for a full 10-node rack configuration.

NETWORK CONNECTIVITY AND ACCESS PROTOCOL Full network bandwidth is available using a high-performance setup.

Spectra Verde DPE data ports can be ordered, supporting either Optical or Copper Ethernet connectivity.

• Dual 10 GigE (GBase-T optical) ports • Dual 10 GigE (GBase-T copper) ports

Spectra Verde DPE Data Ports • One 10 GigE (GBase-T copper or optical) • Two 10 GigE (GBase-T copper or optical) in LACP

Spectra Verde DPE Management Port • RJ45 10GBase-T management port, browser-based web interface

Spectra Verde DPE Protocol • CIFS – SMB 2.1

Figure 2, Spectra Verde DPE Rear Panel


MILESTONE XPROTECT / SPECTRA LOGIC VERDE DPE REFERENCE DESIGN IP CAMERA VIDEO FLOW In the Milestone XProtect system, video is first recorded to a live database and later transferred for long-term storage in an archive database. The live video database typically resides on the recording server’s local storage or direct-attached storage locations and, according to video retention policy, is moved to the archive video database. Fast, low latency, block-based disk is used for live recording, while a file-based, network-attached storage location is used for archive database recording. In this design, each recording server has access to a NAS shared volume, making a single shared volume a common archive database storage location. Milestone best practices recommends keeping the live video database to a maximum size of 24 hours, and transferring video to the archive database periodically throughout the same 24-hour period.

XProtect Smart Client

Archive DatabaseVerde DPE NAS

Live Database

XProtectRecording ServerFixed IP

camera

IP Video Write to Live DBIP Video Write to Archive DBIP Video Read Request PathIP Video Archive DB Playback

Figure 3, IP Camera Video Flow to XProtect recording server then to Verde DPE, accessed by XProtect Smart Client for viewing.


IP CAMERA VIDEO LONG-TERM RETENTION SCALING

Fixed IPCameras

Master Node

Expansion Node

XProtectSmart Client

XProtectSQL Server

XProtect Management Server

XProtect Management Client

XProtectRecording Server

Live Database


Live Database


Live Database


Live Database

Verde DPE NASArchive Database

IP Video Writing to Archive Database

Figure 4, Multi-Recording Server, Single Verde DPE Master Node.

The Verde DPE architecture supports up to 9 expansion nodes, which allows it to scale in storage capacity to 7.4PB. Spectra recommends single link or dual link aggregated 10Gbe network connectivity for writing and reading IP video to Verde DPE.


Fixed IPCameras

Master Node

Expansion Node

XProtectSQL Server

XProtect Management Server


Live Database


Live Database


Live Database


Live Database



Master Node

Expansion Node

IP Video Writing to Archive Database

XProtectSmart Client

XProtect Management Client

Figure 5, Multi-Recording Server, Dual Verde DPE Master Nodes

As the amount of IP cameras, motion and image quality increases, the total write and read bandwidth of the system can exceed the capacity of a single Verde DPE master node. A second Verde DPE master node can then be added to the multi-recording server XProtect system. The XProtect recording servers are configured to load balance the recording bandwidth between the two Verde DPE master nodes.


LIVE TO ARCHIVE DATABASE WRITE PERFORMANCE To optimize the overall video recording “write” performance, XProtect’s default archive block size of 4096 byte blocks needs to be modified during installation. Spectra’s best practices for Verde DPE is to update XProtect to match Verde DPE’s block size of 131072 bytes per block. Spectra provides instructions to modify the recording server configuration file: RecorderConfig.xml.

The graph in Figure 5 shows available write performance using a single Verde DPE master node, six XProtect record servers, 131072 bytes per block, and an hourly transfer from the individual live databases to the archive database. The write performance shown is a modest system configuration of 400 IP cameras; a single Verde DPE master node can accommodate higher recording performance.

Figure 6, Verde DPE Write Performance in a multi-recording server XProtect system with IP camera recording bandwidth exceeding the capability of a single Verde DPE master node.

ARCHIVE DATABASE TO SMART CLIENT READ PERFORMANCE An important consideration in system design is the recorded video read bandwidth from the IP video archive database stored on Verde DPE, which is generated due to video search and playback in XProtect’s Smart Client. Spectra recommends reserving 20 percent of the overall write recording bandwidth for IP camera video playback.

Figure 7, Verde DPE read performance in a multi-recording server XProtect system

0100200300400500

1 53 105

157

209

261

313

365

417

469

521

573

625

677

729

781

833

885

937

989

1041

1093

1145

1197

1249

1301

1353

1405

1457

Write MB/sec


XPROTECT / VERDE DPE REFERENCE DESIGN TOOLS ESTIMATING IP CAMERA VIDEO RECORDING STORAGE Milestone and Spectra each have tools for calculating system storage requirements. These tools analyze several key project requirements and use those variables to estimate the total amount of archive database storage. Both calculator tools are similar in the baseline parameters used and provide similar results.

Seven parameters can be used to define a pool of cameras. The results generated from these parameters are the total recording bandwidth and the amount of storage needed in the Verde DPE to support the XProtect archive database. A suggested Verde DPE configuration is supplied for quotation purposes.

Figure 8, Spectra’s XProtect Calculator / Configuration Tool


VERDE DPE-RECOMMENDED CONFIGURATIONS 50 CAMERAS, 90, 180, 365 DAYS OF RETENTION

Camera Specifications / Spectra XProtect Calculator Cameras: 50 Image Complexity: Medium

Resolution: HD 1080 (1920x1080) Recording / Motion %: 35% Frames Per Second: 30 Operational Hours Per Day: 24

Codec: H.264 Recording Bandwidth: 12.69 MB/sec Table 2, 50 Camera Parameters

90 Days of Recording / Milestone Archive DB Retention Amount = 94TB / USD North America Price Part Number Description Quantity Price Each Price Total

D1FEA00D25BAA Verde DPE 4U Master Node with 200TB RAW Storage, SMB 2.1, 2x10 Gb Ethernet with SFPs, rack mount kit with Active Bezel. 1 $34,000 $34,000

90999716 Drive License Key - enables DPE Disk Drives. 25 $0.01 $0.25 SDE-HW-1-BAS Warranty Support, 1 Year SpectraGuard Basic Support and 5x9

telephone/email support 1 $0.00 $0.00

90990505 Professional Services, Onsite Installation/Integration, per Master Node

1 $3,200 $3,200

Total $36,200.25

180 Days of Recording / Milestone Archive DB Retention Amount = 188TB / USD North America Price Part Number Description Quantity Price Each Price Total


X6AN13B000BAAA Verde DPE 4U Expansion Node 1 with 200TB RAW Storage, rack mount kit with bezel, HBAs and SAS Cables. 1 $26,000 $26,000

90999716 Drive License Key - enables DPE Disk Drives. 50 $0.01 $0.50 9563 PDU Power Cord, C-14 TO C13 ,14AWG, 8 feet 2 $1.00 $2.00

SDE-HW-1-BAS Warranty Support, 1 Year SpectraGuard Basic Support and 5x9 telephone/email support 1 $0.00 $0.00


1 $3,200 $3,200

90990533 Professional Services, Onsite Installation/Integration per Expansion Node

1 $800 $800

Total $64,002.50

365 Days of Recording / Milestone Archive DB Retention Amount = 382 TB / USD North America Price Part Number Description Quantity Price Each Price Total

D1FEA00D25BAA Verde DPE 4U Master Node with 200TB RAW Storage, SMB2.1, 2x10 Gb Ethernet with SFPs, rack mount kit with Active Bezel. 1 $34,000 $34,000

X6AP13B000BAAA Verde DPE 4U Expansion Node 1 with 600TB RAW Storage, rack mount kit with bezel, HBAs and SAS Cables. 1 $57,000 $57,000

10633 Hard Drive Blank Covers 5 $7.00 $35.00 90999716 Drive License Key - enables DPE Disk Drives 100 $0.01 $1.00

9563 PDU Power Cord, C-14 TO C13 ,14AWG, 8 feet 2 $1.00 $2.00 SDE-HW-1-BAS Warranty Support, 1 Year SpectraGuard Basic Support and 5x9



1 $3,200 $3,200


1 $800 $800

Total $95,038


125 CAMERAS, 90, 180, 365 DAYS OF RETENTION Camera Specifications / Spectra XProtect Calculator

Cameras: 125 Image Complexity: Medium Resolution: HD 1080 (1920x1080) Recording / Motion %: 35%

Frames Per Second: 30 Operational Hours Per Day: 24 Codec: H.264 Recording Bandwidth: 31.72 MB/sec

Table 3, 125 Camera Parameters



X6AN13B000BAAA Verde DPE 4U Expansion Node 1 with 200TB RAW Storage, rack mount kit with bezel, HBAs and SAS Cables. 1 $26,000 $26,000

90999716 Drive License Key - enables DPE Disk Drives. 50 $0.01 $0.50 9563 PDU Power Cord, C-14 TO C13 ,14AWG, 8 feet 2 $1.00 $2.00



1 $3,200 $3,200


1 $800 $800

Total $64,002.5








1 $3,200 $3,200


1 $800 $800

Total $95,038

365 Days of Recording / Milestone Archive DB Retention Amount = 954 TB / USD North America Price

Part Number Description Quantity Price Each Price Total D1FEA00D25BAA Verde DPE 4U Master Node with 200TB RAW Storage, SMB2.1,

2x10 Gb Ethernet with SFPs, rack mount kit with Active Bezel. 1 $34,000 $34,000


90999716 Drive License Key - enables DPE Disk Drives 225 $0.01 $2.25 9563 PDU Power Cord, C-14 TO C13 ,14AWG, 8 feet 2 $1.00 $2.00



1 $3,200 $3,200


2 $800 $1,600

Total $182,804.25













1 $3,200 $3,200


1 $800 $800

Total $95,038








1 $3,200 $3,200


2 $800 $1,600

Total $182,804.25





90999716 Drive License Key - enables DPE Disk Drives 425 $0.01 $4.25 10633 Hard Drive Blank Covers 5 $7.00 $35.00




1 $3,200 $3,200


4 $800 $3,200

Total $328,441.25



Cameras: 500 Image Complexity: Medium Resolution: HD 1080 (1920x1080) Recording / Motion %: 35% Frames Per Second: 30 Operational Hours Per Day: 24 Codec: H.264 Recording Bandwidth: 126.89 MB/sec








1 $3,200 $3,200


2 $800 $1,600

Total $182,804.25









1 $3,200 $3,200


4 $800 $3,200

Total $328,441.25









1 $3,200 $3,200


8 $800 $6,400

Total $619,645.25













1 $3,200 $3,200


4 $800 $3,200

Total $328,441.25









1 $3,200 $3,200


8 $800 $6,400

Total $619,645.25




X6AP13B000BAAA Verde DPE 4U Expansion Node 1 with 800TB RAW Storage, rack mount kit with bezel, HBAs and SAS Cables. 16 $72,000 $1,152,000





2 $3,200 $6,400


16 $800 $12,800

Total $1,239,290.5


PROJECT DESIGN ASSISTANCE This Reference Design Architecture document addresses video archive database storage needs utilizing the Milestone XProtect and Spectra Logic Verde DPE. If further assistance with specific projects is required, our staff of professional services architects are available to recommend customized solutions. SPECTRA LOGIC CONTACT INFORMATION WORLD HEADQUARTERS Spectra Logic Corporation 6285 Lookout Road Boulder, CO 80301-3580 Main: +1.800.833.1132 / +1.303.449.6400 URL: spectralogic.com EUROPEAN HEADQUARTERS Spectra Logic Europe Ltd 329 Doncastle Road Bracknell, Berks, RG12 8PE United Kingdom Main: +44 870 112 2150 ASIA/PACIFIC/JAPAN HEADQUARTERS Spectra Logic Pty Ltd D-LS 110, Quad D 10-14 Market Lane Rouse Hill NSW 2155 Main: +61 2 8006 4532

LEGAL INFORMATION Copyright © 2016 Spectra Logic Corporation. All rights reserved. This item and the information contained herein are the property of Spectra Logic Corporation. All trademarks and registered trademarks are properties of their respective owners. Notices Except as expressly stated herein, Spectra Logic Corporation makes its products and associated documentation on an “AS IS” BASIS, WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE, BOTH OF WHICH ARE EXPRESSLY DISCLAIMED. In no event shall Spectra Logic be liable for any loss of profits, loss of business, loss of use or data, interruption of business, or for indirect, special, incidental or consequential damages of any kind, even if Spectra Logic has been advised of the possibility of such damages arising from any defect or error. Information furnished in this manual is believed to be accurate and reliable. However, no responsibility is assumed by Spectra Logic for its use. Due to continuing research and development, Spectra Logic may revise this publication from time to time without notice, and reserves the right to change any product specification at any time without notice.

303-449-6400 • 800-833-1132 • (Fax) 303-939-8844 • 6285 Lookout Road • Boulder, CO 80301 USA • spectralogic.com 6102016V5

Deep Storage Experts Spectra Logic develops deep storage solutions that solve the problem of long-term storage for business and technology professionals dealing with exponential data growth.

Dedicated solely to storage innovation for nearly 40 years, Spectra Logic’s uncompromising product and customer focus is proven by the largest information users in multiple vertical markets globally.

Spectra enables affordable, multi-decade data storage and access by creating new methods of managing information in all forms of deep storage—including archive, backup, cold storage, cloud and private cloud.

For more information, please visit http://www.spectralogic.com.

http://www.spectralogic.com/

Documents

Reference Design Architecture for Milestone … · 2016-11-24 · 3 Reference Design Architecture for Milestone XProtect® and Spectra Logic Verde DPE Verde DPE Recommended Configurations