Sample Lucene Big Data Diagram Generic

Storage Network West Storage Network East

Public Network

Trusted Outward Security Zone

Internet

Satellite Networks

MPLS Network

Related Infrastructures Related Infrastructures

Digital Asset Managment High Level Architecture

Revised 08/14/2013 KAI

Internal Network West Internal Network East

Cisco UCS Environment Cisco UCS Environment

NetApp FAS3240 NetApp FAS3240NetApp V3170 NetApp V3170

Citrix Farm Citrix Farm

EMC VNX5700

MS-SQL/Lucene Server(1)PhotoDeskWindows 2008 Bare MetalCisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM

VMWare Environment (1)Cisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM

App Fabric

Media FactoryD-Q-S-P

SATA (Partial)SAS Attached7.2K RPM 2 TB48 TB Raw per Shelf

MS-SQL

VMWare Assets

Image Listing Service Only

MS-SQL Replication

SnapMirror Replication

SCC Replication

Fiber Channel (Partial)Fiber Channel Attached15K RPM 450 GB6.3 TB Raw per Shelf

Tiered (Partial)SAS AttachedFlash15K RPM 600 GB 7.2K RPM 3 TB3-45 TB Raw per ShelfAssets

SATA (Partial)SAS Attached7.2K RPM 2 TB48 TB Raw per Shelf Assets

MS-SQL

VMWare


Citrix Environment (1)Dell 2950X5160 2x2core 3.0Ghz, 8GB RAM

Web Server

D-Q-S-P

SCC DBD-Q-S-P

LuceneD-Q-S-P

CitrixD-Q-S-P

MS-SQL/Lucene Server(1)PhotoDeskWindows 2008 Bare MetalCisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM


App Fabric

Media Factory

S-P


Web Server

S-P

SCC DBS-P

LuceneS-P

CitrixS-P


Public Network


Internet

Satellite Networks

MPLS Network








EMC VNX5700

Image Listing Service and Primary Archive


MS-SQL/Lucene Cluster(2)PhotoDeskWindows 2008 Bare MetalCisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM


App Fabric

WebServer

Outakes

Media Factory


MS-SQL

VMWare Assets

MS-SQL Replication


SCC Replication




MS-SQL

VMWare



Web Server

SCC DB

Lucene

Media Factory Outakes

Middleware

SCC DBLucene Outakes

Citrix

MS-SQL/Lucene Cluster(2)PhotoDeskWindows 2008 Bare MetalCisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM


App Fabric

Media Factory


Web Server

SCC DB

Lucene

MiddlewareCitrix

MS-SQL/Lucene Server(1)OutakesWindows 2008 Bare MetalCisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM

Media Factory

Web Server

Media Factory

Web Server

The addition of the West Coast Photo Desk would add HA (2 blades in each location) and add 2 additional virtualized application blades in each location (for a total addition of 4) to sufficiently handle the user load and provide local redundancy. The 12 core MS-SQL server should be sufficient in scale to accommodate the additional load. This section also supplements the storage infrastructure for the West Coast data.


Public Network


Internet

Satellite Networks

MPLS Network








EMC VNX5700

Pre-Production Environment



WebServer

OutakesS

Media Factory


MS-SQL

VMWare Assets

MS-SQL Replication


SCC Replication




MS-SQL

VMWare



Web Server

SCC DBLucene

D-S


S


S

CitrixD-S

VMWare Environment (4)Cisco UCS B200-M2X5650 2x6core 2.66Ghz, 96GB RAM Media

Factory


Web Server

SCC DBLucene

Q-S

CitrixQ-S

Media Factory

D-S

Web Server

D-S

Media Factory

Q-S

Web Server

Q-S

Dev, Staging and QA represent the Pre-Prod environment. Dev is configured within the DAM VMWare Environment for West Coast, QA within the DAM VMWare of East Coast. Staging is configured within both West and East Coast environments to facilitate the testing of Disaster recovery scenarios.

Staging (A) - Dev

Staging (B) - QAStaging Outakes


Public Network


Internet

Satellite Networks

MPLS Network








EMC VNX5700SnapMirror Replication

MS-SQL/Lucene Cluster(2)PhotoDeskWindows 2008 Bare MetalCisco UCS B440X7560 2x8core 2.26Ghz, 128GB RAM


App Fabric

WebServer

Outakes

Media Factory

SATA (Multi)SAS Attached7.2K RPM 2 TB48 TB Raw per Shelf

MS-SQL

VMWare Assets


Fiber ChannelFiber Channel Attached15K RPM 450 GB6.3 TB Raw per Shelf

Tiered (Multi)SAS AttachedFlash15K RPM 600 GB 7.2K RPM 3 TB3-45 TB Raw per ShelfAssets

SATA (Multi)SAS Attached7.2K RPM 2 TB48 TB Raw per Shelf Assets

MS-SQL

VMWare



Web Server

SCC DB

Lucene


Middleware


Citrix



App Fabric

Media Factory


Web Server

SCC DB

Lucene

MiddlewareCitrix


Media Factory

Web Server

Media Factory

Web Server

Full Enterprise Solution (Optimistic)


Media Factory

Web Server

Media Factory

Web Server

This configuration option expands the storage, virtual environment and database capacity to address an enterprise deployment while preserving a scalability to larger configurations. This configuration may represent a transitional platform and not an overall Content solution as it probably does not provide sufficient database fabric for all properties. In this configuration the previously deployed database servers would be replaced with Cisco B440 Blades and the former equipment used to supplement the virtualized application server processing pool.

MS-SQL Replication

SCC Replication


Public Network


Internet

Satellite Networks

MPLS Network











App Fabric

WebServer

Outakes

Media Factory


MS-SQL

VMWare Assets





MS-SQL

VMWare



Web Server

SCC DB

Lucene


Middleware


Citrix



App Fabric

Media Factory


Web Server

SCC DB

Lucene

MiddlewareCitrix


Media Factory

Web Server

Media Factory

Web Server

Full Enterprise Solution (Median)


Media Factory

Web Server

Media Factory

Web Server

MS-SQL Replication

SCC Replication

Based on conversations with the vendor it is likely that the "Optimistic" configuration may fall short of performance requirements. This configuration addresses the most likely shortfalls, those being database capacity and I/O performance. This configuration doubles the number of cores and memory dedicated to the operation of the database and dedicates a storage controller and Fiber Channel disk array to increase I/O capability. It is presented as a supplimental addendum to the "Optimistic" configuration. This configuration, as is true of the former, is intended to provide performance upgrade in place options should, during deployment, the results fall short of expectations.


Public Network


Internet

Satellite Networks

MPLS Network











App Fabric

WebServer

Outakes

Media Factory


MS-SQL

VMWare Assets





MS-SQL

VMWare



Web Server

SCC DB

Lucene


Middleware


Citrix



App Fabric

Media Factory


Web Server

SCC DB

Lucene

MiddlewareCitrix


Media Factory

Web Server

Media Factory

Web Server

Full Enterprise Solution (Pessimistic)


Media Factory

Web Server

Media Factory

Web Server

MS-SQL Replication

SCC Replication

Should the "Median" configuration fall short of performance expectations it will likely be from a limitation of I/O performance of the disk subsystem. This configuration addresses that scenario as an addendum to that configuration. These three views (Optimistic, Median and Pessimistic) represent a pathway to the final configuration walked all or in part and are architected to provide a quick deployment, expandable in place, roadmap while addressing the preferred seamless deployment strategy for the product across the entire enterprise. This configuration also adds 2 additional servers and associated operational licenses to expand the virtualized environment in each location.


Public Network


Internet

Satellite Networks

MPLS Network








EMC VNX5700

ContentWindows -

MacOS

ContentWindows -

MacOS

Content

Nexus Switch Fabric Nexus Switch Fabric

Related ApplicationsRelated Applications

NetBackup Appliance NetBackup Appliance

Active Directory LDAPIntel - Windows

PDF ArchiveIntel - CentOS

Content DistributionIntel - Linux

Content CloudIntel - Windows

Active Directory LDAPIntel - Windows

Content DistributionIntel - Linux

Content CloudIntel - Windows

PDF ArchiveIntel - Linux

Infrastructure Interconnects

FANSTATUS

1

2

3

4

5

6

7

8

9

Power Supply 1 Power Supply 2

Catalyst 6500 SERIES

RUNIN

STAL

L

RUNIN

STAL

L

WS- X6 724 -SFP24 PO RT G IGABI T ETHERNET SFP

STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8

Legacy Switch Fabric

FANSTATUS

1

2

3

4

5

6

7

8

9

Power Supply 1 Power Supply 2

Catalyst 6500 SERIES

RUNIN

STAL

L

RUNIN

STAL

L


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8


STATUS

1 2 3 4 21 2 2 23 241 7 18 1 9 2 013 1 4 15 169 10 11 125 6 7 8

Legacy Switch Fabric

Documents

Sample Lucene Big Data Diagram Generic