1© Copyright 2013 EMC Corporation. All rights reserved.
EMC Storage Resource Management Suite
Technical Review
Tim Piqueur
2© Copyright 2013 EMC Corporation. All rights reserved.
The Challenge� Over the next decade…
– Data managed by enterprise datacenters will grow 50x
– Number of files will grow by 75x
– Number of IT professionals will grow < 1.5x
� Optimizing storage resources is essential to controlling IT costs
� Investments in Storage Resource Management help reduce these costs
Rapid data growth leads to rising storage costs while $/GB declines
Source: IDC Digital Universe Study, June 2011
3© Copyright 2013 EMC Corporation. All rights reserved.
What’s the impact on YOUR business?
The Impact of Application Downtime
4© Copyright 2013 EMC Corporation. All rights reserved.
What if you could…
Understand ALL storage relationships, dependencies and application impact?
Assure storage-related Service Levels and Chargeback?
Optimize storage investments to control costs and improve productivity?
5© Copyright 2013 EMC Corporation. All rights reserved.
Storage Resource Management Suite
EMC Storage Resource Management Suite
Configuration & ComplianceConfiguration & Compliance
PerformancePerformance CapacityCapacityRelationship Mapping
Relationship Mapping
EMC Storage
HostsBrocade & Cisco
Switches3rd Party Storage
PlanningScorecards
Role-based ReportingTroubleshooting
SLASituations to WatchResource / Usage
Virtual Machines
AlertingAlerting
Applications
TopologyTopology
Represents capabilities of the entire Storage Resource Management suite.
6© Copyright 2013 EMC Corporation. All rights reserved.
What’s Included in the SRM Suite?
� EMC ProSphere – Displays data path relationships and dependencies and analyzes performance and capacity to optimize storage resources.
� EMC Storage Configuration Advisor – Tracks configuration changes and validates compliance with design best practices and the EMC Support Matrix to eliminate configuration errors that impact service levels
� EMC Watch4net for Storage – Monitors application health and performance and provides dashboards to monitor the application to storage service levels across heterogeneous storage environments
7© Copyright 2013 EMC Corporation. All rights reserved.
Storage Resource Management Suite
• EMC & Third-Party Storage
– Symmetrix
– VNX Block & File
– Isilon
– VPLEX
– NetApp Filers
– IBM SVC & DS
– Hewlett Packard
• Data Path
– VMware
– HP-UX
– IBM AIX
– Linux SUSE & RHEL
– Microsoft Windows
– Sun Solaris
� SAN Switches
– Cisco
– Brocade
– McDATA
� Applications
– Oracle
– Microsoft SQL Server*
– MySQL*
– IBM DB2*
(*) Additional licenses required for application support
Supported Environments
Support specific details
8© Copyright 2013 EMC Corporation. All rights reserved.
Solution Enabler (SE) 7.4
SMIS 4.4
NaviSecCLI 7.3
SRM 1.1 Suite ArchitecturevApp
ProSphere 1.7
SuSE 11 ES
Virtual Machine
SCA 3.0
rPath 4
Application
W4N 6.1
Windows � SuSE 11ES
MySQLSybase 10Greenplum 4
Collection | Aggregation | Enrichment
W4N utilizes object polling mechanism marked with (*) for Symmetrix, VNX Block, SAN and Windows Hosts
Data Storage
SE* � SMISNaviSecCLI*
� SMIS
SSH �
XMLAPISNMP SMIS
SNMP* �
SMIS
SSH � SSH
Sudo �
SNMP
PowerShell* �
WinRM* � SNMP*
WMI � WS-Man
VISDK JDBC …
Symmetrix VNX Block VNX File NetApp FilerIBM DS
IBM SVC
SAN
(Cisco,
Brocade)
Unix Hosts Windows Hosts VMware Oracle
Other
Optional
Apps
Install on W4N Host
9© Copyright 2013 EMC Corporation. All rights reserved.
System Requirements� Total resource for SRM Suite – full scale
– 32 Virtual CPU (vCPU)
– 108 GB of memory (vMemory)
– 1.3 TB starting to 2.5 TB storage for data retention of 1 year
ComponentsvApp
Storage Manager
vAppDiscovery Engine
vAppHistorical DB
CollectorEach
CPU4
3.0 Ghz4
3.0 Ghz4
3.0 Ghz2
3.0 Ghz
Memory 12 GB 8 GB 6 GB 6 GB
Storage 230 GB 30 GB 230 GB 30 GB
ProSphere SCA W4N
Virtual Machine
4 3.0 Ghz
16 GB
50 GB
W4N UI Portal
W4N SuSE/WinHost #2 & more
43.0 Ghz
43.0 Ghz
16 GB 8GB
500 GB 64 GB
10© Copyright 2013 EMC Corporation. All rights reserved.
Scalability
SolutionPhysical Hosts/Host Devices
ESX Servers
VirtualMachine
EMC Arrays/# of LUNs
3rd Party Arrays
NetApp Filer
SAN Switches
SAN Ports Databases
ProSphere 1.7With 4 Collectors
2500/161k 125 2500 63/275k n/a n/a 113 8192 n/a
SCA 3.0(Virtual Machine)
800/136k 800 40/68k n/a # of 8192 SAN Ports n/a
W4Net 6.1(2-3 W4n Hosts)
2500 hosts 125 2500 63 arrays 30 30 113 8192 400
11© Copyright 2013 EMC Corporation. All rights reserved.
Watch4Net Logical Architecture
Collector
• Periodically starts collection
• Connects to remote systems to collect
• Filter/enrich data
• Formats data for backend
Backend
Collector3rd
Party Array
Infrastructure
Backend
• Processes data from collection
• Computes aggregates
• Database maintainer
Web Portal
• User login
• Admin management
• Generate and browse reports
Database
• Storage for Data
• Storage for metric properties
Retrieve
Send
Polled
12© Copyright 2013 EMC Corporation. All rights reserved.
Pick your client language and destination platform/application of choice, for example…
ProSphere Open ArchitectureOpen via REST
• HTTP-based, Stateless and Information transferred in XML
• Fully documented and supported
• Exposes all information visible through UI
• Based on EMC standards
• Hides details and differences in internal ProSphere persistence
• Can be used for a truly headless solution
Historical DatabaseHistorical DatabasePro ApplicationPro Application Discovery EngineDiscovery Engine
RDFRS RS RS
REST Services
HTTP:// POST, PUT, DELETE(future)
GET
13© Copyright 2013 EMC Corporation. All rights reserved.
Policy A
Policy BPolicyB
PolicyA
Rules
Rules
Rules
Rules
RulesAccess Profile
Storage Environments Discovery Policies Repository Data & Dependencies Configuration Policies
Administrative web-based interface
Access Profile
Access Profile
Access Profile
Access Profile
Discovery Changes Storage
Storage Configuration Advisor Architecture
14© Copyright 2013 EMC Corporation. All rights reserved.
Relationships, Dependencies & Impact
• Dynamic reporting of ALL resources and performance dependencies
RECEIVE REAL-TIME UPDATES
• Trending and threshold notifications correlated with storage metrics
ANALYZE APPLICATION PERFORMANCE
• Visualize all physical and virtual relationships from application to host and from host through storage
UNDERSTAND INTERDEPENDENCIES
15© Copyright 2013 EMC Corporation. All rights reserved.
Application – Storage Interdependencies
• Understand relationships and topology end-to-end across all layers
– Storage & Fabric
– Virtual Machine & Datastore
– App & Database
• Analyze infrastructure with a view into:
– Performance
– Availability
– Configuration
END-TO-END ANALYSIS
16© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Application Storage Related Issues
• Overview of Oracle application and infrastructure uptime
– Drill into application for details and status
• Additional application report packs available:
– Microsoft SQL Server
– MySQL
– IBM DB2
– Websphere
17© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Application Storage Related Issues
• Examine application hosts– Datastore Usage
– Disk Rate
– CPU Usage
– Memory
• Identify application host to investigate further
– Data path
– Configuration policy
– Virtual to Physical host
18© Copyright 2013 EMC Corporation. All rights reserved.
View End-to-End Topology for EMC Storage
19© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Data Path & Configuration Policies
View host to storage topology details for EMC
storage
Enable analysis of host performance issues
Investigate configuration policies to determine
compliance
20© Copyright 2013 EMC Corporation. All rights reserved.
vCenter Servers Arrays
EMC Professional Services Can Assist to Design Your Custom Reports
Unified SLA Reports From Heterogeneous Sources
One pane of glassOne pane of glass
Host Unification (Physical Windows/Unix, Virtual)Host Unification (Physical Windows/Unix, Virtual)
Allocated StorageAllocated Storage
Capacity MetricsCapacity Metrics Performance MetricsPerformance Metrics
21© Copyright 2013 EMC Corporation. All rights reserved.
Launch to Element Managers for Remediation
• Launch in context to:– Symmetrix Management
Console (SMC)
– Symmetrix Performance Analyzer (SPA)
– Unisphere for VMAX
– Unisphere (for VNX)
– Brocade Top Talkers
• Real-time investigation unique to the element
– Active commands and detail information
Symmetrix Management Console
Symmetrix Performance Analyzer
Unisphere for VMAX
22© Copyright 2013 EMC Corporation. All rights reserved.
Assure Storage SLAs & Chargeback
• Custom thresholds and dashboards across heterogeneous storage environments
IDENTIFY SLA ISSUES
• Automatically, using the EMC Support Matrix and your own design best practices
VALIDATE CONFIGURATIONS
• See the impact of FAST on performance and chargeback based on policy
OPTIMIZE USE OF FAST VP
23© Copyright 2013 EMC Corporation. All rights reserved.
Performance and SLA Monitoring� Historical, real-time views, trending, and forecasting
� Correlation between performance metrics & events
� Performance analytics, with adaptive alerting
24© Copyright 2013 EMC Corporation. All rights reserved.
Identify SLA Issues
Identify SLAs at risk
Identify SLA issues requiring immediate investigation
25© Copyright 2013 EMC Corporation. All rights reserved.
Validate Storage Configurations
Determine if SLA issue is due to a configuration issue
26© Copyright 2013 EMC Corporation. All rights reserved.
Identify Configuration Compliance Issues
SLA issue is due to a path problem. Defined policy calls for 2 paths.
27© Copyright 2013 EMC Corporation. All rights reserved.
Array #2Array #1
Identify True Cost of Application Storage
Primary volume
Local copy
Remote copySnapshots
Local copy Mapped/masked
to backup server
Copy for testing new version of applicationMapped to Dev server
DR Copy. May or may not be mapped to a DR server
ApplicationCluster
BackupServer
Dev/TestServer
Total Charge Should Include All This Capacity
Primary volume
Local copy
Remote copySnapshots
Local copy
Map storage to Service Levels based on FAST
policy, etc.
Understand storage to host relationships,
including clusters, etc.
Need to handle copies correctly – should be charged to application server, not backup
server
28© Copyright 2013 EMC Corporation. All rights reserved.
Analyze Storage Usage for Chargeback
EMC
NetAppIBM
29© Copyright 2013 EMC Corporation. All rights reserved.
Optimize Resources & Productivity
• Analyze capacity trends with visibility of all replicas
IMPROVE CAPACITY PLANNING
• Analyze application performance with storage workload trends to select best storage tier
IDENTIFY APPROPRIATE TIER OF STORAGE
• Through anywhere, any-device access to comprehensive analysis
ENHANCE PRODUCTIVITY
30© Copyright 2013 EMC Corporation. All rights reserved.
Assure Storage SLAs
Service Level Utilization
Service Levels
Service Level storage details
31© Copyright 2013 EMC Corporation. All rights reserved.
Monitor Federated Tiered Storage
Encapsulated and Externally Provisioned
volumes in use
Unused Externally Provisioned volumes
Federated Tiered Storage capacity per array
32© Copyright 2013 EMC Corporation. All rights reserved.
Improve Capacity Planning
Show capacity used by purpose
Pools are close to running out of space
33© Copyright 2013 EMC Corporation. All rights reserved.
Identify Capacity Issues
Only 6 weeks to “Pool Full”
Identify what type of storage to add
Time to order more 15K drives for Hopkinton
34© Copyright 2013 EMC Corporation. All rights reserved.
Enhance ProductivityAnywhere, Any-Device Access to Comprehensive Analysis
Access reports on the go!