Upload
dotu
View
222
Download
0
Embed Size (px)
Citation preview
�© Copyright IBM Corporation 2018.
Accelerate with IBM Storage:
IBM Spectrum NAS Overview
Apr 12, 2018
Ash Mate
Norman Bogard
Chris Vollmar
John Sing
�Washington Systems Center - Storage
�© Copyright IBM Corporation 2018 Accelerate with IBM Storage.
Accelerate with IBM Storage Webinars
The Free IBM Storage Technical Webinar Series Continues in 2018...
Washington Systems Center – Storage experts cover a variety of technical topics.
Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMersare also welcome.
To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business
Partners and IBMers are welcome to send an email request to [email protected].
Located in the Accelerate with IBM Storage Blog: https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en
Also, check out the WSC YouTube Channel here:
2018 Webinars:January 9 – DS8880 Easy TierJanuary 17 – Start 2018 Fast! What's New for Spectrum Scale V5 and ESSFebruary 8 - VersaStack - Solutions For Fast DeploymentsFebruary 16 - TS7700 R4.1 Phase 2 GUI with Live DemoFebruary 22 - DS8880 Transparent Cloud Tiering Live DemoMarch 7 - Spectrum Storage Management, Control, Insights, Foundation; what’s the difference?March 15 - IBM FlashSystem A9000/R and SVC Configuration Best PracticesMarch 27 - IBM FlashSystem A9000/R Technical UpdateApril 12 - Introducing Spectrum NAS - The Newest Member in the Spectrum Storage FamilyApril 26 - TS7700 Grid Configuration Changes -- Joins, Merges and Removals
Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e19126fb94d657fcf347b5a70c7e08ce2May 8 - DS8880 Technical Update
Register Here: https://ibm2.webex.com/ibm2/onstage/g.php?MTID=e5a4a631f2c718b34c9c3ec4e0f508672
https://www.youtube.com/playlist?list=PLSdmGMn4Aud-gKUBCR8K0kscCiF6E6ZYD&disable_polymer=true
Questions about this webinar? Interested in follow-up?
Send email to:
Dennis [email protected]
IBM Washington Systems Center
IBM Storage & SDI
Topic Speaker
Spectrum NAS Product Announcement John Sing
Spectrum NAS Architecture Overview Ash Mate
Spectrum NAS Features & Functions Christopher Vollmar
Spectrum NAS Functions demo Norman Bogard
Additional Resources Ash Mate
Conclusion & Next Steps John Sing
End
Agenda
3
IBM Storage & SDI
IBM Spectrum NAS Product
Announcement
John Sing
IBM Storage & SDI
• NEW! Addition to the Spectrum Software Defined Storage Portfolio
• Designed for modernizing your general purpose NAS workloads toward software defined storage
• Simple, easy to deploy and manage
• Native support of the latest specifications for NFS and SMB
• Software only offering - runs on storage rich commodity servers (x86)
Introducing IBM Spectrum NAS
IBM Storage & SDI
• IBM Spectrum™ NAS is a software-defined storage solution
that offers agility and management simplicity for network-attached storage (NAS) workloads
• It helps reduce capital expenditure by working with industry-
standard x86 servers to form high-performance, scale-out
storage clusters
• It includes:� Protocol support (NFS, SMB)
� Scale-out file system
� Embedded operating system
� Intuitive Management GUI
• Spectrum NAS GA: March 20, 2018
IBM Spectrum NAS
6
IBM Storage & SDIDriven by Data: Modernize and Transform
MODERNIZE
Optimize and drive efficiencies, while continuing to deliver high levels of service delivery
SAVE HERE INVEST HERE
TRANSFORM
Deliver and operate new scale out NAS infrastructure to support new Cognitive and agile workloads
Traditional NAS Software Defined NASGeneral Purpose File
IBM Storage & SDI
The NAS segment is 20+ years old, and enterprises depend on standard file protocolsHowever, enterprises are looking to lower the cost of storing file data in order to invest in new workloads
1. Simple to deploy and administer
• Deploy on bare-metal servers or VMs in 30 mins
• Robust and Self balancing
2. Lower cost
• Run on Commodity x86 servers
• Tailor for efficiency, performance, and protection
3. Scale-out file storage that grows with you
• Linear scale of performance and capacity
• Upgrade without downtime
4. Enterprise NAS features you need
• Native NFS and SMB protocols
• Rich NAS functions
Easy to manage software-defined file storage for the enterprise
IBM Spectrum NASScalable software-defined file storage for enterprise IT
IBM Storage & SDIIBM File and Object offerings based on Workloads and Key Requirements
The right offering for the right workloads
IBM
OfferingSpectrum Scale & ESS Spectrum NAS Cloud Object Storage
WorkloadsTraditional
HPC
Big Data
analytics,
Technical
computing,
ML/DL
High
speed
backup &
restore
File serving
for Virtual
Machines
Home
Directories /
General
purpose file
serving
NAS for
Microsoft
Apps
Archive,
Content
Repository &
distribution
Native Object
Applications
Key
req’ments
High Performance;
supports billions of files
Simple and Native File Protocols
(no open source code)
Multi-site and Native Object
Storage
IBM Storage & SDIEasy to Use and Manage
Management Tool Management Tool Management Tool
Unconfigured servers + Spectrum NAS software
Name the servers
Connect to a network
Run server wizards Run cluster wizard
Setup is complete
IBM Storage & SDI
Architecture Overview
Ash Mate
IBM Storage & SDISpectrum NAS IS/IS NOT
Spectrum NAS
IS... IS NOT…
NAS (NFS & SMB File Protocols) Unified File, Object, Block
SW only Appliance
Scale-out A pair of HA controllers
Based on storage rich servers Based on external storage
SDS-NAS Traditional NAS
On-Premise Cloud
Native NFS/SMB Open Source (Samba/Ganesha)
Symmetric architecture Asymmetric architecture
IBM Storage & SDI
Spectrum NAS Traditional NAS
Software Defined – Commodity Hardware Customized Hardware Appliance
Software-defined storage cost effectiveness Traditional cost levels
Rolling, in-service upgrades Fork-lift upgrades
Flexible, agile, on-demand scale out Rigid, controller-based, hardware specific
models
Easier to deploy, configure, manage,
upgrade, and scale
Traditional methods for configure, manage &
upgrade
Scale out in discreet increments Add a whole array at a time, to expand
Low cost commodity enterprise servers,
exploit fast moving technology upgrades
Hardware vendor lock-in
Spectrum NAS vs. Traditional NAS
13
IBM Storage & SDI
Synchronous & Asynchronous Replication for DR
Robust File System Feature set
IBM Storage & SDI
• Significant compatibility with primary file protocol specifications
• Support for NFSv3, NFSv4.0, NFSv4.1 and pNFS
• SMB is critical for Microsoft application environments
• Many software defined NAS and file gateways use Samba for SMB
• Open source SMB is lacking full
coverage of SMB standard (46%)
Strong Support for Standard SMB and NFS
IBM Storage & SDI
Each node is an industry standard storage rich server with CPU, RAM, NIC, HDD/SSD, NVMe SSD Cache and SAS HBA
Node 1 Node 2 Node 3 Node 4 5 . . n
Linear Scale-Out
Tig
htl
y I
nte
gra
ted
sin
gle
so
ftw
are
sta
ck
10, 40 or 100GbE private network
True Scale-Out� Symmetric Architecture: Every node has
identical role
� No hot spots or bottlenecks
� Files served from cache on any node
� No JBODs or any external storage
� Min 4 nodes to form cluster
� Data store runs erasure coding &
responsible for load balancing
� Self healing cluster survives node failures
� Scalable to 100’s of nodes
Scale Out NFS and SMB
Scale Out Data Store
Scale Out File System
Scale Out Non-Volatile Cache
Spectrum NAS is architected from ground up for cloud-scale
IBM Storage & SDINative protocols, easy to use, self-healing and linear scaling
IBM Storage & SDIDeployment Model
18
• 4 servers to start; simply add node(s) to scale capacity
and performance
4 nodes for protection against 2 drive failures,
5 nodes for protection against 2 complete node failures
• Add new tier with new hardware up to 5 tiers
Start each tier with 4 nodes
• Every node has identical role; no bottleneck or hotspots
• Self healing cluster survives node or drive failures
• Non-disruptive upgrades & capacity expansion
IBM Storage & SDIProviding the Full Software Stack
NO
3PPSOFTWARE
NO
OPENSOURCE
IBM Storage & SDI
All protocols implemented in C/C++
Protocols tightly integrated with the virtual
file system layer
Own implementation of RPC server for
higher efficiency
High focus on minimizing memory
allocations
Protocols
IBM Storage & SDIScale-out Storage
IBM Storage & SDI
• Support for cache mirroring
• Cache partners are selected at file level
• Supports write cache for a file on single
server
• Supports read cache for a file on
multiple servers
• Destage after a configurable time
Spectrum NAS Write Operation – Cache Sync
22
IBM Storage & SDI
File encoding: 2+1 Extent (object) size: 1 GB
File 1Size2 GB
Obj1ASize1 GB
Obj1BSize1 GB
Slice 1A1
Size500 MB
Slice 1B1
Size500 MB
Slice 1A2
Size500 MB
Slice 1B2
Size500 MB
Slice 1A3
Size500 MB
Slice 1B3
Size500 MB
Slice x
128 KB + chk sum
128 KB + chk sum
128 KB + chk sum
128 KB + chk sum
128 KB + chk sum
File Encoding
IBM Storage & SDI
No 1-to-1 mapping of
nodes
Data placed based on:
• Free space in node
• Geographical position
• Current work load
• Tier policies
• Random
How is data distributed within cluster
IBM Storage & SDIVirtual IP
IBM Storage & SDI
Configuration 1: 8 nodes
2x Intel(R) Xeon(R) 6 core CPU E5645 @ 2.40GHz, 96 GB
RAM (6x16GB DIMMs)
1x800 GB SATA SSD for cache
10x1TB SAS/SATA HDD for data
1x 10Gb port for mgmt , 1x 10Gb port for private , 1x 10Gb port for public
Configuration 2: 5 nodes
2x Intel(R) Xeon(R) 6 core CPU E5645 @ 2.40GHz, 96 GB RAM (6x16GB DIMMs)
1x800 GB SATA SSD for cache
10x1TB SAS/SATA HDD for data
1x 10Gb port for mgmt , 1x 10Gb port for private , 1x 1Gb port for public
What does IBM recommend?Tested Configurations
Configuration 3: 8 nodes
2x Intel(R) Xeon(R) 6 core CPU E5645 @
2.40GHz, 96 GB RAM (6x16GB DIMMs)
1x800 GB SATA SSD for cache
10x2TB SAS/SATA HDD for data
1x 10Gb port for mgmt , 1x 10Gb port for private , 1x 10Gb port for public
Configuration 4: 8 nodes
2x Intel(R) Xeon(R) 4 core CPU E5620 @ 2.40GHz, 64 GB RAM (8x8GB DIMMs)
1x800 GB SATA SSD for cache
10x2TB SAS/SATA HDD for data
1x 10Gb port for mgmt , 1x 10Gb port for private , 1x 1Gb port for public
NVMe
NVMe
NVMe
NVMe
IBM Storage & SDI
Capacity OptimizedCapacity OptimizedCapacity OptimizedCapacity Optimized Performance Performance Performance Performance
OptimizedOptimizedOptimizedOptimized
All FlashAll FlashAll FlashAll Flash
CPU 1x Intel Xeon E5-2620v4
8cores
2x Intel Xeon E5-2620v4
8cores
2x Intel Xeon E5-2620v4 8cores
RAM 64GB RAM DDR4; 128GB RAM DDR4; 128GB RAM DDR4;
Storage 12x3.5” (6TB or 10TB) 24x2.5” SAS 10K 24 x Intel 1200GB SATA SSD
Cache(R/W) 1xIntel® P3700/P4800
400GB NVMe
2x Intel P3700/P4800
400GB NVMe
3 x Intel® P4800X 375GB NVMe
HBA Broadcom SAS 3008 IT-mode (HBA)
NIC Intel® X520 2x10GbE NIC SFP+ Intel® X520 2x10GbE NIC SFP+ 2 x Mellanox ConnectX-4 25/100GbE
All Configurations require 2 switches: 1 for client connections, 1 for intra-cluster communication
Spectrum NAS can run on any x86 storage rich server but the Items in purple must be the same family model/vendor as listed above
(See following page)
Recommended Node Configurations
IBM Storage & SDI
NVMe
1. Prefer two smaller cards over one big card
2. “Enterprise" grade NMVe (not "desktop" grade)
3. Endurance (DWPD) - 5 or above (close to 10 preferred)
(Good experience w/ Intel Optane)
HBA
1. As long as it is based on LSI based
2. All disk drives are classified as 6 Gb or better
NIC
1. Any Mellanox card is fine
2. 10 Gb or better
3. Support IGMP multicast
(There have been reported performance issues with Intel 710 Gigabit Ethernet cards)
Hardware Compatibility for Spectrum NAS
28
IBM Storage & SDI
IBM Spectrum NAS Features
Christopher Vollmar
IBM Storage & SDIManagement Tools
30
• GUI• Out of band
• Windows installable
• Services available• Real-time performance
• Configuration
• Health
• Logging
• Alerts
• REST API• Supports administration of file shares,
users, groups, ACLs, policies and manual snapshots
• Any node in the cluster is capable of responding to API requests
IBM Storage & SDIFile Share Properties
Properties
• NFS
• SMB
• Capacity
• Encryption Status
• Ability to update Properties ‘on the fly’
IBM Storage & SDI
Core Folder Characteristics are retained under ‘Properties’
• SnapShots
• Folder Coding
• Capacity
• Number of Files
• Tier
Folder Properties
IBM Storage & SDI
• File policy is an optional feature to automatically apply actions to selected files in a folder
• Policy filters include• File type, age
• Policies apply to: • Erasure encoding level, media tier, data encryption, retention and
WORM
• New files created will inherit established policies
• Previously created files will have policies applied by a background, low priority task
File Policies
IBM Storage & SDI
Data Durability in ‘2 Dimensions’• Leverage File Coding to create policies in the same
folder and apply at the
• File Folder level
• File Policy Level
• Create a file share with a File Coding based on initial Data Durability requirements – eg 3 Copies
• Add a policy based on ‘Data Durability’ of file types placed in the file share
File Policies and Erasure Coding
IBM Storage & SDI
Ability to have different performance tiers in same cluster
• Nodes with similar media capabilities are grouped into the same tier
• Five tiers available
File policies are defined for files at the Folder level
• Tiers based on attributes filename and age
Tiering
IBM Storage & SDI
Ability to create snapshots at the file level, within a folder
• Automatically scheduled snapshots• Can be configured so that one is made hourly, daily, weekly or manually
• Up to 253 snapshots for each folder
• Target snapshots are copies that have read-only access
• Leverage copy-on-write capability
• After a file share has been configured, it can be accessed from Windows or Linux using SMB and NFS
Snapshots
IBM Storage & SDI
Capacity limit that restricts the use of storage
• Space set at the file system, folder or sub-folder
• Limit is specified in number of GB, TB or PB and will then
apply for all users with access to the folder
Quota Management
IBM Storage & SDI
Data at rest encryption• AES 256 bit XTS
• File system, folder, file level
• One key for each file system
• Internal key management
Encryption
IBM Storage & SDI
Retention period can be set • To retain files for a specific time period
based on either;
• Accessed time frame
• Modified time frame
• Can be used to remove file types or patterns to enable file screening
eg – Remove file types 1 day after being
saved
Retention
IBM Storage & SDI
Files can be set read-only
• Users cannot edit or delete WORM protected files
• Administrator can delete WORM protected data
Spectrum NAS – WORM
IBM Storage & SDI
Metro Cluster (Synchronous Replication ) High-availability cluster for mission-critical data and applications
Writes written synchronously to two clusters
Established while Adding Nodes to ClusterBoth sides should be same size
Promoting a site to primary can be done from the GUI.
Replication – Metro Cluster
IBM Storage & SDI
Hybrid Cloud (Asynchronous Replication)
• Snapshot based
• Continually replicate differential snapshots
Provides a unified view of the file system between the
local network and the second cluster
• Permits a common view of the file system that spans both clusters
Replication – Hybrid Cloud
IBM Cloud available as a target site
Leverage IBM Cloud Bare Metal servers** as an alternate to customer premise or MSP
IBM Storage & SDI
• Allows multiple, separate domains and file systems spanning over one single storage cluster
• Each domain and file system are separated, using their own IP addresses for access, authentication mechanisms and set of protocols
• Provides CPU, infrastructure and storage capacity to be utilized for all the domains combined
Spectrum NAS - Multitenancy
IBM Storage & SDI
IBM Spectrum NAS Demonstration
Norman Bogard
IBM Storage & SDI
1. Simplicity of deployment and administration� Node installation (https://www.youtube.com/watch?v=K0DVB0JTEQ8)
� File System Creation & NFS, SMB shares
(https://www.youtube.com/watch?v=Xl1y-zwtWS4&t=86s)
2. Enterprise NAS Features � File Policies – Quota, Snapshots, Erasure Coding, Tiering
3. Scale out file storage that grows with you � Node addition
� Rolling Upgrades
Spectrum NAS Demonstration
45
IBM Storage & SDI
GUI
Out of band
Windows installable
Services availableReal-time performance
Configuration
Health
Logging
Alerts
REST APISupports administration of file shares, users, groups, ACLs, policies and manual snapshots
Any node in the cluster is capable of responding to API requests
Spectrum NAS – Features through the GUI
IBM Storage & SDI
Install Spectrum NAS software on Linux node
Install NAS management on Windows machine, import license
Discover un-configured nodes over management network
Configure nodes into a cluster using NAS management software
Spectrum NAS – Node Installation
47
IBM Storage & SDI
Wizard for file system creation
Configure hostname & public IP
Configure SMB & NFS protocols
Spectrum NAS – File System Creation
48
IBM Storage & SDI
Select un-configured nodes to add into a cluster
Wizard will walk user through the configuration for node addition
Spectrum NAS – Node Addition
49
IBM Storage & SDI
Spectrum NAS supports rolling upgrades of software on the nodes in the cluster without downtime
The update is performed in sequence, one node at a time to maintain resiliency level
Spectrum NAS – Rolling Upgrades
50
IBM Storage & SDI
File and Object Solutions
Design Studio Tool
Ash Mate
IBM Storage & SDIFile and Object Solutions Design Studio� Interactive tool for you and your IBM and Business Partner for sizing
� Unified questions to help determine what IBM solution fits best
� One common tool for IBM Spectrum NAS, Spectrum Scale/Elastic Storage Server, and
IBM Cloud Object Storage
� IBM Design Thinking approach to working with you, our clients
� Available now for IBMers, available end of April with IBM Business Partners
� Link: https://ibm.biz/FOSDesignStudio
IBM Storage & SDIFOS Design Studio Workflow
53
IBM Storage & SDI
Dashboard: Answer a few questions, responses used by the tool to automatically select product and solution template
Template: View all details pre-populated, answer more questions about
requirements, contacts, sites. Select options in order to complete template
Design: Solution design is shown based on the inputs, including cautions and items need to be addressed
Report: Generate a report summarizing requirements, solution design, any considerations, warnings or errors
FOS Design Studio Workflow
54
IBM Storage & SDI
• Spectrum NAS Demo videos on YouTube:• https://www.youtube.com/playlist?list=PLS7mekU2kxDpHZFHWXDEcrzD6RuubzhdO
• Data sheet: • https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?htmlfid=51012651USEN&
• Product Documentation:• https://www.ibm.com/support/knowledgecenter/en/SSKLNK_1.7.0/spectrumnas170_welco
me.html
• Analyst white paper: • https://www-01.ibm.com/common/ssi/cgi-bin/ssialias?htmlfid=69013169USEN
Additional Resources
IBM Storage & SDI
Conclusion: Next Steps
John Sing
IBM Storage & SDI
• Get more information on Spectrum NAS• IBM Spectrum NAS YouTube:
� https://www.youtube.com/watch?v=oA55y2Mv7c0&list=PLS7mekU2kxDpHZFHWXDEcrzD6RuubzhdO
• IBM Spectrum NAS Knowledge Center: � https://www.ibm.com/support/knowledgecenter/en/SSKLNK_1.7.0/spectrumnas170_welcome.html
• Contact your IBM Account Exec / Business Partner for more information and to arrange a demonstration
• IBM Client Demo Center: http://ibm.biz/ClientDemoCenter
• Sign up for a free 60-day Spectrum NAS software trial• https://www.ibm.com/us-en/marketplace/spectrum-nas
• Sign up for future IBM Washington Systems Center webinars:• Accelerate with IBM Storage blog on IBM Developerworks:
https://www.ibm.com/developerworks/mydeveloperworks/blogs/accelerate/?lang=en
Next Steps
57
Questions about this webinar? Interested in follow-up?
Send email to:
Dennis [email protected]
IBM Washington Systems Center
Special Thanks
Christopher Maestas, Global Solution Architect, Software Defined and Flash Solutions
Ash Mate, Sr. Solutions Architect, Spectrum Storage
Norman Bogard, Sr. IT Specialist, Spectrum Storage
Christopher Vollmar, Storage Client Technical Architect - IBM Certified Consulting
Franck Malterre, Certified Specialist, Software Defined Infrastructure
Dennis Robertson, Accelerate with IBM Storage Lead
ibm.com/storage
Thank You.
IBM Storage & SDI