© 2007 XSIGO SYSTEMS CONFIDENTIAL 1
Xsigo Systems
Faster, Simpler, More Cost-Effective Server I/O
David [email protected]
© 2007 XSIGO SYSTEMS CONFIDENTIAL 2
About Xsigo
• Founded 2004 • Offices:
– San Jose, CA (Headquarters)
– Munich, New York, London, Tokyo
• Funding– Kleiner Perkins,
– Greylock Partners,
– Khosla Ventures
– Juniper Networks
• Board members include:– Ray Lane: Former President, Oracle
– Mark Leslie: Co-Founder, VERITAS
– Vinod Khosla: Co-Founder, Sun
– Ashok Krishnamurthi: Founding team at Juniper
© 2007 XSIGO SYSTEMS CONFIDENTIAL 3
Awards and Press
© 2007 XSIGO SYSTEMS CONFIDENTIAL 4
What Are Your Pain Points?
Consolidation Data Center Agility Power, Heat,
and Cooling Disaster Recovery Cabling Virtualization Backup
© 2007 XSIGO SYSTEMS CONFIDENTIAL 5
Evolution of the Data Center
Network
One OS
CPU I/O
MEM DISK
1 Ethernet
NetworkEthernet
SANFCP
Storage
2
One OS
CPU I/O
MEM
FCP
SC
AL
E
3
Network
SAN
Hypervisor
CPU MEM
VM1 VM1 VM1 VM1 Storage
10-40GbEthernet
FCPFC S
CA
LE
SC
AL
E
© 2007 XSIGO SYSTEMS CONFIDENTIAL 6
The Data Center Ecosystem
StorageNetworking
Servers
Applications
Virtual I/O
© 2007 XSIGO SYSTEMS CONFIDENTIAL 7
Xsigo Reduces Complexity
With Xsigo
70% fewer cables, cards.Fewer edge switches.
Without Xsigo
© 2007 XSIGO SYSTEMS CONFIDENTIAL 8
Xsigo at a Glance
Remote management:Central management of configurations across all servers..
Zero downtime:Deploy connectivity to live servers.
Predictable performance:QoS to specific vNICs or virtual machines.
Bandwidth where you need it. 20Gb/s networks for backup, Vmotion, etc.
No rip and replace:Standards based.Works with the gear you have.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 9
Hundreds of servers
Fast & Scalable
• 10Gb/s link to each server– QoS features for
bandwidth allocation
• Scalable to 120 servers
• Up to 150 Gb/s to LAN and SAN– Configurable I/O to
networks
Leaf switches
© 2007 XSIGO SYSTEMS CONFIDENTIAL 10
Open
Virtual resources appear as physical NICs and HBAs to OS
Industry standard x86/x64 servers incl. blade servers
Supports Windows 2003, Linux and VMware ESX today
• Works with…
Server bus requirement:PCI-Express
© 2007 XSIGO SYSTEMS CONFIDENTIAL 11
Problems which Xsigo Addresses
© 2007 XSIGO SYSTEMS CONFIDENTIAL 12
App DBWeb SAN
• Server’s use limited by connectivity• Time consuming to re-purpose– Re-configuration of cards, cables, networks
Challenge : Constrained Datacenter
Cannot respond quickly to changing needs.
Web Tier App Tier DB Tier
© 2007 XSIGO SYSTEMS CONFIDENTIAL 13
Challenge : Agility
• Time– Moves adds and changes
take weeks.
• Expense– Multiple teams involved in
each change.
• Risk– Re-cabling introduces risk of
mechanical failure and human error.
High costs. Response time challenge.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 14
More Agility
100X faster management.
Configure new server
Reassign SAN connection Reassign LAN connection
Weeks
Move I/O.Restart.
Hours
WithoutXsigo
With Xsigo
Time Saved
Bring up app
Accelerates response time:
© 2007 XSIGO SYSTEMS CONFIDENTIAL 15
Why I/O Drives Cost
• Network complexity– Interdependencies abound
• Example:– Application migration– Caused by:
– Server upgrade– Maintenance– Recover under-used asset
Tape
Core SAN
BackupDMZ
Move app from A to B
LAN Backup SANSecurity Server
Teams Needed: 5
© 2007 XSIGO SYSTEMS CONFIDENTIAL 16
How Xsigo Helps
• Move I/O transparently
• BenefitsManagement expense
Deployment time
Power, space, cooling
Tape
Core SAN
BackupDMZ
Move app from A to B
Server
80% less operational expense
No config changesneeded
Server manager works more efficiently
Teams Needed: 15
© 2007 XSIGO SYSTEMS CONFIDENTIAL 17
Connectivity: After
Tape
Test SAN
BackupDMZ
Cables per server: 2
Vmotion Dev
Core Mgmt
• Consolidate I/O. Storage and networking share one cable.
• All servers can be configured with access to any network.
Faster and less costly to deploy VMware across hundreds of servers.
Save space with 1U servers, rather than 4U.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 18
How It Works
• Create virtual connectivity
• Create I/O profile template
• Migrate connectivity
• Retains full identity of I/O
“Web Server”
“Web Server”
© 2007 XSIGO SYSTEMS CONFIDENTIAL 19
How Xsigo Virtualizes I/O
• Xsigo fabric extends I/O bus– Extends I/O bus from servers to
the Xsigo I/O Director
– Apart from that, the network remains the same
• Self-contained– Fabric is fully self-contained
– Management tools built in to the Xsigo system
Routers
LAN SANDirectors
Self contained fabric
© 2007 XSIGO SYSTEMS CONFIDENTIAL 20
Routers & Switches
• Simplifies edge infrastructure– Extends I/O bus to the I/O
Director
– Consolidates edge networking
– Not replacing Ethernet as network fabric
– No change to core switch, VLAN, firewall, or SAN
• Simple, consistent I/O management– Single point of management
for configuration settings
LAN
LAN SAN
SANRouters & Switches
Before
After
EdgeSwitches
Directors
Directors
Xsigo Network Benefits
ComplexConnectivity
SimpleConnectivity
XsigoI/O Director
© 2007 XSIGO SYSTEMS CONFIDENTIAL 21
Lower Cost
Before After
256 VMs4 racks, 4U servers$700K capital cost
256 VMs1 rack, 1U servers$470K capital cost
Saves capital cost 4 ways:
1.70% fewer I/O cards and cables
2.Enables more use of 1U high servers
3.No edge switches
4.More I/O on blades at less cost
33% to 50% capital cost savings.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 22
Xsigo Hardware
© 2007 XSIGO SYSTEMS CONFIDENTIAL 23
VP780 I/O Director
24 Server ports•Expansion switch available for connection to hundreds of servers
15 I/O module slots• 4 X 1Gb Ethernet• 1 x 10Gb Ethernet• 2 x 4Gb Fibre Channel
Hardware-based architecture• Fully non-blocking fabric• 780 Gb/s aggregate bandwidth
4U height
Custom silicon• Line rate throughput
Redundant Hot Swappable Power Supplies
System Control Processor Redundant Hot Swappable Fans
© 2007 XSIGO SYSTEMS CONFIDENTIAL 24
VP780 Options
IS24 Expansion Switch
I/O Modules
4-port GigabitEthernet
10 GigabitEthernet
Dual 4 GigabitFibre Channel
Expansion Switch
10-port GigabitEthernet
© 2007 XSIGO SYSTEMS CONFIDENTIAL 25
Scalability
Xsigo Expansion Switch
AC DC
AC DC
Servers + Expansion Switch
To VP780 I/O Director
AC DC
… … … … …
Scalable to hundreds of servers
© 2007 XSIGO SYSTEMS CONFIDENTIAL 26
Xsigo Topology
LANSAN
Xsigo VP780
Xsigo VP780
Redundancy and scalability
© 2007 XSIGO SYSTEMS CONFIDENTIAL 27
The Xsigo Difference
Before After
© 2007 XSIGO SYSTEMS CONFIDENTIAL 28
Relevance to VMware
© 2007 XSIGO SYSTEMS CONFIDENTIAL 29
Why I/O Matters for Virtualization
• 75% of users have five or more Ethernet ports per server.
• 85% of users have two or more SAN ports per server.
• 58% have had to add connectivity to a server specifically for VMs.
• 65% consider cable reduction a priority.
7 or more I/O ports per server!
Virtualization drives significantly more I/O.
Virtualization drives I/O demand for users:
© 2007 XSIGO SYSTEMS CONFIDENTIAL 30
App1 App2 App3
vsw1 vsw2 vsw3
LAN SAN
20Gb
Consolidate infrastructure, reduce costs.
Xsigo Benefits
Integrated separate network for VMotion
Virtual I/O
Isolate traffic to each VM or any logical grouping. No need for “open zoning.”
Scale I/O as needs change.
Guarantee bandwidth to specific VMs.Ensure application performance.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 31
Predictable Application Performance
• Problem:
– Ensure performance of critical applications.
• Xsigo Solution
– Integrated QoS
1. Provision critical applications with dedicated I/O.
2. Set QoS by virtual machine.
3. QoS remains with VM even through VMotion.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 32
Scalable I/O
Tape
TestSAN
BackupDMZ
VMotionDev
Core
Mgmt
• VMware recommends dedicated I/O for:
‒ VMs running critical applications
‒ VMotion
‒ Management
• Xsigo I/O scales to meet changing requirements
Tape
Test SAN
BackupDMZ
VMotion Dev
Core Mgmt
Add I/O resources whenever needed.
Dedicated I/O resources:• Many cables.•Hours or days to modify.
Same I/O resources:• Two cables.• Change in minutes.
Without Xsigo With Xsigo
© 2007 XSIGO SYSTEMS CONFIDENTIAL 33
Reduced Hardware Expense
ESX NICHost 1
ESX NICHost 2
ESX NICHost 3
ESX NICHost 4
ESX HBAA
ESX HBAB
ESX VMotion
ESX Console
ESX RIL 0
ESX NICHost 1
ESX NICHost 2
ESX NICHost 3
ESX NICHost 4
ESX HBAA
ESX HBAB
ESX VMotion
ESX Console
ESX RIL 0
4U
1U
• Problem:– Large 4U servers required
to accommodate I/O cards.
– More power, space, cost.
• Xsigo Solution– Use virtual NICs and
HBAs.
– Get the connectivity you need in a 1U high server.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 34
Fast & Secure VMotion
LAN
1) VMotion traffic
3) Traffic does not hit LAN
2) Travels over 10Gb link
• Problem
– VMotion traffic contains all data for VMs being moved.
– Security risk of moving unencrypted VMotion data over open network.
– Requires network bandwidth for rapid execution.
• Xsigo Solution
– Use Xsigo high-speed fabric to handle VMotion traffic.
– Traffic does not hit LAN.
– Fast 10 or 20Gb link.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 35
Without Xsigo
LAN
NIC HBA
App1 App2
vswitch
SAN
NIC HBA
vswitch
App3
LAN
App1 App2
vsw3
SAN
App3
vsw2vsw1
vHBAvHBA
vsw
vHBA
With Xsigo
Xsigo enables VM mobility without the security risk of “open zoning.”
Servers both have access to storage.
Security exposure.
Server 1 Server 2 Server 1 Server 2
VM Mobility
Only server running app has access to storage.
© 2007 XSIGO SYSTEMS CONFIDENTIAL 36
Available vNICS
Available vHBAs
Visible within Virtual Center
Xsigo Integration with Virtual Center
© 2007 XSIGO SYSTEMS CONFIDENTIAL 37
Examples from W&W Testing
© 2007 XSIGO SYSTEMS CONFIDENTIAL 38
© 2007 XSIGO SYSTEMS CONFIDENTIAL 39
Tested
• Redundant configuration with 2 ESX server 3.5u1– (2 ports/server , 2 Xsigo chassis, 2 LAN switch, 2 paths to SAN)
• Binding / unbinding of profiles to ESX servers– with several vNICs and vHBAs each– without reboot
• Combination Xsigo vnics with vSwitches– ESX without vmnic0– added VLANs
• ESX multipath with vHBAs• QoS limitations with vNICs and with ACLs• Seamless failover, even during VMotion
– Cable pulls on LAN, SAN and chassis power
© 2007 XSIGO SYSTEMS CONFIDENTIAL 40
© 2007 XSIGO SYSTEMS CONFIDENTIAL 41
© 2007 XSIGO SYSTEMS CONFIDENTIAL 43
© 2007 XSIGO SYSTEMS CONFIDENTIAL 44
© 2007 XSIGO SYSTEMS CONFIDENTIAL 45
© 2007 XSIGO SYSTEMS CONFIDENTIAL 46
© 2007 XSIGO SYSTEMS CONFIDENTIAL 47
© 2007 XSIGO SYSTEMS CONFIDENTIAL 48
© 2007 XSIGO SYSTEMS CONFIDENTIAL 49
© 2007 XSIGO SYSTEMS CONFIDENTIAL 50
© 2007 XSIGO SYSTEMS CONFIDENTIAL 51
Summary
© 2007 XSIGO SYSTEMS CONFIDENTIAL 52
Summary
• Traditional connectivity limits virtualization deployments
• Xsigo addresses this with virtual I/O• Benefits:
– Predictable performance for critical applications– Scalable I/O resources– Agile management of I/O resources – Match I/O to the unique requirements of virtualization
• Well integrated with ESX 3.5
© 2007 XSIGO SYSTEMS CONFIDENTIAL 53
• Xsigo: Faster, Simpler,More Cost-effective Server I/O