20
IBM System Networking RackSwitch G8264/G8264T 1 ® IBM System Networking RackSwitch G8264/G8264T IBM Redbooks Product Guide IBM System Networking now offers the IBM RackSwitch G8264 (leveraging SFP+ technology) and the IBM RackSwitch G8264T (leveraging 10Gbase-T technology). Both are 10 and 40 Gigabit Ethernet (GbE) switches specifically designed for the data center, and are ideal for today's big data, cloud and optimized workload solutions. They are enterprise class Layer 2 and layer 3 full featured switches that deliver line-rate, high-bandwidth switching, filtering, and traffic queuing without delaying data. Large data-center grade buffers help keep traffic moving, while the redundant power and fans along with numerous high availability features help provide high availability for business sensitive traffic. The RackSwitch G8264, shown in Figure 1, is ideal for latency sensitive applications such as high performance computing clusters and financial applications. In addition to the 10GbE and 40GbE connections, the G8264 also has the capability for legacy 1GbE connections. The G8264 supports the newest protocols including Data Center Bridging/Converged Enhanced Ethernet (DCB/CEE) for support of Fibre Channel over Ethernet (FCoE) in addition to ISCSI and NAS. The G8264 is also designed to support IBM Virtual Fabric, which helps clients significantly reduce cost and complexity related to I/O requirements of many virtualization deployments. Virtual Fabric helps you reduce the number of multiple I/O adapters to a single dual-port 10 G adapter, and also to reduce the number of cables and required upstream switch ports. Virtual Fabric allows you to carve a dual-port 10 G server adapter into 8 virtual NICs (vNICs) and to create dedicated virtual pipes between the adapter and the switch for optimal performance., higher availability, and improved security. Using Virtual Fabric IT can make dynamic changes and allocate bandwidth per vNIC, making it possible to adjust over time without downtime. Figure 1. IBM System Networking RackSwitch G8264 The G8264T is part of a comprehensive 10GBase-T IBM solution that includes servers, storage and networking and that provides improved virtualization, better management, and smarter connectivity options for next generation data centers. Flexible connectivity across distances up to 100m at a low cost makes the G8264T an optimal choice for connecting high-speed server and storage devices. Figure 2. IBM System Networking RackSwitch G8264T Did you know Did you know that:

IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 1

��� ®

IBM System Networking RackSwitch G8264/G8264TIBM Redbooks Product Guide

IBM System Networking now offers the IBM RackSwitch G8264 (leveraging SFP+ technology) and the IBM RackSwitch G8264T (leveraging 10Gbase-T technology). Both are 10 and 40 Gigabit Ethernet (GbE) switches specifically designed for the data center, and are ideal for today's big data, cloud and optimized workload solutions. They are enterprise class Layer 2 and layer 3 full featured switches that deliver line-rate, high-bandwidth switching, filtering, and traffic queuing without delaying data. Large data-center grade buffers help keep traffic moving, while the redundant power and fans along with numerous high availability features help provide high availability for business sensitive traffic.

The RackSwitch G8264, shown in Figure 1, is ideal for latency sensitive applications such as high performance computing clusters and financial applications. In addition to the 10GbE and 40GbE connections, the G8264 also has the capability for legacy 1GbE connections. The G8264 supports the newest protocols including Data Center Bridging/Converged Enhanced Ethernet (DCB/CEE) for support of Fibre Channel over Ethernet (FCoE) in addition to ISCSI and NAS.

The G8264 is also designed to support IBM Virtual Fabric, which helps clients significantly reduce cost and complexity related to I/O requirements of many virtualization deployments. Virtual Fabric helps you reduce the number of multiple I/O adapters to a single dual-port 10 G adapter, and also to reduce the number of cables and required upstream switch ports. Virtual Fabric allows you to carve a dual-port 10 G server adapter into 8 virtual NICs (vNICs) and to create dedicated virtual pipes between the adapter and the switch for optimal performance., higher availability, and improved security. Using Virtual Fabric IT can make dynamic changes and allocate bandwidth per vNIC, making it possible to adjust over time without downtime.

Figure 1. IBM System Networking RackSwitch G8264

The G8264T is part of a comprehensive 10GBase-T IBM solution that includes servers, storage and networking and that provides improved virtualization, better management, and smarter connectivity options for next generation data centers. Flexible connectivity across distances up to 100m at a low cost makes the G8264T an optimal choice for connecting high-speed server and storage devices.

Figure 2. IBM System Networking RackSwitch G8264T

Did you know

Did you know that:

Page 2: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 2

The RackSwitch G8264 is designed to support a number of types of configurations: 1 Gb, 10 Gb,

and 40 Gb, Virtual NIC, Converged Enhanced Ethernet (CEE/DCB), and iSCSI.

The RackSwitch G8264 with SFP+ technology is the ideal solution for clients looking for low

latency and low power consumption.

The RackSwitch G8264 is designed to support Data Center Bridging (DCB), the IEEE’s group of

protocols that provide lossless Ethernet and allow clients to reduce the costs of implementing either:

NAS or iSCSI convergence and priority-based flow control

FCoE by aggregating switch ports before connecting to more costly upstream Fibre Channel

gateway devices.

IBM is a leader in network virtualization, offering the on-switch IBM VMready® software that

reduces the complexity of managing virtual machines (VMs) in the network.

The G8264 plays a vital role with IBM Virtual Fabric which reduces costs and complexity in

environments where four or more NICs are needed per server. A perfect example is virtualization, where clients often need as many as eight NICs per server.

The G8264T offers 48 10Gbase-T connections allowing for cost effective CAT6/6A cables of

distances up to 100m.

Part number information

Table 1 lists the part numbers for ordering IBM System x® and IBM Power Systems™ modules and additional options.

Page 3: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 3

Table 1. IBM part numbers and feature codes for ordering (part 1)

Description System x part number Power Systems MTM/FC

IBM System Networking RackSwitch G8264 (Rear-to-Front)

7309G64 1455-64C

IBM System Networking RackSwitch G8264(Front-to-Rear)

730964F

IBM System Networking RackSwitch G8264T(Rear-to-Front)

730CR9

IBM System Networking RackSwitch G8264T(Front-to-Rear)

730CF9

1 Gb options (supported only on G8264)

IBM SFP RJ45 Transceiver 81Y1618 EB29

IBM SFP SX Transceiver 81Y1622 EB2A

IBM SFP LX Transceiver 90Y9424

0.6 m Blue Cat5e Cable 40K5679

1.5 m Blue Cat5e Cable 40K8785

3 m Blue Cat5e Cable 40K5581

10 m Blue Cat5e Cable 40K8927

25 m Blue Cat5e Cable 40K8930

Page 4: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 4

Table 1. IBM part numbers and feature codes for ordering (part 2)

Description IBM System x part number Power Systems MTM/FC

10 Gb options (supported only on G8264)

IBM SFP+ SR Transceiver 46C3447 EB28

IBM SFP+ LR Transceiver 90Y9412

IBM SFP+ ER Transceiver 90Y9415

1m LC-LC Fiber Cable

(networking) - Optical88Y6851

5m LC-LC Fiber Cable

(networking) - Optical88Y6854

25m LC-LC Fiber Cable

(networking) - Optical88Y6857

1 m IBM Passive DAC SFP+ Cable 90Y9427

3 m IBM Passive DAC SFP+ Cable 90Y9430

5 m IBM Passive DAC SFP+ Cable 90Y9433

8.5 m IBM Passive DAC SFP+ Cable

90Y9436

IBM Twinax Direct Attach Cable (DAC) 1m

45W2398 (8-pack: 45W2401*)

IBM Twinax Direct Attach Cable (DAC) 3m

45W2408 (8-pack: 45W2409*)

IBM Twinax Direct Attach Cable (DAC) 5m

45W3039 (8-pack: 45W3042*)

1m 10GbE Cable SFP+ Active Twinax

ENO1

3m 10GbE Cable SFP+ Active Twinax

EN02

5m 10GbE Cable SFP+ Active Twinax

EN03

Page 5: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 5

Table 1. IBM part numbers and feature codes for ordering (part 3)

40 Gb options (Supported on G8264 & G8264T)

(Supported on G8264 only)

IBM QSFP+ SR Transceiver 49Y7884 EB27

10 m IBM QSFP+ MTP Optical

Cable90Y3519

30 m IBM QSPF+ MTP Optical

Cable90Y3521

1 m IBM QSFP+ DAC Break Out Cable

49Y7886 EB24

3 m IBM QSFP+ DAC Break Out Cable

49Y7887 EB25

5 m IBM QSFP+ DAC Break Out Cable

49Y7888 EB26

1 m IBM QSFP+-to-QSFP+ Cable 49Y7890

3 m IBM QSFP+-to-QSFP+ Cable 49Y7891

5 m IBM QSFP+-to-QSFP+ Cable 00D5810

7 m IBM QSFP+-to-QSFP+ Cable 00D4813

Page 6: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 6

Table 1. IBM part numbers and feature codes for ordering (part 4)

Miscellaneous options

IBM 19" Flexible 4 Post Rail Kit 49Y4284

Front-to-rear, hot-swappable power supply spare (G8264 only)

49Y7938

Rear-to-front, not swappable power supply spare (G8264 only)

49Y7937

Front-to-rear, hot-swappable 750WCFF power supply spare (G8264T only)

00D5857

Rear-to-front, hot swappable 750WCFF power supply spare (G8264T only)

00D5858

Front-to-rear, hot swappable fan assembly spare (both G8264 and G8264T)

49Y7939

Rear-to-front, hot swappable fan assembly spare (both G8264 and G8264T)

88Y6026

* Products are ordered through IBM Storage and Power ordering systems.Note: Transceivers are not included in the purchase of the switch and all require using the appropriate cables.

With the flexibility of the IBM switch, you can take advantage of the technologies required for multiple environments, such as the following (shown in Figure 3):

For 1 Gb links, on the G8264 specifically, you can use SFP transceivers plus LC-to-LC fiber

cables.

For 10 Gb, you can use the following:

• 10GBase-T allows CAT6 or CAT6A cables for cost effective long distances.

• SFP+ transceivers (SR, LR, or ER) plus LC-to-LC fiber cables for longer distances.

For 40 Gb links, you can use QSFP to QSFP cables up to 7m, or QSFP transceivers and MTP

cables for longer distances.

Page 7: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 7

Figure 3. Options and their supported distances

The module part numbers include the following items:

One IBM System Networking RackSwitch G8264/ G8264T

Generic Rail Mount Kit (2-post)

IBM serial cable

Power cords, shown in Table 2, are shipped separately at an additional charge.

Page 8: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 8

Table 2. Power cords and descriptions

Power cord Description

39Y7917 Power Cord Europe AC plug 10A/250 V; OPT

39Y7918 Power Cord Europe (Denmark) AC plug 10A/250 V; OPT

39Y7919 Power Cord Europe (Switzerland) AC plug 10A/250 V; OPT

39Y7920 Power Cord Israel AC plug 10A/250 V; OPT

39Y7922 Power Cord South Africa AC plug 10A/250 V; OPT

39Y7923 Power Cord UK AC plug 13A/250 V; OPT

39Y7924 Power Cord Australia AC plug 10A/250 V; OPT

39Y7925 Power Cord Korea AC plug 10A/250 V; OPT

39Y7926 Power Cord Japan AC plug 10A/125 V; OPT

39Y7927 Power Cord India AC plug 10A/250 V; OPT

39Y7928 Power Cord China AC plug 16A/250 V; OPT

39Y7929 Power Cord Brazil AC plug 16A/250 V; OPT

39Y7930 Power Cord Uruguay/Argentina AC plug 16A/250 V; OPT

39Y7931 Power Cord US/Canada AC plug 10A/125 V; OPT

Benefits

The IBM System Networking RackSwitch G8264 offers the following benefits:

High performance: The 10 Gb/40 Gb switch provides the best combination of low latency,

non-blocking line-rate switching, and ease of management. It has a throughput of 1.28 Tbps.

Lower power and better cooling: The IBM RackSwitch G8264 uses as little as 275 W of power,

which is a fraction of the power consumption of most competitive offerings. Unlike side-cooled switches, which can cause heat recirculation and reliability concerns, the G8264’s front-to-rear or rear-to-front cooling design reduces data center air conditioning costs by having airflow match the servers in the rack. In addition, variable speed fans help to automatically reduce power consumption.

Virtual Fabric: Can help customers address I/O requirements for multiple NICs while reducing cost

and complexity. Virtual Fabric for IBM allows you to carve a physical NIC into multiple virtual NICs (between 2 - 8 vNIC) and to create a virtual pipe between the adapter and the switch for improved performance, availability, and security.

VM-Aware Networking: VMready™ software on the switch simplifies configuration and improves

security in virtualized environments. VMready automatically detects virtual machine movement between physical servers and instantly reconfigures each VM’s network policies across VLANs to keep the network up and running without interrupting traffic or impacting performance. VMready works with all leading VM providers, such as VMware, Citrix, Xen, PowerVM and Microsoft.

Layer 3 functionality: The G8264 includes Layer 3 functionality, which provides security and

performance benefits, as inter-VLAN traffic stays within the switch. This switch also provides the full range of Layer 3 protocols from static routes for technologies such as Open Shortest Path First (OSPF) and Border Gateway Protocol (BGP) for enterprise customers.

Seamless interoperability: IBM switches perform seamlessly with other vendors' upstream

switches.

Fault tolerance: These IBM switches learn alternate routes automatically and perform faster

convergence in the unlikely case of a link, switch, or power failure. The switch uses proven

Page 9: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 9

technologies like L2 trunk failover, advanced VLAN-based failover, VRRP, and HotLink™.

Multicast: Supports IGMP Snooping v1, v2, and v3 with 2 K IGMP groups, as well as Protocol

Independent Multicast such as PIM Sparse Mode or PIM Dense Mode.

Converged fabric: The IBM switch is designed to support CEE and connectivity to FCoE

gateways. CEE will help enable clients to combine storage, messaging traffic, VoIP, video, and other data on a common data center Ethernet infrastructure. FCoE will help enable highly efficient block storage over Ethernet for consolidating server network connectivity. As a result, clients can deploy a single server interface for multiple data types, which can simplify both deployment and management of server network connectivity, while maintaining the high availability and robustness required for storage transactions.

The IBM System Networking RackSwitch G8264T offers the following benefits:

Low cost cabling: The ability to leverage CAT6 or CAT6A cabling can save clients thousands of

dollars for connections anywhere from a couple feet to 100 meters compared to SFP+ models.

High performance: For those requiring the use of 10GBase-T the 10 Gb/40 Gb capabilities

provides the best combination of non-blocking line-rate switching with throughput of 1.2 Tbps.

Lower power and better cooling: The IBM RackSwitch G8264T’s typical power consumption is

385 W, which is a fraction of the power consumption of most competitive 10GBase-T offerings. Unlike side-cooled switches, which can cause heat recirculation and reliability concerns, the G8264T’s front-to-rear or rear-to-front cooling design reduces data center air conditioning costs by having airflow match the servers in the rack. In addition, variable speed fans assist in automatically reducing power consumption.

VM-Aware Networking: VMready™ software on the switch simplifies configuration and improves

security in virtualized environments. VMready automatically detects virtual machine movement between physical servers and instantly reconfigures each VM’s network policies across VLANs to keep the network up and running without interrupting traffic or impacting performance. VMready works with all leading VM providers, such as VMware, Citrix, Xen, and Microsoft.

Layer 3 functionality: The IBM switch includes Layer 3 functionality, which provides security and

performance benefits, as inter-VLAN traffic stays within the switch. This switch also provides the full range of Layer 3 protocols from static routes for technologies such as Open Shortest Path First (OSPF) and Border Gateway Protocol (BGP) for enterprise customers.

Seamless interoperability: IBM switches perform seamlessly with other vendors' upstream

switches.

Fault tolerance: These IBM switches learn alternate routes automatically and perform faster

convergence in the unlikely case of a link, switch, or power failure. The switch uses proven technologies like L2 trunk failover, advanced VLAN-based failover, VRRP, and HotLink™.

Multicast: Supports IGMP Snooping v1, v2, and v3 with 2 K IGMP groups, as well as Protocol

Independent Multicast such as PIM Sparse Mode or PIM Dense Mode. Use Table 3 to select the appropriate switch.

IBM RackSwitch G8264 IBM RackSwitch G8264T

Port types Based on SFP+ Based on 10GBase-T

Latency Lower latency - 880 nanosecond 3.2 microseconds

Typical power Lower power - 275 watts Competitive vs. other 10GBase-T - 385W

Copper cable length Up to 8.5m Up to 100m

Total distance Up to 40KM with Transceiver Limited to 100m

TCO Less than other SFP+Lower TCO – for 100m and less(based on adapter, cables and switch)

Table 3. RackSwitch G8264 and RackSwitch G8264T features

Warranty information

The IBM RackSwitch includes an IBM standard 3-year hardware and software warranty. IBM also reserves the right to provide new features as part of future software releases. Software Upgrade

Page 10: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 10

Entitlement is based on the switch’s warranty or post warranty extension and service contracts.

Features and specifications

Performance is as follows:

100% Line rate performance

1280 Gbps non-blocking switching throughput (full duplex)

Latency: G8264 (880 nanoseconds) G8264T (3.2 microseconds)

960 Mpps

Hardware features

The hardware features are as follows:• Models

• IBM System Networking RackSwitch G8264/G8264T Rear-to-Front Versions For ports located in the rear of the rack matching System x and IBM BladeCenter® designs

• IBM System Networking RackSwitch G8264/G8264T Front-to-Rear Versions For ports located in the front of the rack matching airflow of IBM iDataPlex®

• Interface options

• Forty-eight ports (10 GbE) – G8264 (SFP+) and G8264T (10GBase-T)

• Four QSFP+ ports (40 GbE)

• One 10/100/1000 Ethernet RJ45 port for out-of-band management

• One USB port for mass storage device connection

• One mini-USB Console port for serial access

• Server-like port orientations, enabling short and simple cabling

• Dimensions:

• G8264: 17.3 inches wide, 19 inches deep, 1 RU high

• G8264T: 17.3 inches wide, 20.3 inches deep, 1 RU high

• Weight:

• G8264: 9.98 kg (22 lb)

• G8264T: 11.1 kg (24.5lb)

• Rack Installation Kit

• Generic Rack Mount Kit (2-post)

• Can be mounted vertically or horizontally

• LEDs

• System LEDs to indicate link status, fan, power, and stacking

• Airflow

• Front-to-rear or rear-to-front cooling

• Redundant variable hot-swap speed fans for reduced power draw

Figure 4 shows the rear view of the IBM RackSwitch G8264.

Page 11: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 11

Figure 4. Rear view of IBM RackSwitch G8264

Power

Dual hot swap power modules, 50 - 60Hz, 100 - 240 VAC auto-switching per module

Typical power consumption of 275 Watts (G8264) and 385 Watts (G8264T)

Environmental specifications

Temperature: Ambient operating: 0 - 40 ºC

Relative humidity: Non-condensing, operating 10 - 90%

Altitude: Operating 1,800 m (6,000 feet)

Typical heat dissipation: 1127 BTU/hour ( G8264) and 1330 BTU/hour (G8264T)

Mean time between failures (MTBF):

G8264: 165,990 hours at 40 °C

Software features

The software features, as of 6.8, are as follows:

Security

RADIUS

TACACS+

SCP

Wire Speed Filtering: Allow and Deny

SSH v1, v2

HTTPS Secure BBI

Secure interface login and password

MAC address move notification

Shift B Boot menu (Password Recovery/ Factory Default)

VLANs

Port-based VLANs

4096 VLAN ids supported

2048 Active VLANs (802.1Q)

802.1x with Guest VLAN

Private VLAN Edge

FCoE/Lossless Ethernet

802.1 Data Center Bridging

Priority Based Flow Control (PFC)

Enhanced Transmission Selection (ETS)

Data Center Bridge Exchange protocol (DCBX)

FIP Snooping

Fibre Channel over Ethernet (G8264 only)

Converged Enhanced Ethernet

Page 12: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 12

Trunking

LACP

Static Trunks (EtherChannel)

Configurable Trunk Hash algorithm

Spanning Tree

Multiple Spanning Tree (802.1 s)

Rapid Spanning Tree (802.1 w)

PVRST+

Fast Uplink Convergence

BPDU guard

Quality of Service

QoS 802.1p (priority queues)

DSCP remarking

Metering

Routing protocols

RIP v1/v2

OSPF

BGP

High availability

Layer 2 failover

HotLinks™

Virtual Router Redundancy support (VRRP)

Multicast

IGMP Snooping v1, v2, and v3 with 2 K IGMP groups

Protocol Independent Multicast (PIM Sparse Mode/Dense Mode)

Monitoring

Port mirroring

ACL-based mirroring

sFlow Version 5

Virtualization

VMready with VI API support

vNIC MIB support for SNMP (G8264 only)

Clients

IBM System Networking Element Manager

isCLI (Cisco-like)

Scriptable CLI

Browser-based client or Telnet

Standard protocols

IPv6

SNMP v1, v2c, and v3

RMON

Secondary NTP Support

DHCP Client

DHCP Relay

LLDP

128 K MAC Table

9 K Jumbo Frames

802.3X Flow Control

Upgrades

Upgrade firmware via serial or TFTP

Dual software images

Popular configurations

This section describes common configurations for the G8264.

Rack-optimized server aggregation 10-GbE attached rack servers

The RackSwitch G8264 is an ideal networking device for port aggregation, allowing the consolidation

Page 13: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 13

of one to three racks full of servers before connecting to an upstream switch.

High-concentration of rack-optimized servers, for example:

IBM System x 1U servers with a 10 Gb adapter installed

Easily supports 40 servers per rack.

Easily supports up to 48 servers or more, depending on uplink bandwidth required across

two racks, including storage or UPS.

IBM System x 2U servers with a 10 Gb adapter installed

Most clients will have up to twenty 2U servers per rack.

With the G8264 switch being able to support up to 64 SFP+ ports, a client could easily

leverage a switch across three racks of severs, and more likely two for redundancy.

IBM BladeCenter using any of the following modules in the chassis

BNT 1/10 Gb Uplink Ethernet Switch Module for IBM BladeCenter

With only two 10 Gb SFP+ ports per chassis, clients with larger data centers could easilysupport 24 chassis or more per RackSwitch G8264.

BNT Virtual Fabric 10 Gb Switch Module for IBM BladeCenter

With support of up to ten 10 Gb SFP+ ports per switch, clients can easily support 4 - 6 chassis per RackSwitch, and if they are not concerned about oversubscription, they can support up to 24 or more per RackSwitch G8264.

10 Gb Ethernet Pass-Thru Module for IBM BladeCenter

For many clients looking to use a pass-through module, upstream costs could be very expensive, especially if you are connecting to a core switch and you are looking at up to fourteen 10 Gb ports per chassis. The G8264 provides a much more cost-effective alternative and can support up to four fully populated IBM BladeCenter H chassis per RackSwitch. This is also a much better alternative for larger BladeCenter H environments compared to a smaller 24-port switch.

Low-profile, high-performance, 48/64-port 10-GbE switch needed to perform aggregation function

per rack. Figure 5 shows port aggregation, and Table 4 lists the features and benefits.

Figure 5. Port aggregation

Page 14: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 14

Table 4. Features and benefits

Features Benefits

Line-rate, non-blocking, all 64-ports Supports massive compute and virtualization workloads

Deterministically low latency Faster application response times

Support for IGMP Snooping and L3 forwarding Enables high-bandwidth, low-latency multicast applications

Standards-based Layer 2/3 protocols; industry standard CLI

Interoperates with existing network; no learning curve

Rack-optimized server aggregation logical design

Design Goal: IBM RackSwitch G8264 (10 GbE) switch at Distribution Layer and IBM RackSwitch G8000/G8052 (1 GbE) at Edge/Access.

The G8264 is also ideal at the distribution layer when you are looking to aggregate connections for access layer switches like the G8000 or G8052 which support forty-eight 1 Gb ports to the servers and four 10 Gb uplinks. In either scenario the G8264 provides exceptional value by being able to support:

Up to 12 G8000/G8052 switches (576 servers) when using the four 10 Gb uplinks per

G8000/G8052, while still having the four 40 Gb uplinks from the G8264 to the core

Up to 16 G8000/G8052 switches (768 servers) when using the four 10 Gb uplinks per

G8000/G8052 and using 10 Gb SFP+ break-out cables in the four 40 Gb ports with no uplinks to a core

Additional details:

Logical Configuration: Configure G8000/G8052 for Layer 2 and apply static routes for L3

forwardingFull Layer 2/3 Feature Set: STP, MSTP, RSTP, PVRST+; RIP v1/2, static routes, OSPF

Security: 802.1X; RADIUS/TACACS+; Wire Speed ACLs, SSH v1, v2; HTTPS Secure BBI

QoS: Up to eight queues per port, IEEE 802.1p and DiffServ prioritization

Figure 6 shows aggregation option 2.

Page 15: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 15

Figure 6. Aggregation option 2

2560 node gigabit network : Using next-generation 64 port 1U switches

The following high-level configuration is an example of how a configuration might look if the G8052 is used as leaf switches and the G8264 is used as a spine switch.

All active links

Traffic load balanced across all links using Layer 3 ECMP

64 RackSwitch G8052 Leaf Switches for 2560 non-blocking 1 GbE ports

48x 10/100/1000 server-facing ports each

4x 10 GBASE-SR fiber uplinks each

Four RackSwitch G8264 spine switches for non-blocking core

Figure 7 shows the 2560 node.

Figure 7. 2560 node

Virtual Fabric configuration with IBM System x servers using the Emulex Virtual Fabric Adapter

The following example is how an IBM Virtual Fabric implementation might look:

IBM Virtual Fabric for IBM System x is built using industry standards and is the ideal solution for

customers that require more than two NICs per server. Over the past couple of years many clients

Page 16: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 16

have seen their I/O requirements per server increase anywhere from 4 to 6 to 8 or even moreNICs per server, especially with the adoption of virtualization. What IBM Virtual Fabric does is provide clients with the ability to leverage a virtual NIC approach leveraging 10 Gb Ethernet technology to help reduce cost and complexity while also achieving better performance and more flexibility. It provides the following benefits:

Reduced costs: (Acquisition and operating) by using fewer adapters, cables, and upstream

switch ports.

Reduced complexity: Fewer items to manage, based on industry standards, making

management easier with the addition of high availability and better security.

Better performance: A significant amount more I/O bandwidth per server and lower latency

than traditional 1 Gb Ethernet.

Flexibility: The ability to carve up a dual-port 10 Gb adapter into 4 - 8 virtual NICs and create

virtual pipes between the adapter and switch for higher availability and security. Not only can customers dynamically allocate I/O bandwidth to each virtual NIC, Virtual Fabric also provides the ability to change those allocations as needed. For example, a customer might have one configuration for workload during the day and another during the evenings. Virtual Fabric has the ability to make those changes on the fly without downtime.

IBM Virtual Fabric is designed in partnership with Emulex. This solution requires the following

components:

Emulex 10 Gb Virtual Fabric Adapter for IBM System x. For more details, use the link below

http://www.redbooks.ibm.com/Redbooks.nsf/RedbookAbstracts/tips0762.html?Open

IBM System Networking RackSwitch G8264

Figure 8 shows the vNIC.

Figure 8. vNIC

IP Storage over 10 GbE: Changing the economics of storage

G8264 benefits for IP Storage applications are as follows:

Lossless Ethernet Fabric

Low latency ideal for HPC clusters, cloud, and financial applications

Line-rate, high-bandwidth performance

Low-power consumption with fewer components

Low-cost, pay-as-you-grow 10 Gb/40 Gb storage network

Figure 9 shows the iSCSI.

Page 17: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 17

Figure 9. iSCSI

This section describes common configurations for the G8264T.

Rack-optimized server aggregation for rack servers using 10GBase-T

The RackSwitch G8264T is an ideal networking device for port aggregation, allowing the consolidation of one to three racks full of IBM System x type servers before connecting to an upstream switch. The IBM System x servers could leverage a 10GBase-T adapter installed like the Broadcom NetXtreme II Dual Port 10GBase-T Adapter for IBM System x (Link: http://www.redbooks.ibm.com/abstracts/tips0846.html?Open) and then CAT6/6A cables can be used to connect upstream to the G8264T. The RackSwitch G8316 would be an attractive offering for 40Gb upstream connects from the G8264T helping clients create a flat two layer networking implementation as shown in Figure 10.

Page 18: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 18

Figure 10. G8316 Aggregation for multiple G8264T switches

iSCSI Storage Implementation If you need to leverage iSCSI or other storage offerings based on 10GBase-T, e.g., the IBM System

Storage DS3512, use the link below:

http://public.dhe.ibm.com/common/ssi/ecm/en/tsd03097usen/TSD03097USEN.PDF)

The IBM RackSwitch G8264T is a good solution for connecting IBM servers and IBM System Storage DS3500, as shown in Figure 11.

Figure 11. G8264T connected to DS3500

Related publications

For more information, see the following IBM System Networking RackSwitch G8264 product publications:

Application Guide

http://www-01.ibm.com/support/docview.wss?uid=isg3T7000464

ISCLI Command Reference

http://www-01.ibm.com/support/docview.wss?uid=isg3T7000482

BBI (browser-based interface) Quick Guide

http://www-01.ibm.com/support/docview.wss?uid=isg3T7000481

Menu-based CLI Command Reference

IBM US Announcement Letter http://www-01.ibm.com/support/docview.wss?uid=isg3T7000481

G8264 -

http://ibm.com/common/ssi/cgi-bin/ssialias?subtype=ca&infotype=an&supplier=897&letternum=ENUS111-005G8264T -

http://www-01.ibm.com/common/ssi/cgi-bin/ssialias?infotype=AN&subtype=CA&htmlfid=897/ENUS112-027&appname=USN

Page 19: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 19

NoticesThis information was developed for products and services offered in the U.S.A.

IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-IBM product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to:

IBM Director of Licensing, IBM Corporation, North Castle Drive, Armonk, NY 10504-1785 U.S.A.

The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.

Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.

Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurement may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment.

COPYRIGHT LICENSE:

This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs.

© Copyright International Business Machines Corporation 2011. All rights reserved.Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted byGSA ADP Schedule Contract with IBM Corp.

Page 20: IBM System Networking RackSwitch G8264/G8264T 2012. 4. 16. · IBM System Networking RackSwitch G8264/G8264T 2 The RackSwitch G8264 is designed to support a number of types of configurations:

IBM System Networking RackSwitch G8264/G8264T 20

This document was created or updated on March 5, 2012.

Send us your comments in one of the following ways:Use the online Contact us review form found at:

ibm.com/redbooksSend your comments in an e-mail to:

[email protected] your comments to:

IBM Corporation, International Technical Support OrganizationDept. HYTD Mail Station P0992455 South RoadPoughkeepsie, NY 12601-5400 U.S.A.

This document is available online at http://www.ibm.com/redbooks/abstracts/tips0815.html .

Trademarks

IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. These and other IBM trademarked terms are marked on their first occurrence in this information with the appropriate symbol (® or ™), indicating US registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml

The following terms are trademarks of the International Business Machines Corporation in the United States, other countries, or both:

BladeCenter®Blade Network Technologies®BNT®IBM®iDataPlex®Power Systems™Redpaper™Redbooks (logo)®System x®VMready®

Microsoft, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both.

BNT, VMready, and Server Mobility are trademarks or registered trademarks of Blade Network Technologies, Inc., an IBM Company.

Other company, product, or service names may be trademarks or service marks of others.