16
From Physical Layer to System Integration Bundle promotion! See page 12 Test Tools for InfiniBand TRADE ASSOCIATION

Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

From Physical Layer to System Integration

Bundle promotion! See page 12

Test Tools for InfiniBand

T R A D E A S S O C I A T I O N

Page 2: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

2

The explosion of the Internet andthe resulting need to move hugeamounts of data instantly haveplaced a considerable strain onexisting server technologies. TheInformation Technology (IT)industry has struggled to keepup with a continuing demand to decrease cost, increaseperformance, and providecontinuous availability.

The InfiniBand interconnecttechnology uses a channel-based,switched-fabric, point-to-pointarchitecture to deliver new levelsof scaleability, availability, andperformance. Scalability isdelivered in part by its switchednetwork interconnect, itsautomatic reconfiguration of the network upon addition or

Moving to the High Speeds of InfiniBandInfiniBand certainly presentsconsiderable opportunities fornew high-speed products, but it also presents you with asignificant learning curve whentasked with developing theseproducts. The data transfer rates are enough to test yourengineering abilities. Add to that the complex protocol,hot-swapping ability, automaticnetwork reconfiguration, and distributed computingintelligence, and you have a real challenge ahead.

But you won’t have to meet thischallenge alone. AgilentTechnologies is committed toproviding the InfiniBand testsolutions you need. Agilent is amember of the InfiniBand TradeAssociation and will be therewith the required tools to get the job done even in the face ofevolving standards. In addition,Agilent offers extensive trainingin both InfiniBand designtechnology basics, andhigh-frequency test and system verification.

From verifying the signalintegrity of the physical layer tochecking the BER (Bit ErrorRate) to analyzing InfiniBandtraffic to stepping through theInfiniBand protocol, Agilent canprovide the required tools.Moving into the InfiniBand realmwill present challenges, butAgilent will be at your side allthe way.

removal of devices, and its use of virtual channels rather thanhardwired links to connectservers to other devices.

Availability is a product ofreliability, fault tolerance, and serviceability. InfiniBandtechnology utilizes point-to-pointinterconnects, allows forredundant paths betweendevices with subsequent failovercapability, and includesimproved error detection and correction. It also allowshot-swapping devices withautomatic network reconfiguration.

Improved performance isanother cornerstone ofInfiniBand. Data is transferredbetween InfiniBand fabricelements on links of copper or optical fiber. The effectivesustained data rates are500 MB/s (1x), 2 GB/s (4x), and6 GB/s (12x). Beyond the rawdata transfer rates, system-levelperformance is improved by theconcept of intelligent channels,with computing intelligencedistributed into the I/O systemto off-load the task of controllingI/O from processors.

Figure 1. It is expected that data centers will adoptthis high-speed data transfer technology to clusterservers and storage devices.

Page 3: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

3

www.agilent.com/find/InfiniBandFigure 2. The complexity of the InfiniBand technology requires many different toolsat various stages within an implementation. This diagram shows a typicalInfiniBand system and where each type of instrument is used.

InfiniBand ComponentsHCA - Host Channel AdapterTCA - Target Channel Adapter

Test InstrumentsOSC - Oscilloscope/TDRPLTS (VNA) - Physical Layer Test SystemPG - Pulse GeneratorPB - ParBERTSB - Serial BERTLA - Logic AnalyzerPA - Protocol Analyzer/

Traffic GeneratorBE - Bus Exerciser/

Analyzer (PCI-X)

Higher level protocolApplication & Management software verification• Establish and tear down connections• Handle error conditions

TransportPacked validation• Packets in sequence, end-to-end flow control, QPs• Transport time (latencies)

NetworkTest logistical switching• Switching inputs to outputs according to

switch table• Handling of load conditions

Port Link LevelVerify point to point connection between two nodes• Implementation of buffers, virtual lanes, data paths• Variant CRC checks (goes to the 8bit level)• Link training, link-level flow control

Port PhysicalVerify the 2.5 Gbit design• Signal integrity (measure eye opening, BER, jitter,

etc.) board design and component characterization• Ensure proper 50-Ω strip line design, board layout,

connectors, cables, etc. (TDR measurements)• Symbol encoding, running disparity, control symbols

and ordered sets, lane-to-lane skew, elastic FIFOs

16700 Series Logic Analysis System• N4206A software tool• N4217A logic analysis probe• N4216A 4:1 converter box

86100B Infiniium DCAwith TDR

81250 ParBERT

86130A BitAlyzer

N1947A, 48A, 51A PhysicalLayer Test System (VNA)

81134A Pulse/Pattern Generator

E2950 Series• E2951A protocol analyzer for InfiniBand 1x• E2952A protocol analyzer for InfiniBand 4x• E2953A traffic generator for InfiniBand 1x• E2954A exerciser for InfiniBand 4x• E2955A InfiniBand 4x Bundle• Option 100 Compliance Test Software for

E2953A and E2954A

Page 4: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

4

Physical Layer Characterization

Signal integrity is no longersomething to be looked at justonce at the beginning of a projectwhen laying out the device orboard. Everyone must be awareof signal integrity and evaluate it throughout the project, andmust have the proper tools toaccomplish this sometimesdaunting task. The challenginghigh-speed digital designs oftoday’s data rates require careful use of a wide variety ofengineering tools. It is importantfor designers to learn these newtools effectively to avoid multiplere-design efforts.

The breadth of tools availablefrom Agilent Technologiesenables signal integrityevaluation throughout the entiredesign process.

After all of the simulations andverifications of your product invirtual form, you eventually getto work with real hardware. The first step in testing anyproduct with such high datarates is to verify the integrity ofthe physical layer. Great caremust be taken to ensure that the physical layer is laid outproperly in order to minimizereflections, crosstalk, and othernoise sources.

When the components are firstinstalled, you can use pulsegenerators to test your systemwith live signals. High-speedscopes and active probes enableyou to see what is going on. Once the system is running, youcan monitor the signal integrityof hundreds of channelssimultaneously with a logicanalyzer and new eye diagramfeature, “eye scan”.

When the system is running, youcan use eye diagrams to furthervalidate the quality of individualsignals with a scope. Bit errorratio testers (BERTs) can also beused to ensure that errors arewithin the required range.

Finally, when all of the signalshave been checked, the entiresystem can be tested withAgilent's protocol analyzers andbus exercisers. You can stressyour design with very specificand controllable worst-casescenarios to give you theconfidence that your system is ready to ship.

Design Simulation Device and Board

Link toModelDatabase

Devices &InterconnectCharacterization

PrototypeCharacterization

Bring-UpTest

SystemIntegration& FunctionalValidation

ADS

SPICE/IBIS

IConnect

PhysicalLayer

System(VNA)

DeviceCharacterization& Modeling Services

Serial/Parallel BERT

81133/34A Pulse Generator

16700 Series Logic Analysis Systems

High-Bandwidth Real-Time Scope

86100BwithTDR

86100B DCA (Probes)

Single-Ended/Differential Probes for Real-Time Scope

Live SignalsExternal Stimulus

16760A with Eye Scan

Protocol Analyzer

System

Figure 3. Agilent Technologies helps you address signal integrity issues throughout the entiredesign process.

Page 5: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

5

www.agilent.com/find/InfiniBand

TDR (time domain reflectometry)is ideal for checking the signalintegrity of printed circuitboards, cables, and connectors. Itrequires a high-speed digitizingoscilloscope with a built-in stepgenerator capable of launching afast edge into a signal path.Monitoring the reflected wavefrom various impedancediscontinuities encounteredalong the signal path allows youto determine whether or not thesignal path adds excessive noiseto the signal. Even the mostprecise printed circuit boardlayouts can result in impedancediscontinuities severe enough torender a signal path useless.

The Agilent 86100B InfiniiumDCA (digital communicationsanalyzer) with TDR enablesdesign and analysis of theInfiniBand physical layer byaccurately characterizingelectrical components, includingbackplanes, cables andconnectors. The 86100B is awide-bandwidth oscilloscopewith the following plug-inmodules that support testing ofInfiniBand components:

• 54754A differential TDR• 86112A dual 20 GHz electrical

plug-in module• 83484A dual 50 GHz electrical

plug-in module• 86101A optical plug-in module

Also available is third-partysoftware from TDA Systems thataccurately characterizes lossy,dispersive transmission linesusing the 86100B’s TDR/TDTmeasurements. For informationon this product, send an e-mail to [email protected]

Figure 4. Physical layer probing with the N1020A TDR probe and positioning arm.

For InfiniBand optical-layertesting, Agilent offers the 86101A optical plug-in modulefor component testing at the 850 nanometer centerwavelength. InfiniBandtransceiver modulationcharacteristics can be improvedby measuring and optimizing key

performance parameters such asextinction ratio, jitter, averagepower, and duty cycle distortion.The 3 GHz of unfilteredbandwidth gives superiormeasurement capability forInfiniBand applications.

Figure 5. TDR measurements on the 86100B Infiniium DCA (digital communications analyzer).

Page 6: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

6

Physical Layer Characterization (continued)

To create accurate models, youmust accurately characterizeyour devices and interconnects.You can modify existing modelsor use supplied libraries, but the most accurate method forcreating models is to measureactual devices.

The Agilent N1947A, N1948Aand N1951A physical-layer testsystems provide an accurate andcomprehensive physical-layercharacterization of high-speedinterconnects and components.Characterizing interconnects andcomponents of high-speedsystems has become increasinglychallenging. Engineers workingwith microwave applicationshave addressed similar issues byusing a systematic approach,based in the frequency domain.

This same technology based on aVNA (vector network analyzer) isnow being applied to high-speedsignal integrity problems,resulting in increasedmeasurement accuracy.

The accuracy of the measurementsis enhanced with the ability tofully remove the effects of thetest fixtures. Additionally, the measurements arecomprehensive. With a one-timeconnection, all of the forwardand reverse transmission andreflection terms are measured.Once the measurement iscomplete, analysis can beperformed in single-ended-,differential-, common-, andmixed-modes. Switching betweenfrequency and time domains, eyediagrams, and transmission lineparameters (RLCG) is as easy asa mouse-click.

Figure 6. Gather accurate measurementsfor model extractions and comprehensivephysical-layer characterizations with theAgilent N1947A, N1948A and N1951A.

Instead of tracking down thecause of signal integrityproblems after the hardware iscreated, consider addressingsignal integrity issues during the simulation of what you willcreate. With accurate models,you can solve many signalintegrity problems before theyactually exist.

Page 7: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

7

www.agilent.com/find/InfiniBand

Figure 7. The Agilent 81134A pulse/pattern generator enables the precisecharacterization of devices and minimizes the influence of jitter injection bythe source.

While bringing a system up, it isoften necessary to stimulate aportion of the system before theentire system is running. Apulse/pattern generator canprovide the stimulus signals usedby a scope to make eye diagrams. The generator must also allowyou to stress the system byadding controllable jitter to thestimulus signal.

The 81134A pulse/patterngenerator is a high-performanceand easy-to-use pulse anddata-pattern source forcharacterizing the physical layeras well as verifying andvalidating high-speed clocksystems. The graphical userinterface enables you to easily setup very complex signals. Fromgenerating PRBS to adding jitterto your clock or data, the 81134Agives you the required signals.

The fast rise times, low jitter, and full parameter flexibilityprovide just the signal you need,especially in high-speed systemswhere timing is critical.Performance can be evaluatedwith eye-diagram measurementswith PRBS from 25-1 to 231-1.The delay control input allowsyou to add jitter to the clock ordata signals. The eye can bedistorted with the variablecrossover function.

Other features include LVDSlevels and a remote graphicaluser interface and SCPIcommands for remote handlingand programming.

For more specific informationabout signal integrity solutions,log onto www.agilent.com/find/si

Page 8: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

8

Digital Data Transfer Performancesoftware offers deeper analysiscapabilities for R&D engineerscharacterizing devices. Fastpass/fail measurements areavailable for engineers in manufacturing.

The ParBERT 81250 is a parallelBERT, an instrument that iscurrently unique in themarketplace. It is able tostimulate and analyze multipleInfiniBand bus lines withstandard test patterns (PRBSand PRWS—pseudo random wordsequence), user-defined custompatterns, and a mix of PRBS andcustom data. For SerDes(serializer/de-serializer) devices,it is particularly useful to be able to generate data on a number of lower-speed parallel lines and detect the fidelity of themultiplexing process on thehigh-speed serial side of thedevice. Likewise, the 81250 canbe used to stimulate the serialside of the SerDes device andanalyze the lower-speed parallellines. The ParBERT 81250 can be used to test 1x InfiniBandserializer and deserializerdevices, 4x InfiniBand and 12x InfiniBand serializers.

Once the signal integrity of thephysical layer is validated, youmust test the InfiniBand channelwith full-speed digital data. Thisis commonly accomplished bycreating test data, running itthrough the channel, and thencomparing the data receivedwith the data transmitted. Yourgoal is to verify that the designhas an acceptable Bit Error Rate.If the BER is not acceptable, youmust be able to find the source ofthe problem quickly.

Another test goal is to stress theInfiniBand implementation todetermine its limits of operation,ensuring that your design is wellwithin the parameters of thespecification. Key testingcapabilities are to vary signalparameter levels or datacontents for margin test; toaccurately move pulse edgepositions in time relative topulses on other, parallel, buslines; and to stress devices untilthe limits of performance areestablished. New measurement

Figure 9. The ParBERT 81250stimulates and analyzes multiple InfiniBand bus links.

Figure 8. View the BER results of several ports with ParBERT 81250.

Page 9: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

9

www.agilent.com/find/InfiniBand

The ParBERT 81250 is a modularsolution for simultaneouslytesting multiple channels at datarates up to 10.8 Gb/s. ParBERT81250 thoroughly characterizesyour device by going beyond BERmeasurements, providing testfeatures such as propagationdelay and setup and hold times.The system generatesPRBS/PRWS up to 231–1.

The 86130A BitAlyzer is a serialBERT that is particularlysuitable for stimulating andmeasuring the BER performanceof individual channels in anInfiniBand optical link, up to3.6 Gb/s. Besides superiorwaveform performance thatstimulates the device under testfully, the instrument also hasadvanced error analysiscapabilities that allow completeand accurate characterization oferrors in ways that have not beenwidely available before. The86130A’s error analysis featurequickly reveals the underlyingcauses behind errors. Combinedwith a user interface that isquick and easy to learn, andin-depth help similar to the86100B Infiniium DCA, thesecapabilities will make InfiniBanddevelopment cycles shorter. Byreducing time to discovery,design problems can beeliminated earlier and moreeasily.

Figure 11. The 86130A BitAlyzer stimulates and measures the BERperformance of individual channels in an InfiniBand optical link.

Figure 10. Error analysis on the 86130A—an underlyingrepetition is revealed that iscontributing to the errorperformance of the test device.

Page 10: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

10

Figure 12. The E2951A protocol analyzer’s graphical interface lets you easily dealwith all levels of the InfiniBand protocol.

Once your InfiniBand nodes areup and running, you can beginvalidation of the InfiniBandfabric itself. An isolatedhigh-level view of the InfiniBandbus allows you to focus onprotocol and performance-relatedissues. It is critically importantto exercise the InfiniBand systemwith worst-case traffic conditionsin a repeatable and controllablefashion. By generatingrepeatable traffic, you canchange the system parameters to verify operation, and uponencountering a problem,repeatedly force the error until a solution is found.

By representing data in ahierarchical way, automaticallypointing to protocol errors anddata mismatch, and stimulatingthe system with test data, theAgilent E2950 Series speedssystem validation.

Agilent’s E2950 Series SolutionThe E2950 Series decodes bus information intoInfiniBand-specific code, and can generate worst-caseInfiniBand traffic conditions.

To aid troubleshooting, theE2950 Series provides real-timetriggering on events, the header,and parts of the payload. Itperforms counting andsequencing, protocol errordetecting, and data filtering.

Protocol Analysis and Exercising

Comprehensive error-detectionfeatures sense and alert you toprotocol violations at all protocol levels, from 8b/10b anddisparity errors on the physicallayer to out-of-sequence packets.An interactive graphical userinterface running in the familiarWindows® environment allowsyou to easily deal with all levelsof the InfiniBand protocol.

In addition, a C-ApplicationProgramming Interface (C-API)offers a convenient R&Ddebugging tool and thefoundation for structured andautomated testing.

Finding the Right Instruments forYour InfiniBand 1x or 4x ApplicationThe E2950 Series has itsconsistent look and feel, andallows you to expand your testenvironment as the InfiniBandtechnology and standard evolve.The E2951A protocol analyzerfor InfiniBand 1x and theE2952A protocol analyzer for

InfiniBand 4x are standaloneinstruments that analyze thephysical and protocol levels,provide time analysis andreal-time performance analysis,and verify efficiency.

The analyzers are preconfiguredwith either one 2.5 Gb/s (for 1x)or four 2.5 Gb/s InfiniBandfront-end modules (for 4x). Thefront-end module does notinfluence the physical protocolbehavior of the observedInfiniBand link.

These analyzers have up to512 MB or 2 GB of memory and a packet time-stamp resolutionof 8 ns. They can analyzedual-simplex packets and countskip-ordered sets.

Their extensive triggeringcapabilities include InfiniBandheader bits, bits of data payload,real-time errors, link-trainingsequences, and message-level orpacket sequences.

Page 11: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

11

www.agilent.com/find/InfiniBand

The E2951A’s/E2952A’s GUIdepicts data hierarchicallyregardless of whether a datarepresentation on a highermessage level or individual bitlevel is needed. Timinginformation is presented as anabsolute time stamp, as a timedelta between time stamps, or asidle time between packets. Youcan also collapse or expandpacket fields, and define theirformat and bit ordering.

The E2953A traffic generator andthe E2954A exerciser deliver acontrolled stimulus of InfiniBandtraffic to test compliance, cornercases, stress and error scenarios.The tools create predictableInfiniBand test traffic in a fullycontrollable way, as well asgenerating sequences ofarbitrary InfiniBand packets thatthe user can program via a C++or TCL script interface. It canmonitor incoming traffic,participate in link training,transmit idle data andskip-ordered sets, generatesequences of arbitrary packets,perform packet framing, andrespond to incoming packetsunder software control. TheE2953A/E2954A let you generatevarious InfiniBand test scenariosso you can validate your designsand ensure compliance withstandards. An optionalInfiniBand Compliance TestSuite (option #100) is alsoavailable. The option containspre-written InfiniBandcompliance tests you can executeby simply clicking “Run”.

The E2950 Series include anintegrated power supply, USB(universal serial bus) connectorto interface to the controlling PC,indicators, trigger I/O connectors,

and a 1x or 4x InfiniBandinterface. These InfiniBand toolsare the ideal combination fordesigning, debugging andvalidating your InfiniBandproducts. For example, you canuse them to validate an HCA(host channel adapter) andserver. The two instrumentsallow you to stress the serverfrom the I/O side, monitor systemperformance, and test withworst-case scenarios in a fullypredictable and controllable way.

Bundle Promotions Offer Discountsfor E2950 SeriesGet a 20% discount on InfiniBand 1xproducts when you buy both anE2951A protocol analyzer and anE2953A traffic generator/exerciser.Get a 25% discount on Infiniband4x products (E2952A protocolanalyzer and E2954A exerciser)when you buy the E2955Abundle. In the USA call1-800-452-4844 ext. 7675 or callyour Agilent sales representativeand ask for the 1x bundle or theE2955A InfiniBand 4x bundle.

E2951A

Universal serial bus

Hostchanneladapter

Server

SwitchTargetchanneladapter

RAID

Switch

E2951A

Universal serial bus

Four-portswitch

E2953A

E2953A

E2953A

E2953A

Generatorand analyzerfor criticaltest traffic

One additionalgenerator/portto generatebackground load

Figure 13. The E2952A protocol analyzer for InfiniBand 4X.

Figure 14. Typical application for protocol analyzer.

Figure 15. Typical application for traffic generator.

For more information, log onto this website:

www.agilent.com/find/E2950_series_promotion

Page 12: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

12

After establishing that yourInfiniBand link meets therequired BER, you can thenvalidate both the InfiniBanddevice (HCA, TCA, switch, etc.)and the system that incorporatesthe device. The N4217A logicanalysis probe capturesInfiniBand traffic and, incombination with the 16700 Series logic analysissystem, provides triggering,cross-correlation, and detailedmeasurements for completeInfiniBand system hardware and software debugging. Theprobe connects to a copper 4xInfiniBand cable, allowing the16700 Series to trace and trigger on InfiniBand traffic from the physical 10b level,through 8b logical, and on to high-level InfiniBandprotocol-based measurements.

4x copper cables connect directlyto the N4217A analyzer probe.Additional SFP connectors allowthe use of SFP copper or optical1x modules.

You can define the logic analyzer triggers in terms of theInfiniBand packet protocol, andview measurement results asdecoded InfiniBand packets. You do not have to become anInfiniBand protocol expert totrigger the logic analyzer orinterpret the results. Theflexibility of the 16700 Seriesallows you to combine triggeringof high-level InfiniBand events with other logicanalyzer-measured events. Thisallows you to trigger and analyzedata from different sources andquickly narrow your search for aproblem. All of this can be donein real time with full systemloads so you can realisticallyexercise the system and be surethat your design works properly.

System-Level TestingBeyond validating the InfiniBandchannel, you can extend themodular 16700 Series to acquiretime-correlated data from otherparts of the system. Additionalprobes are available formeasuring other system busessuch as Rambus®, SDRAM andDDR memories, PCI, and PCI-X.Powerful microprocessoranalysis probes andinverse-assembly softwareprovide visibility into thesoftware running on an HCA or TCA. The modular nature ofthe 16700 Series logic analysissystem gives you the flexibility to measure a handful of signalsfor an isolated problem, or tomeasure thousands of signals tolocate a problem that spansmany domains.

For validation of 1x, 4x and 12xInfiniBand channels, the N4206Aprotocol analysis tool forInfiniBand (used with the 16700Series logic analysis system)reads the 10b data stream foreach byte lane and producesdecoded InfiniBand packets. Tocapture the 10b data, Mictor orSamtec connectors are used toprobe the 10b data goingbetween the SerDes(serializer/de-serializer) deviceand the InfiniBand controllerchip (such as HCA, TCA, orswitch) for each byte lane.

Figure 18. The N4217A trigger menu.

Figure 16. The 16702B logic analysissystem with touch screen.

Figure 17. Packet Decode.

Page 13: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

13

Related Literature

Publication Title Publication Type Publication Number

Signal Integrity Solutions Color Brochure 5988-5405EN

Agilent Infiniium DCA Oscilloscope Color Brochure 5968-8548E

Agilent 86100B Wide-Bandwidth Oscilloscope Technical Specifications 5988-5311EN

Should a Bit Error Ratio measurement be Color Brochure 5968-8547Ehard to make?

Agilent 86130 BitAlyzer Error Technical Specifications 5968-8545EPerformance Analyzer

Need to test BER? Complete solutions for Color Brochure 5968-9250Ehigh speed digital transmission testing

Agilent ParBERT 81250 Parallel Bit Product Overview 5968-9188EError Ratio Tester

Agilent E2950 Series for InfiniBand Product Overview 5988-1784EN

Agilent Technologies 16700 SeriesLogic Analysis System Product Overview 5968-9661E

Agilent Physical-Layer Test Systems Product Overview 5988-5288EN

VNA-Based System Tests the Physical Layer Application Note 1382-7 5988-5075EN

81133A and 81134A 3.3 GHz Pulse/Pattern Generators Data Sheet 5988-5549EN

InfiniBand System-Level Debugging Application Note 1382-1 5988-4225EN

Choosing the Right Signal Integrity Tools for InfiniBand Measurements White Paper 5988-6591EN

Passively Probing an InfiniBand System with anAgilent Technologies 16700 Series Logic Analysis System Product Note 5988-2857EN

8 Hints for Debugging and ValidatingHigh-Speed Buses Application Note 5988-5623EN

Instrument Connectivity Made Easy Color Brochure 5988-6527EN

www.agilent.com/find/InfiniBand

Page 14: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

14

86100B Infiniium DCA withTDR

50 GHz bandwidth

62.5 femtosecond time intervalresolution

1.7 picosecond RMS jitter

200 mVp-p sensitivity

300 MHz microprocessor runningWindows® 98

TDR Probe for InfiniBand 1x

5 GHz bandwidth calibrationterminations compatible with the86100A www.atspeed.net

54754A Differential TDR Module

2 channels (single-ended ordifferential)

12 GHz (TDR); 18-GHz (electrical)bandwidth

35 picosecond nominal TDR step rise time

+ 5%, –3% 1 ns from edge TDR step flatness

±0.4% of full scale dc accuracy

86101A Optical Module

2 (1 electrical and 1 optical) channels

12.4/20 GHz electrical; 3 GHz opticalbandwidth

750 to 860 nanometer wavelength

2 or 3 switchable filters

–17 dBm mask test sensitivity

Key Features and SpecificationsPhysical Layer Test Systems2 differential channels or 4 single-ended

Powerful analysis tools: time domainanalysis (TDR/TDT), frequencydomain analysis, eye diagrams, and RLCG transmission-line parameter extraction

N1947A/N1948A

300 kHz to 9 GHz

80 ps rise time

Greater than 100 dB dynamic range

N1951A

50 MHz to 20 GHz

35 ps rise time

Greater than 75 dB dynamic range

81134A Pulse GeneratorPulses, data patterns and PRBS datafrom 15 MHz to 3.35 GHz

Fast rise time <50 ps, low jitter < 2 ps RMS

PRBS from 25-1 to 231-1

Jitter generation up to 500 ps on theclock or data signals

1 or 2 output channels

LVDS levels can be addressed withoutput levels from 50 mV to 2.00 V

User defined data patterns can be created

Graphical user interface

Remote programming via GPIB, LANand USB

81250 ParBERTBit-rate coverage up to 10.8 Gb/s

Parallel input and output channels

Modular design

Generation of PRBS/PRWS up to 231–1

86130A BitAlyzer50 Mb/s to 3.6 Gb/s bit-rate coverage

Advanced error analysis

Excellent waveform

Up to 10 nm clock/data delay

Compatible with the Agilent 71501Cjitter analyzer

Page 15: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

15

www.agilent.com/find/InfiniBand

E2951A/E2952A ProtocolAnalyzer for InfiniBand 1x and 4xPreconfigured with either one or four2.5 Gb/s InfiniBand front-end modules

Analysis of dual-simplex packets

Up to 512 MB of memory

Packet time stamp with 8 ns resolution

Triggering on 0, 1, X pattern, Op Codes,Q-Pairs, etc.

Real-time error triggering on ICRC,VCRC, skip-ordered set error, CRCerror, running disparity error,alignment errors, end of bad packetcode, and invalid 10b code

Triggering on link-training sequences

Message-level or packet-sequencetriggering

Timing information represented asabsolute time stamp, time deltabetween time stamps, or idle timebetween packets

Interactive graphical user interfacewith trigger-, storage, filter- andsearch capabilities

MAD (management datagram)decoding

Real-time performance analysis

Adjustable trace memory depth of 512MB(1X) and 2 Gbytes(4X)

Record of skip-ordered sets

Ability to view packet level, operationlevel, 10-bit coders or as decodedManagement Datagrams (MADs)

E2953A/E2954A TrafficGenerator/Exerciser forInfiniBand 1x and 4xMonitoring of incoming traffic

Participation in link training

Transmission of idle data and skip-ordered sets

8 MB traffic-generator memory

Automatic CRC calculation and packet framing

8b/10b coding

Response to incoming packets withsoftware control

Error location for ICRC, VCRC, invalid headers, packet framing,disparity, 8b/10b

Generates and receives arbitraryInfiniBand packets

C++ & TCL scripting language

Graphical user interface

Automatically responds to incomingpackets in real time

Programmable inter-packet delay

Tests error recovery circuits

Maximum bandwidth data source ordata sink

Switch packet latency analysis

Record and replay

2 Mbytes transmit and 2 Mbytesreceive trace memory

Optional compliance test software

External triggering/synchronization

Real-time performance counters

N4217A Logic Analysis Probefor InfiniBand 1x or 4xCapturing and triggering onInfiniBand 1x or 4x traffic at 2.5 Gb/s(all fields in the InfiniBand protocol upto the transport layer are supported inthe trigger macro)

Viewing of InfiniBand protocol (theN4217A performs lane-to-lane link de-skew and displays packet datastriped across four lanes)

Loss-of-signal information provided by LEDs

Detection of 8b/10b coding, disparity,framing, and control-symbol errors

Filters allow different views of thedata (filtering on idles and payload data)

All packets or cells time-stamped inthe logic analyzer for time-correlationwith other system buses

InfiniBand Connections

Connection to 4x copper cables.Additional SFP connectors allow the use of SFP copper or optical 1x modules

N4206A Protocol AnalysisTool for InfiniBand 1x, 4x,and 12xDecoding of InfiniBand protocol fromcaptured 10b data for InfiniBand 1x,4x, and 12x links

Detection of disparity, VCRC, andICR errors

Display of byte lane skew amounts forInfiniBand 4x and 12x links

Filter protocol display of idle symbols,data, link packets, control symbols,and packet payloads

N4216A 4:1 Converter Box for InfiniBand2 each 4x copper connectors convertto 4 each 1x copper connectors

Page 16: Test Tools for InfiniBand - Keysightliterature.cdn.keysight.com › litweb › pdf › 5988-2424EN.pdf · Test Tools for InfiniBand TRADE ASSOCIATION. 2 ... QPs • Transport time

Agilent Technologies’ Test and Measurement Support, Services, and AssistanceAgilent Technologies aims to maximize the value you receive, while minimizing your risk andproblems. We strive to ensure that you get the test and measurement capabilities you paidfor and obtain the support you need. Our extensive support resources and services can helpyou choose the right Agilent products for your applications and apply them successfully.Every instrument and system we sell has a global warranty. Support is available for at leastfive years beyond the production life of the product. Two concepts underlie Agilent's overallsupport policy: "Our Promise" and "Your Advantage."

Our PromiseOur Promise means your Agilent test and measurement equipment will meet its advertisedperformance and functionality. When you are choosing new equipment, we will help youwith product information, including realistic performance specifications and practicalrecommendations from experienced test engineers. When you use Agilent equipment, wecan verify that it works properly, help with product operation, and provide basic measurementassistance for the use of specified capabilities, at no extra cost upon request. Many self-helptools are available.

Your AdvantageYour Advantage means that Agilent offers a wide range of additional expert test andmeasurement services, which you can purchase according to your unique technical andbusiness needs. Solve problems efficiently and gain a competitive edge by contracting withus for calibration, extra-cost upgrades, out-of-warranty repairs, and on-site education andtraining, as well as design, system integration, project management, and other professionalengineering services. Experienced Agilent engineers and technicians worldwide can helpyou maximize your productivity, optimize the return on investment of your Agilentinstruments and systems, and obtain dependable measurement accuracy for the life ofthose products.

www.agilent.com/find/consulting

By internet, phone, or fax, get assistance withall your test & measurement needs

Online assistance:www.agilent.com/find/assist

Agilent InfiniBand products:www.agilent.com/find/InfiniBand

Phone or FaxUnited States:(tel) 800 452 4844

Canada:(tel) 877 894 4414(fax) 905 282 6495

China:(tel) 800 810 0189(fax) 800 820 2816

Europe:(tel) (31 20) 547 2323(fax) (31 20) 547 2390

Japan:(tel) (81) 426 56 7832(fax) (81) 426 56 7840

Korea:(tel) (82 2) 2004 5004(fax) (82 2) 2004 5115

Latin America:(tel) (305) 269 7500(fax) (305) 269 7599

Taiwan:(tel) 0800 047 866(fax) 0800 286 331

Other Asia Pacific Countries:(tel) (65) 6375 8100(fax) (65) 6836 0252Email: [email protected]

Product specifications and descriptions in thisdocument subject to change without notice.

© Agilent Technologies, Inc. 2002Printed in USA August 28, 20025988-2424EN

www.agilent.com

www.agilent.com/find/emailupdatesGet the latest information on the products and applications you select.

Agilent T&M Software and ConnectivityAgilent's Test and Measurement software and connectivity products, solutions anddeveloper network allows you to take time out of connecting your instruments to yourcomputer with tools based on PC standards, so you can focus on your tasks, not on yourconnections. Visit www.agilent.com/find/connectivity for more information.

Rambus® is a trademark of Rambus Inc.Windows® is a registered trademark of Microsoft Corporation in the U.S. and/or other countries.

www.agilent.com/find/InfiniBand