15
HIGH PERFORMANCE TECHNICAL COMPUTING HARDWARE. SOFTWARE. SERVICES. DESIGNED TO WORK TOGETHER Optimized Hadoop™ Solutions Lior Paster, Technical Sales Executive, [email protected] NASDAQ-OMX: SGI

Sgi hadoop

Embed Size (px)

DESCRIPTION

Overview from our sponsor, SGI on some of the solutions they have, and how they can be used to power datacenter and cluster scenarios

Citation preview

Page 1: Sgi hadoop

HIGH PERFORMANCE TECHNICAL COMPUTINGHARDWARE. SOFTWARE. SERVICES.

DESIGNED TO WORK TOGETHER

Optimized Hadoop™ SolutionsLior Paster, Technical Sales Executive, [email protected]

NASDAQ-OMX: SGI

Page 2: Sgi hadoop

SGI – Brief History

Experts in Scale-Out datacenters - since 1998 Better “Internet” servers, 40-50% lower power draw Invented “half-depth” servers Pioneered “back to back” rack mount for double density with

optimized air flow Invented “front facing I/O” to eliminate user errors Invented “rack-and-roll” for faster time to results Invented high efficiency “datacenter containers” Largest Hadoop clusters

~ $750M Annual Sales, and growing US-Based: HQ Fremont CA, Manufac. Chippewa Falls WI

2

Page 3: Sgi hadoop

SGI Technology @ WorkDIGITAL MEDIADIGITAL MEDIA

CLOUDCLOUD

ENERGYENERGY FINANCIAL SERVICESFINANCIAL SERVICESDEFENSE & INTELLIGENCEDEFENSE & INTELLIGENCE

MANUFACTURINGMANUFACTURING RESEARCH & EDUCATIONRESEARCH & EDUCATION ……AND MOREAND MORE

Page 4: Sgi hadoop

4

Past and Current Customers

Page 5: Sgi hadoop

SGI ComputeLeading solutions from scalable entry to hyper-scale and cloud

Shared Memory

High Performance InfiniBand

Scale-Out Datacenter

Scalable Entry

CR Rackable™

UV 10

UV 100

UV 1000Cloud, Big data, ScaleEco-LogicalDensityBTO

Large MemoryBig DataFast I/O

Rackable ICECapabilityCapacityCost-OptimizedMulti-TopologyChoice

Office friendlySelf-containedScalableLow IT needs

CR X2

Origin®400

Prism XL

Page 6: Sgi hadoop

6SGI “Rackable” servers at one of our customers … a well known Internet company

Page 7: Sgi hadoop

SGI StorageLeading solutions from cost to scalability and performance

RAID Systems

Persistent Data

Cloud Systems

Integrated Storage Servers

IS1000 Short-lived dataCost optimizedRedundancy Software RAID

COPAN™ •Long life data•Integrated, file accessible•Large Capacity•Eco-logical•High Density

•Half & Standard Depth•File serving•App Appliance•Cost or Performance optimized

ISS3500

Software: File systems (Lustre, CXFS™, XFS®), DMF, LiveArc™

IS2000

Entry Level (IS5000) Price/Performance LeaderEnterprise RAID (IS4600) Balanced Price/PerformanceHPC RAID (IS6120/15k/16k) Ultimate Performance/Throughput

ArcFiniti™ISS3012

Page 8: Sgi hadoop

8

Factory Integrated

Page 9: Sgi hadoop

Modular Data Centers: ICE Cube™

1 Self-contained datacenterPower distribution, cooling, safety

Eco-logical: PUEs up to 1.02Air, Evaporative, DX and Water-Chilled Cooling Options

Economical1/5 the cost of a traditional datacenter

2

3

4

5

Simple and easy to deployGo-Live in 5 days

Universal Support for SGI and all Tier-1 Hardware

Page 10: Sgi hadoop

Hadoop “Big Data” Solutions

Hadoop = BI and Data Analysis on Large Clusters Method:

– Data and Compute are distributed over many nodes– Data and Compute sit on each cluster node– (as opposed to traditional method of separate data and compute,

monolithic SAN, large compute…) SGI has deployed thousands of Hadoop servers SGI uses CloudRack, Rackable, ICE OPTIMIZED architectures -

– performance, utilization, lower power, and lower cost

+ = complete turn-key solutions to help customers architect and deploy Hadoop ASAP

10

Page 11: Sgi hadoop

11© 2011 SGI Proprietary

Building Hadoop Solution with SGI

Based on Servers with internal balanced CPU / memory / local storage; and balanced networking infrastructure.

We installed both INTEL and AMD solutions. We have recommended configurations Popular solution: Rackable C2005 half-depth chassis

2U design, optimizes airflow High density Great flexibility: up to 15TB storage, 144GB RAM, 24 cores...

A great feature when the datacenter is power-constrained - SGI is capable of power-capping individual servers AND complete racks with SGI Management Center and Intel Power Node Manager.

Page 12: Sgi hadoop

12

SGI Hadoop Servers

Sample hardware config -

Component Qty DetailsChassis 1 Rackable C2005

Motherboard 1 Intel Hanlen Creek

CPU 2 Intel Xeon L5640 6-core

Memory 12 8GB DDR3 1333

Disk 5 2TB SATA 3.5” 7.2KRPM

Page 13: Sgi hadoop

Resources

Hadoop Solutions Brief on http://www.sgi.com/go/hadoop/ White Paper: Increased Hadoop™ Optimization Using Intel®-based

SGI® Rackable™ Solutions Press Release: SGI Establishes New World Record Apache Hadoop

Benchmark Press Release: Cloudera and SGI Partner to Take High

Performance Computing on Apache Hadoop to the Next Level Technical Sales Assistance –

[email protected] http://www.linkedin.com/in/liorpaster www.twitter.com/x86world

Page 14: Sgi hadoop

14© 2011 SGI Proprietary

Summary

SGI servers are used in many large Hadoop clusters

SGI offers Turn-key Hardware and Software for Hadoop, with Cloudera

Most optimized solution Local sales team and support

Page 15: Sgi hadoop

15© 2011 SGI Proprietary15