Gluster Webinar: Introduction to GlusterFS

Introduction To GlusterFS

Audio is available via VoIP or Landline.

For VoIP

You will be connected to audio using your

computer‟s speakers or headset.

For Landline:

Please select Use Telephone after joining the

Webinar.

US/Canada attendees dial (805) 309-0021

Access Code 232-976-193

A Better Way To Do Storage 2

John Kreisa Vice President

Marketing

Gluster, Inc.

Tom TrainerDirector

Product Marketing

Gluster, Inc.

Jacob Shucart Senior Systems Engineer

Gluster, Inc.

Today’s Speakers


Poll Question

Are you using GlusterFS today?– Yes, in a test environment

– Yes, it‟s deployed in a production environment

– No, however we are considering it

– Just researching


History of Gluster

How it all started– Backgrounds in high performance, clustered computing

– Working at Lawrence Livermore National Labs

• AB Periasamy & Hitesh Chellani design “Thunder”

• One of the worlds fastest super computers

• On Intel commodity hardware

• Solved filesystem scalability and performance limitations

– Large customer in oil & gas persuaded them to focus on storage

– Gluster founded by Hitesh & AB to bring technology to market

Result: award winning technology

Thunder


What is the Gluster File System?

A scale-out file system for Network Attached Storage (NAS)

– Highly available

– Linearly scalable performance

GlusterFS provides

– Flexibility to deploy in ANY

environment

– Scalability to Petabytes & beyond

– Superior storage economics


GlusterFS Architecture Design Goals

Elasticity – Flexibility adapt to growth/reduction

– Add, delete volumes & users

– Without disruption

Scale linearly – Multiple dimensions

• Performance

• Capacity

– Aggregated resources

Eliminate metadata– Improve file access speed

Simplicity – Ease of management

– No complex Kernel patches

– Run in user space

Capacity

Per

form

ance


Key Differentiators

Filesystem runs in user space

Software only

Open source

Modular, stackable storage OS architecture

Data stored in native formats

No metadata – Elastic hashing


User Space

Filesystem Runs in User Space

GlusterFS

Server(CPU/Mem)

1 TB

1 TB

1 TB

1 TB

1 TB

1 TB

1 TB

1 TB

1 TB

1 TB

1 TB 1 TB

Kernel

1 TB 1 TB

Not tied to kernel

No reassemblies

Independence


Software Only

Hardware agnostic

Superior storage economics & flexibility – Data center / private cloud use commodity hardware

– Public cloud – i.e. AWS, RackSpace, GoGrid – pay for only what you need

No lock-in– Hardware vendors-at purchase time or in the future

– Public or private cloud

– Performance, capacity, or availability levels

– GlusterFS – not proprietary, files are stored in native formats (i.e. EXT4)


Open Source

200,000+ downloads– ~12,000 /month

500+ registered deployments– 45 countries

2,500+ registered users– Mailing lists, Forums, etc.

Active community– Diverse testing environments

– Bugs identification and fixes

– Code contributions

Member of broader ecosystem– OpenStack, Linux Foundation, Open

Virtualization Alliance

Global Adoption


Modular, Stackable Storage OS Architecture

NAS protocols

Replication

Global namespace

Clustered & replicated

Built-in failover

Self healing

POSIX compliant

No metadata server

Elastic hash

Thin provisioning

Flexible storage configurations

NFS, CIFS, GlusterFS, HTTP(s), WebDAV, (S)FTP

Interface – Protocols - Replication

Services to the public network

Gluster Server

Public Network | Storage Server Network1Gb, 10Gb, Infiniband

64-bit Linux distributionsRHEL, Fedora, Debian, CentOS, Ubuntu, SUSE

Unlimited number of filesElastic hash function

Native format ext3 or ext4 recommended / POSIX compliant

Disk storage Local to host(Gluster Server), SAS, SATA, SCSI attached JBODs, Fibre

Channel supportedISCSI supported – for low I/O Apps


Elastic Hashing

No metadata server

An algorithmic approach– Unique hash tag for each file stored

– Tags stored within the file system

– Rapid file read – low latency

Figure 1

Figure 2Figure 3

*Figures 1,2,3 are examples only


A Standard Gluster Deployment

Standard clients

running standard apps

Over any standard IP

network

Access application

data, as files & folders,

in a global namespace,

using a variety of

standard protocols

Stored in a

commoditized,

virtualized, scale-out,

centrally managed pool

DAS, SAN, NAS

Gluster Global Namespace (NFS, CIFS, Gluster Native)

Application data

Clients/Apps Clients/Apps Clients/Apps

IP Network

VMs VMDK VMDK

virtual storage pool


Unifying Public and Private Cloud Storage

Client/AppsClient/Apps

Private Cloud Public Cloud

Replication

Gluster Global Namespace




Client/Apps

IP Network


Deployment Scenarios Common Solutions Built on GlusterFS

Media serving (CDN)

Large scale file storage

Tier 2 & 3 archive

File sharing

Multi-tenant file systems

Storage for High Performance

Computing (HPC)

IaaS storage layer

Disaster recovery

Backup & restore

Private cloud


Pandora Internet Radio

Problem• Explosive user & title growth

• As many as 12 file formats for each song

• „Hot‟ content and long tail

Solution• Three data centers, each with a six-node

GlusterFS cluster

• Replication for high availability

• 250+ TB total capacity

Benefits• Easily scale capacity

• Centralized management; one administrator

to manage day-to-day operations

• No changes to application

• Higher reliability

• 1.2 PB of audio served

per week

• 13 million files

• Over 50 GB/sec peak

traffic


Brightcove

Problem• Cloud-based online video platform

• Explosive customer & title growth

• Massive video in multiple locations

• Costs rising, esp. with HD formats

Solution• Complete scale-out based on commodity

DAS/JBOD


• 1PB total capacity

Benefits• Easily scale capacity

• Centralized management; one administrator

to manage day-to-day operations


• Path to multi-site

• Over 1 PB currently in

Gluster

• Separate 4 PB project

in the works


Cincinnati Bell Technology Solutions

Problem• Host a dedicated enterprise cloud solution

• Large scale VMware environment

• Need high availability

Solution• Gluster for VM storage, NFS to clients

• SAS drives on back-end


Benefits• Storage provisioning from 6 wks to 15 min.

• Vendor agnostic storage

• Low cost of service delivery

• Elastic growth

• Large scale VM

storage

• Low cost service

delivery for enterprise

customer

• Drastic reduction in

provisioning time


Problem• Capacity growth from 144TB to 1+PB

• Multiple distributed users/departments

• Multi OS access - Windows, Linux and Unix

Solution• GlusterFS Cluster

• Solaris/ZFS/x4500 w/ InfiniBand

• Native CIFS/ NFS access

Benefits• Capacity on demand / pay as you grow

• Centralized management


• OPEX decreased by 10X

Partners Healthcare

• Over 500 TB

• 9 Sun “Thumper”

systems in cluster

Private Cloud: Centralized Storage as a Service


4 Supported Ways to Consume GlusterFS

Virtual Machines– GlusterFS deployable on the leading virtual machines

Amazon Web Services (AWS)– GlusterFS deployed within Amazon Machine Image (AMI)

RightScale Cloud Management – GlusterFS is available within a RightScale ServerTemplate

– Deployable via the RightScale Cloud Management Dashboard

Storage software appliance– Deployable on bare metal and supports any hardware on the Red Hat Hardware

Compatibility List (HCL) of certified servers and storage


Select Gluster Customers

http://upload.wikimedia.org/wikipedia/en/5/52/Kaltura_Logo.png


Summary

GlusterFS – A scale-out NAS file system

Flexibility, scalability, superior economics

Innovative architecture provides a better way to do

storage


Your turn - ask our experts

Questions and Answers

Try Gluster for free here: http://www.gluster.com/trybuy/

Additional resources here: http://www.gluster.com/products/resources/

Join the community: http://www.gluster.org/

Follow on twitter: @gluster.

Read our blog: http://blog.gluster.com/

Contact us at: [email protected] or 1-800-805-5215

http://www.gluster.com/trybuy/

http://www.gluster.com/trybuy/

http://www.gluster.com/products/resources/

http://www.gluster.org/

http://blog.gluster.com/

mailto:[email protected]