The Zettabyte Filesystem – a Commercialization Breakthrough With NEXENTASTOR

8/14/2019 The Zettabyte Filesystem – a Commercialization Breakthrough With NEXENTASTOR

http://slidepdf.com/reader/full/the-zettabyte-filesystem-a-commercialization-breakthrough-with-nexentastor 1/26

Click to edit Master subtitle style

10/19/09

The Zettabyte Filesystem – A commercializationbreakthrough withNEXENTASTOR

Heoh Chin FahSenior Consultantnext-IQ Solutions([email protected])



10/19/09

Agenda

File Systems

Introduction to ZFS

ZFS’s ability Introduction to Nexenta

The Collaboration

The Business Model

The New World – Nexenta success



10/19/09

Overview of File Systems

In the world of computer data storage, the FileSystem is a very important component

We have

• NTFS file system in Windows

• ext3/ext4 file system in Linux

• ISO9660 for CD-ROM

• Others

Wikipedia listed more than 100 types of filesystems – each with its reasons and functions



Click to edit theoutline text format

Second Outline

Level

− Third OutlineLevel

FourthOutlineLevel

− Fifth

Outline10/19/09

Overview of File Systems

File systems

• Store data intellligently

• Retrieve data intelligently

• Organize data intelligently

File systems mask the complexityof physical computer storage. Wecan view them as

• Virtualization

• Abstraction

• A Refrigerator (?)



10/19/09

The problem with today’s FileSystems

Most file systems have

• Scalability issues – a limit that does not meet today’s demand for morestorage space

• Management issues – too complex to manage

• Dependency issues – 1-to-1 relationship between HDDs and the file

system

• Data integrity issues – what you store might not be what you retrieve



10/19/09

Partitions

Partitions

Partitions

The problem with today’s FileSystems

Partitions

Partitions

Partitions

PartitionsPartition

s

FileSystem

FileSystem

FileSystem

Operating System

Volume Management

Space Utilization

Uneven

Limited

Scalability

AddedComplexity

Passive Data IntegrityChecks

File SystemsDependency to

HDDs



10/19/09

Introduction to ZFS

ZFS – Zettabyte File System

A combination of intelligent file system

and logical volume manager released bySun Microsystems in 2005 forOpenSolaris and GA in Solaris 10 in 2006

A mature and proven, 128-bit file system

Freely available for Solaris, Linux,MacOS X, FreeBSD and NetBSD ( Yup, itFREE)



10/19/09

What does 128-bit mean?

103, kilo = thousands

106, mega = millions

109, giga = billions 1012, tera = trillions

1015, peta = quadrillions

1018, exa = quintillions

1012, zetta = sextillions

1024, yotta = septillions



10/19/09

What does 128-bit mean?

File System Max File Size Max Volume Size

Solaris UFS Up to 32Petabytes

Up to 1 Yottabyte

Linux ext3 Up to 2 Terabytes Up to 32Terabytes

Linux ext4 Up to 16Terabytes

Up to 1 Exabytes

Windows FAT32 4 Gigabytes Up to 8 TerabytesWindows NTFS 16 Exabytes 16 Exabytes

ZFS 16 Exabytes 256 Pebi-Zebibytes

3.4028236692093846346337460743177 x 1038 bytes !!!



10/19/09

ZFS StoragePool

Introduction to ZFS

Partitions

Partitions

Partitions

Partitions

Partitions

Partitions

PartitionsPartition

s

FileSystem

FileSystem

FileSystem

Operating System

Volume Management

ZFS FileSystem

ZFS FileSystem

ZFS FileSystem



10/19/09

ZFS Storage Pool (zpool)

ZFS Storage Pool

File

System

File

System

File

System

Operating System

ZFS FileSystem

ZFS FileSystem

ZFS FileSystem

SAN

LA

N

NFS

iSCSILUN

FibreChannel LUN

• No longer has harddisks dependency• Very flexible



10/19/09

ZFS Storage Pool(Hybrid Storage Pool)

The end of proprietary hardware. Use Solid State Disksto build software cache

zpool can be further defined into Hybrid Storage Pool

• ZFS Intend Log (fast write caching – performance)

• Read Cache Pool (fast read caching – performance)

• HDD pool (the rest of the data)

Software-based caching

Reduce cost of HW

ZILRea

dCache

HDDPool



10/19/09

zpool very large capacity

264 snapshots (online, point-in-timecopy)

248 number of files 264 devices



10/19/09

RAID-Z, RAID-Z2, RAID-Z3

Overcomes RAID-5 “write hole” problem usinga Copy-on-Write technology

New data blocks are created in free space andusing ZFS file systems pointers to keep track of contiguity

Double and even triple parity protection withRAID-Z2 and RAID-Z3



10/19/09

The Silent Killer

Silent data corruption – it’s worse thanyou know

CERN (European Center for NuclearResearch) released a 2007 paper onsilent data corruption

• CERN generates 15,000TB of data in 2008

• File Corrupted ~ 38,000 files



Click to edit theoutline text format

Second Outline

Level

− Third OutlineLevel

FourthOutlineLevel

− Fifth

Outline10/19/09

Silent Data Corruption

It can happen anywhere along the data path

ZFS is the first file system to offer end-to-end data

integrity that can detect and correct silent datacorruption

CERN has about 38,000 corrupted files per year in15,000 TB



10/19/09

Introduction to Nexenta

Based out of Mountain View, California USA and Dresden, Germany

Founded by

• Alex Aizman

• Dmitri Yusopov

Both founders are the co-creator of the iSCSI-

stack in the Linux Kernel in 2005

Both founders co-created the TCP/IP OffloadEngine architecture for Linux



10/19/09

NexentaCore andNexentaStor

NexentaCore is totally open source which incorporated OpenSolaris kernel (along with ZFS) and Ubuntu user space

NexentaStor is the commercial version focused on enterprise storage with someadditional codes

Best of all worlds

• OpenSolaris kernel – robust, mature kernel with a world-class file system in ZFS

• Ubuntu user-friendliness and the APT package management architecture

• Added in closed codes for features like replication, remote management, HA



10/19/09

The Business Model

My objective today is not so much about Nexenta butmore about the business model

It’s a whole new world

• Collaborative – USA, Germany, all over the world where codersconvene and contribute to NexentaCore

• Free codes – taking advantage of what the FOSS (Free OpenSource Software) is offering

• Lower cost, better value – ending customer’s storage vendorproprietary lock-in

• Distribute freely – building market share and loyalty with users

• Speed – collaborative efforts leads to faster bug fixing, and new

releases



10/19/09

The Business Model

Nexenta’s concept gives you a CHOICE

• You can build your own Enterprise Storage

Nexenta’s concept helps you BREAK FREE of the proprietary storage hardware

Nexenta’s concept gives you flexibility tocontrol your cost of hardware acquisition andcost of software support & maintenance



10/19/09

Comments on the BusinessModel

“Fostering a group of brilliant people who appreciate ideas and bring out thebest out of their team”

“As soon as you exert brute force, youdestroy the very community that bringsyou success”

Comments by Jim Whitehurst, CEO of RedHat Inc.



10/19/09

Comments on the BusinessModel

Efforts like Nexenta’s are propelling storageinto the twenty first century—much like RedHatdid for the server industry with Linux. - Terri

McClure, ESG July 2009

Open storage is here. It is important, it is viable, and now, with automated highavailability functionality and 24 x 7 support,NexentaStor is enterprise ready. - Terri

McClure, ESG July 2009



10/19/09

A new world – Nexentasuccess

This new type of business model hasresulted in Nexenta’s success

• 600+ customers in 15 months since its inceptionin 2008

• 15,000 users worldwide



10/19/09

A new world for Malaysia

Look at the business model and emulate

Look at the pool of local and global opensource talents

Look deeper into the value into internalsystems rather than developing applications

Look deeper into developing core protocols

for technology innovation and collaborate

Propel Malaysia into a different plateau



10/19/09

Free CDs

Ask for me for Free NexentaStor TrialCDs



10/19/09

THANK YOU

Documents

The Zettabyte Filesystem – a Commercialization Breakthrough With NEXENTASTOR