22
MT57: Managing the data deluge by optimizing storage Alan Atkinson, General Manager, Dell Storage Solutions

Managing The Data Deluge By Optimizing Storage

Embed Size (px)

Citation preview

MT57: Managing the data deluge by optimizing storageAlan Atkinson, General Manager, Dell Storage Solutions

The big data opportunity

Organizations actively using data grow 50% faster than laggards.

50%

39% 42%( 2 0 1 4 ) ( 2 0 1 5 )

The number of organizations who understand the benefits of big data grew slightly.

Source: Dell Global Technology Adoption Index, 2015

44% of organizations still aren’t sure how to approach big data.

In organizations that have big data but are not yet using it, the top barrier is not knowing if the benefits are worth the cost.

In organizations currently using big data, the top barrier when extracting insights is the cost of the IT infrastructure.

29%

The second biggest barrier is securing the data, 28%.

20%

Source: Dell Global Technology Adoption Index, 2015

What is big data?

Capture

Manage

Analyze

Results in datasets too large or complex for typical database or data management tools to…

VolumeA large amount of data, growing at rapid rates

Information of increasing…

VelocityData that must be processed at high speed to facilitate rapid decisions

VarietyWide range of data types and structure

How data is moved and prepared

for analysis

Data integration, aggregation and transformation

Where data originates

Databases

Social media

Sensor data

Devices

LOB applications

Cloud

External sources

Where data is analyzed

Analytical engine

Business intelligence

In-memory computing

Enterprise data warehouse

Dell Storage has aligned its capabilities to address big data.

Comprehensive | Agile | Powerful | Scalable | Flexible

Customers

AnalyticsTurn data into better andfaster actionable insights

IntegrationMove data in real time betweenon and off premise sources

StatisticaStatistica Big Data

PowerEdgeDell Storage

Dell Networking

Dell BoomiToad Intelligence Central

ManagementServices Security Dell Financial ServicesInfrastructure

ToadCloudera Hadoop

ConsultingDesign

Deployment

SecureWorksSonicWall

FinancingLeasing

Asset recovery

Dell advantage: a complete big data and analytics portfolio

Ho

urs

Ho

urs

/Days

Days

/Ye

ars

Real-Time ProcessingApache SparkApache StormApache IgniteKafka

In Mem CacheRedisIMDGridHazelcast

In Mem FileSystemIgniteFSTachyon

Analytics StoreActianPivotalExadataAstor DataMarkLogicVertica

No-SQL BasedHbase MarkLogicMongoDB ElasticSerachCassandra

SQL BasedMemSQLVoltDB

Big data architecture

Real-time processing Operational store ArchiveOn the wire “Fast Data” Fast ingest and analytics Analytics storage

Data Sources

Data WarehouseTeradataDB2 WH

Diverse storage requirements

Performance/Latency Price/Performance Scale/TCO

Ho

urs

Ho

urs

/Days

Days

/Ye

ars

Big data architecture

Diverse storage requirements

Performance/Latency Price/Performance Scale/TCO

Real-time processing Operational store ArchiveOn the wire “Fast Data” Fast ingest and analytics Analytics storage

Data Sources

All flash arrays

In-Memory / NVME / SSD Servers-DAS Dense Servers

Scale out FS

SW Defined

SAN Arrays

Dell Storage strategy: anticipated trends

Converge to single stack architecture

Accelerate flash leadership

Build on software-defined storage

momentum

• Single architecture delivering seamless data flow across: Tier 0 All flash and hybrid flash Unified block & file Scale-out file and dense

storage

• Simple, common architecture from entry to enterprise

• Industry-leading Total Cost of Ownership

• Drive industry adoption with lowest $/GB.

• Flexible architecture combines performance with capacity.

• Future ready flash design accommodates new technology.

• Industry’s broadest portfolio of SDS solutions

• Hardened and functional SDS solutions running

• Runs on optimized hardware with Tier 1 global service and support.

Track Record

ProjectedFlash tiering

Track record

20162013 2014 2015

Projected flash prices

SC

Fla

sh P

ric

es

($/G

B)

Dell is leading the flash-optimized revolution.

Track Record

Projected

$-

$2.00

$1.00

$3.00

$4.00 MLC only

Compression 1.0

TLC Drives

Dedupe

Compression 2.0

Driving success and accessibility for flash

SSD capacity shipped in hybrid arrays, 1H14

Dell hybrid shipments now2x NetApp, 6x HP, 10x Nimble

Trajectory – SSDs capacity in hybrid arrays (TBs)

Dell year-over-year growth: 115%

Source: IDC Report: “Worldwide All-Flash Array and Hybrid Flash Array 2014–2018 Forecast and 1H14 Vendor Shares” November 2014, IDC #252304

Dell Storage architectureEnterprise class performance and scale

Server based tier 0 flash memory

Scale-out file• High performance• Large scale common

name space

Unified block & file mid-range array• General purpose

All flash and hybrid

Cost optimized archive• Fluid FS, dedupe,

compression dense solutions

• Industry standard hardware• Next generation virtualized storage stack• Integrations into traditional new paradigm

applications and environments

CommonArchitecture

Common ManagementEnterprise features

Multi protocol

SC Series: intelligent storage foundation

Dell software defined portfolio

Hyper-Converged Scalable SDS solutions

Choice: Broad portfolio of enterprise class infrastructure

Innovation: Optimized hardware and monitoring

Reliability and assurance: Global services and support

Dell XC Series Powered by Nutanix

Dell’s VSAN Ready Nodes &EVO:RAIL

Validated Dell HW + MS Storage Spaces

Dell ScalityRef Configs

Validated Dell HW + Nexenta SW

PowerEdge + RedHatCeph + Openstack

Hyper converged; Fast time to value;’Multi-Hypervisor

Hyper-converged; Integrated VMware

Management

OS Integrated storage with Integrated Windows Mgt

Flexible & cost effective for large scale Object & File

Highly flexible storage built on opensource ZFS

Opensource technology with Openstack ties

Justin Stottlemyer

Director, Distinguished Engineer Storage & Compute

Intuit’s approach to storage

• Tenets - Availability, Simplicity, Performance, Compression/DeDupe(Cheaper, Faster, Better)

• Tier 1 All Flash Array – OLTP, Customer facing

• Tier 2 Hybrid – Mixed Workload (NFS,CIFS)

• Tier 3 Hybrid – Auto-Tiering, Isolated ETL / DW

• Tier 4 Internal Cloud – Object / Archive / Backup

• Tomorrow – SDS (Software Defined Storage)

Current storage infrastructure

• Tier 2 - EMC VNX

• Tier 3 - Dell SC8000

• Tomorrow – SDS (Software Defined Storage)

• Compute / Storage - Including Cassandra, Hadoop, Elastic Search, JMS.

Database ETL results since implementing changes

The bottom line

• SLA is now always met

• Worst queries dropped from 17 minutes to 4 seconds.

• Up to 4000% improvement in some workloads

• On average 785% improvement

• No more phone calls

• Cheaper to deploy, better user experience, faster technology stack

Accelerate business, your way.

Start today

Schedule an enterprise IT consultation to learn how Dell future ready solutions can move your business forward.

For more information, please visit Dell.com/FutureReady

Thank you!