28
Forging a Future in Memory: Ed Doller New Technologies, New Markets, New Applications Ed Doller V.P. Chief Memory Systems Architect Non-Vol ati l e Memory Seminar Hot Chips Conference August 22, 2010 Memorial Auditorium Stanford University © 2010 Micron Technology, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners. © 2010 Micron Technology, Inc. | 1 July 27, 2010

Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Forging a Future in Memory:

Ed Doller

New Technologies, New Markets, New Applications

Ed DollerV.P. Chief Memory Systems Architect

l lNon-Volatile Memory SeminarHot Chips ConferenceAugust 22, 2010Memorial AuditoriumStanford University

© 2010 Micron Technology, Inc. All rights reserved. Products are warranted only to meet Micron’s production data sheet specifications. Information, products, and/or specifications are subject to change without notice. All information is provided on an “AS IS” basis without warranties of any kind. Dates are estimates only. Drawings are not to scale. Micron and the Micron logo are trademarks of Micron Technology, Inc. All other trademarks are the property of their respective owners.

© 2010 Micron Technology, Inc. | 1July 27, 2010

Page 2: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Legal Disclaimer

INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH MICRON™ PRODUCTS. NO LICENSE, EXPRESS ORIMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPTAS PROVIDED IN MICRON'S TERMS AND CONDITIONS OF SALE FOR SUCH PRODUCTS, MICRON ASSUMES NO LIABILITYWHATSOEVER AND MICRON DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY RELATING TO SALE AND/OR USE OFWHATSOEVER, AND MICRON DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OFMICRON PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE,MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.

Micron products are not intended for use in medical, life saving, life sustaining, critical control or safety systems, or in nuclear facilityapplications.

Micron may make changes to specifications and product descriptions at any time, without notice.Micron may have patents or pending patent applications, trademarks, copyrights, or other intellectual property rights that relate tothe presented subject matter The furnishing of documents and other materials and information does not provide any licensethe presented subject matter. The furnishing of documents and other materials and information does not provide any license, express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual property rights.Designers must not rely on the absence or characteristics of any features or instructions marked “reserved” or “undefined.” Micron reserves these for future definition and shall have no responsibility whatsoever for conflicts or incompatibilities arising from future changes to them.Contact your local Micron sales office or your distributor to obtain the latest specifications and before placing your product order.Contact your local Micron sales office or your distributor to obtain the latest specifications and before placing your product order.Copies of documents which have an order number and are referenced in this document, or other Micron literature may be obtained by visiting Micron's website at http: / /www.Micron.com.* Other names and brands may be claimed as the property of others.

© 2010 Micron Technology, Inc. | 2July 27, 2010

Page 3: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Technology Lifecycle

EarlyMajority

LateMajority

Earlyd

I nnovators

AdoptersLaggards

NORNANDPCM

© 2010 Micron Technology, Inc. | 3July 27, 2010

Page 4: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

NOR Scaling

Tt

floating-gate

traps

tunnel oxide Silicon

traps

NOR R li bilit W it / ENOR (ETOX & NROM) S li NOR Reliability: Write / Erase Tox traps leading to TAT or de-trapping of trapped oxide electrons

NOR (ETOX & NROM) Scaling:3.2ev required to surmount Si-SiO2 barrier Æ Limits Cell Gate Length Scaling

2011 2012 201320092008 2010 2014 2015+

NOR65nm

45nm

© 2010 Micron Technology, Inc. | 4July 27, 2010

NOR 45nm32nm ?

Page 5: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

NAND Scaling

NAND Electron Scaling10000

30120Endurance & ECC Scaling

2007

2006

2004

1000

10000

ns 15

20

25

60

80

100

nce

(K)

CC

20122011

20102009

2008100

# E

lect

ron

5

10

15

20

40

60

Endu

ran EC

1020406080100

Litho Node

2011 2012 201320092008 2010 2014 2015+

0090 70 60 50 40 30 20

Litho Node

NAND4xnm

3xnm2

2011 2012 201320092008 2010 2014 2015+

© 2010 Micron Technology, Inc. | 5July 27, 2010

2xnm

Page 6: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

The 10’s

NOR / NAND / DRAM/ /

• The technology “Brick Wall”

• What can / should we do about it?

• What’s beyond the brick wall?

© 2010 Micron Technology, Inc. | 67/27/2010

y

Page 7: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Phase Change Memory• Storage

Ⴇ GST: Germanium-Antimony-Tellurium Chalcogenide glass

Ⴇ Cell states varying from amorphous (high resistance) to

Crystalline AmorphousႧ Cell states varying from amorphous (high resistance) to

crystalline (low resistance) states

• Read OperationႧ Measure resistance of the GSTႧ Measure resistance of the GST

• Write OperationႧ Heat GST via current flow (Joule effect)

Time at critical temperature determines cell state

IIႧ Time at critical temperature determines cell state

T Reset (amorphization)ture

T Reset (amorphization)

VV0.75

Crystal Amorphous

Ti

Tx

T ( p )

Set (crystallization)

TiTem

pera

t

x

Tm

( p )

Set (crystallization)0.25

0.50

Vth

Cur

rent

[mA

]

© 2010 Micron Technology, Inc. | 7July 27, 2010

TimeTimeTTemperature during write

0.0 0.5 1.0 1.50.00

Voltage [V]

Page 8: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Memory CharacteristicsPCM Offers Attributes of RAM & NANDPCM Offers Attributes of RAM & NAND

Good

DRAM

Not

PCM

it ee ce d cyte cy n- tyal st

GoodNAND

BiAl

tera

bl

Wri

t eEn

dura

nc

Rea

Late

nc

Wri

tLa

tenc

Non

Vola

tilit

Theo

reti

caCo

s

© 2010 Micron Technology, Inc. | 8July 27, 2010

T

Page 9: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Performance & Density ComparisonsCirca 2011, 45nm Silicon

Attributes DRAM PCM NAND HDDN V l il N Y Y YNon-Volatile No Yes Yes Yes

Idle Power ~100mW/GB ~1 mW/GB ~1 mW/GB ~10W

E / P Si N / 64B t N / 32B t Y / 256KB No / Erase / Page Size No / 64Byte No / 32Byte Yes / 256KB 512Byte

Write Bandwidth ~GB/sper die

50-100 MB/sper die

5-40 MB/sper die

~200MB/sper drive

Page Write Latency 20-50 ns ~1 us ~500 us ~5 ms

Page Read 20 50 ns ~70 ns ~25 µs ~5 msgLatency 20-50 ns ~70 ns ~25 µs ~5 ms

Endurance � 106 Æ 107 105 Æ 104 �

Maximum Density 4Gbit 4Gbit 64Gbit 2TByte

© 2010 Micron Technology, Inc. | 9

Maximum Density 4Gbit 4Gbit 64Gbit 2TByte

Page 10: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Theoretical Cost

© 2010 Micron Technology, Inc. | 10July 27, 2010

Page 11: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Theoretical Chip Cost Factorsp

Silicon Cost Component SLC PCM DRAM SLC NANDDie Size Cell Size (F2) 5.5 6.0 5.0

4G Prod Example 1.0x 1.2x 1.0x

Wafer Total Process M k C t

~35 ~34 30Complexity Mask Count

300mm cost structure

1.2x 1.2x 1.0x

Theoretical Die Cost Summary 1 2x 1 4x 1 0xTheoretical Die Cost Summary 1.2x 1.4x 1.0x

• PCM will be cheaper than DRAM at lithography parity

• PCM scales to lower densities better than NAND

• PCM attributes can also save cost at system level

© 2010 Micron Technology, Inc. | 11

y

Page 12: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Bit Alterability

© 2010 Micron Technology, Inc. | 12July 27, 2010

Page 13: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Bit AlterabilityRidiculously SimpleRidiculously Simple

I have a new mobile number: NAND PCM

1. Read 4KB from NAND w/ECC 1 Write 1 bit in PCM

mobile number:(555) 555-5554 NAND PCM

2. Write to RAM

3. Modify RAM

1. Write 1 bit in PCM

Much less bus traffic4. Locate new NAND page

5. Write new NAND page

6. Calculate & Write ECC

Much less bus traffic“Hidden” Power

Ridiculously Simple6. Calculate & Write ECC

7. Mark old NAND page “dirty”

8. Eventually erase NAND block

© 2010 Micron Technology, Inc. | 13July 27, 2010

Page 14: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Endurance & Retention

© 2010 Micron Technology, Inc. | 14July 27, 2010

Page 15: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

ReliabilitySystem ImplicationsSystem Implications

High

emen

ts

tions

olut

ions

Medium

on R

equi

re

Si S

olut

Read Endurance Retention

Syst

em S

o

Low

Appl

icat

io

Read Endurance Retention

Endurance Retention Read S

72nm 55nm 35nm 25nm

Multi-Media(MP3, USB, Memory Card)

Wireless(Code Execution, Data Storage)

Computing(Cache, SSD)

SLC / MLC

© 2010 Micron Technology, Inc. | 15July 27, 2010

Page 16: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

EnduranceScalabilityScalability

1 000 000PCM

800,000

1,000,000

600,000

20X

rase

Cyc

les

200 000

400,000NAND

Er

0

200,000

© 2010 Micron Technology, Inc. | 16July 27, 2010

2010 2012 2014 2016Source: My Estimates

Page 17: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Data RetentionHistorical ViewHistorical View

“Endurance is a measure of the ability of a nonvolatile

10 yr at “ low cycles”1 yr at data sheet200k year?

memory device to meet its data sheet specifications as a function of accumulated nonvolatile data rewrites or program/erase cycles.”

y10 year

(with sticker)

200 ka 1971 1998

p g / y

2006

© 2010 Micron Technology, Inc. | 17July 27, 2010

News Flash: PCM Retention is NOT a function of endurance

Page 18: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

EnduranceSSD: Fast Growing SegmentSSD: Fast Growing Segment

$4

$5

$2

$3

Billi

ons

$1

$2B

$0

2009 2010 2011 2012 2013

© 2010 Micron Technology, Inc. | 18July 27, 2010

Source: iSupply, Dec 2009

Enterprise Notebook

Page 19: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

InterfacesGetting Faster

8

Getting Faster

6

4

GB/s

0

2

0SATA 1 SATA 2 SATA 3 SAS PCIe 1 PCIe 2 PCIe 3

© 2010 Micron Technology, Inc. | 19July 27, 2010

Note: PCIe x8

4GB/s at 90/10 Read/Write Equates to 34TB’s per day

Page 20: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

System SolutionsEndurance vs DensityEndurance vs. DensityPCIe2

1600acity

90/10

800

1200

r�64GB�Capa

nsity

90/10

400

800

ual�G

B's�for

NAND

20X

De

5 yrs

0

Actu

PCM

NAND5 yrs

© 2010 Micron Technology, Inc. | 20July 27, 2010

2010 2012 2014 2016

Page 21: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Latency

© 2010 Micron Technology, Inc. | 21July 27, 2010

Page 22: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Performance Bandwidth vs. LatencyBandwidth vs. Latency

Bandwidth“Add More”

Latency

0 60 h Æ 10 4 0 60 h Æ 3 5

Latency“Add Something Faster”

© 2010 Micron Technology, Inc. | 22July 27, 2010

0-60mph Æ 10.4s$20,000

0-60mph Æ 3.5s$200,000

Page 23: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

Application to ComputeApproach is ChangingApproach is Changing

CPU RAM DI SK TAPEDI SK

ns / GB ms / TB s / PB

Bandwidth Improvement

Latency Improvement or

CPU RAM DI SK TAPESSD

© 2010 Micron Technology, Inc. | 23July 27, 2010

ns / GB ms / TB s / PBus / GBAll logos or trademarks are the property of their respective owners

Page 24: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

PerformanceRelatively SpeakingRelatively Speaking

PCM If R d L t 1 dPCM

SSD

I f Random Latency = 1 day

Then latency = 17 daysSSD

HDD Then… latency = 9 years

Then… latency = 17 days

SCM PCM

HDD

Then… latency = 30 min

Then… latency 9 years

Storage Class PCM can perform > 800 database searches in the time it takes an SSD to do 1

© 2010 Micron Technology, Inc. | 24July 27, 2010

base searches in the time it takes an SSD to do 1

Page 25: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

LatencyValue goes up with information growthValue goes up with information growth

“… every 100ms of latency cost them 1% in sales”Source: http: / /highscalability.com

“…an extra 500ms in search pagegeneration time dropped traffic by 20% ”g pp y

Source: http: / / royal.pingdom.com

“… a broker could lose $4 Million Dollars permillisecond if their electronic trading platform ismillisecond if their electronic trading platform is5ms behind the competition”

Source: http:/ / highscalability.com

CPU RAM DI SK TAPESSDPCM

© 2010 Micron Technology, Inc. | 25

ns / GB ms / TB s / PBus / GBns / GB

July 27, 2010

All logos or trademarks are the property of their respective owners

Page 26: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

LatencyStill Not Convinced?Still Not Convinced?

© 2010 Micron Technology, Inc. | 26July 27, 2010

Page 27: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

PCMIndustry Demands Will Drive ChangeIndustry Demands Will Drive Change

Bit AlterableRidiculously

Simple

EnduranceHigh ReliabilityUsage ModelsSimple Usage Models

Latency RetentionLatencyI nstant Access

RetentionNot a functionOf Endurance

© 2010 Micron Technology, Inc. | 27July 27, 2010

Page 28: Forging a Future in Memory - Hot Chips...express or implied, by estoppel or otherwise, to any such patents, trademarks, copyrights, or other intellectual pr operty rights. Designers

July 27, 2010