41
MRAM, XPoint, ReRAM PM Fuel to Propel Tomorrow’s Computing Advances Jim Handy Objective Analysis Tom Coughlin Coughlin Associates

MRAM, XPoint, ReRAM PM Fuel to Propel Tomorrow’s ...€¦ · MRAM, XPoint, ReRAM PM Fuel to Propel Tomorrow’s Computing Advances. Jim Handy. Objective Analysis. Tom Coughlin

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

MRAM, XPoint, ReRAMPM Fuel to Propel

Tomorrow’s Computing AdvancesJim Handy

Objective AnalysisTom Coughlin

Coughlin Associates

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

PM

The Market is at a Nexus

2

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Technologies

MRAM: Magnetic RAMReRAM: Resistive RAMPCM: Phase-Change Memory (i.e. 3D XPoint)FRAM: Ferroelectric RAMEtc.

All are nonvolatile memories: “NVM”

3

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

What We learned at IEDM

The field has not narrowed:MRAM, PCM, ReRAM, & FRAM all well represented

First big application is still unclearEmbedded NVM? Stand-alone? Embedded RAM? Neural nets?Everybody points to ballooning “Big Data”

Everybody’s participatingSamsung, SK hynix, Micron, Toshiba, Intel, TSMC, Macronix, etc.

Flash might not be dead after all4

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Papers By Type

Technology Papers

Flash 9

RAM 3

MRAM 13

ReRAM 17

FRAM 30

PCM 9

Neural Nets 25

5

Neural Nets and FRAM take the prize

FRAM’s suddenly “New” again!MRAMs had a conference of their own after IEDM

10 more presentationsReRAM well representedFlash coverage surprising

It’s not dead yet!

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

What We learned at IRDSRebooting Computing and elsewhere

IEEE events in November 2018 near Washington, D.C.End of Moore’s Law scaling leading to new Computing Models

Approximate ComputingAdiabatic ComputingNeuromorphic Computing (often using emerging memory technologies)Quantum Computing

Rise of new architectures like RISC-VDevelopment of special purpose application accelerators

6

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Report

Why Emerging Memories are NecessaryUnderstanding Bit SelectorsThe TechnologiesProcess Equipment RequirementsEmerging Memory CompaniesForecasting Emerging Memories

Now available for online purchase7

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Why Emerging Memories are Necessary

Flash can’t scale with process advancesNAND flash went 3D at 15nm

3D is not cost-effective in a CMOS logic process

NOR scaling stops with FinFET28nm & smaller processes need something new

Low DRAM densities load down the memory busAI is expensive on a von Neumann machine, hence new computer architectures

8

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

How Scaling Limits Help New Memories

9

$0.01

$0.10

$1.00

$10.00

$100.00

$1,000.00

500nm250nm

130nm65nm

32nm16nm

8nm4nm

2nm

Process Geometry

Rela

tive

Cost

FlashNew Tech

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Biggifying Memory with DRAM

10

Bus Signal

8GbDRAM

8GbDRAM

8GbDRAM

8GbDRAM

8GbDRAM

8GbDRAM

SNIA has made important contributions!

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Biggifying Memory with 3D XPoint

11

Bus Signal

8GbDRAM

SNIA has made important contributions!

128GbXPoint

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Simplifying AI

12

R1

R2

R3

R4

V1

V2

V3

V4

=V1*(1/R1)+V2*(1/R2)+V3*(1/R3)+V4*(1/R4)

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Simplifying AI

13

R1

R2

R3

R4

V1

V2

V3

V4

=V1*(1/R1)+V2*(1/R2)+V3*(1/R3)+V4*(1/R4)

64Kb Array = 256 sumsof 256 Multiplies EACH!

All in a single cycle.Should SNIA participate in this?

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Big Data Analytics

A big topic at Rebooting ComputingGraph problems: High Communication/Computation ratioFeature recognition: Works OK with low precision (i.e. Analog)

14

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Lightspeeur® 2802M, Production AI Accelerator Chip with MRAM (from 2019 CES)

15

Includes: The GME (Gyrfalcon MRAM Engine)9.9 TOPS/W in a 22nm ASIC Produced via TSMC CollaborationIndustry leading features, like Non-Volatile Memory

~ 40 MB of Memory Large embedded models

Multiple AI models :

Image Classification Facial recognition

Voice identification Voice Commands

Text to speech And others…..

Power Savings 20-50% when compared to SRAM or “other MRAM”

Custom Designs One Time Programmable Memory

Up to 10 ns Read Speed (~30 TOPS/W)Non-Power Leakage

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Report

Why Emerging Memories are NecessaryUnderstanding Bit SelectorsThe TechnologiesProcess Equipment RequirementsEmerging Memory CompaniesForecasting Emerging Memories

16

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Bit Selectors

“The select device is a big issue:How to combine it with the memory element?You can make a ReRAM out of an eggshell,

but you can’t scale that!”

Scott deBoer, Micron Fellow, 7/28/15

17

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Bit Selectors & Sneak Paths

18

Wor

dlin

es

Bitlines= High Resistance = Low Resistance

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Bit Selectors & Sneak Paths

19

Wor

dlin

es

Bitlines

Select

Valid

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Bit Selectors & Sneak Paths

20

Wor

dlin

es

Bitlines

Select

Valid

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Bit Selectors & Sneak Paths

21

Wor

dlin

es

Bitlines

Select

Valid

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Bit Selectors & Sneak Paths

22

Wor

dlin

es

Bitlines

Select

Valid Sneak Sneak

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Report

Why Emerging Memories are NecessaryUnderstanding Bit SelectorsThe TechnologiesProcess Equipment RequirementsEmerging Memory CompaniesForecasting Emerging Memories

23

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Technologies

MRAMReRAMPCM/XpointFRAMOther technologies

24

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Magnetic RAM (MRAM)

25

Bit is set/reset through magnetization

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Resistive RAM (ReRAM)

26

Two main types:Conductive BridgeOxygen Vacancy

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Phase Change Memory (PCM)

27

CMOS Logic

Hea

ter

Metal Interconnect

Polycrystalline Chalcogenide

ProgrammableVolume

Source: Objective Analysis

Bit set via heat/cool cycle

Crystalline conductsAmorphous insulates

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Ferroelectric RAM (FRAM)

28

Source: Objective Analysis

Central atom is up or down

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Other Technologies

Carbon NanotubesGraphene MemoriesConductive Electron RAM (CeRAM)Polymeric ferroelectricsFerroelectric tunnel junctions (FTJ)Ferroelectric FETs (FeFETs)Interfacial PCM/TRAMMagnetoelectric RAM (MeRAM)Racetrack Memory

29

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Report

Why Emerging Memories are NecessaryUnderstanding Bit SelectorsThe TechnologiesProcess Equipment RequirementsEmerging Memory CompaniesForecasting Emerging Memories

30

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Process Equipment Requirements

All new memories are built between metal layersTool sets are similar for MRAM, PCM, ReRAM, etc.

31

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Report

Why Emerging Memories are NecessaryUnderstanding Bit SelectorsThe TechnologiesProcess Equipment RequirementsEmerging Memory CompaniesForecasting Emerging Memories

32

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Companies

New Technology DevelopersChip MakersEquipment Makers

33

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory Report

Why Emerging Memories are NecessaryUnderstanding Bit SelectorsThe TechnologiesProcess Equipment RequirementsEmerging Memory CompaniesForecasting Emerging Memories

34

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Timeline for Change

35

DRAM MRAM?

2015 2020 2025 2030 2035

NAND ReRAM?

Logic ???

Source: Objective Analysis, 2018

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Emerging Memory PB Shipments

36

Emerging NVM market could exceed $6B by 2028!

2018 Coughlin Associates

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

The Report

Emerging Memories Poised to ExplodeIn-depth coverage of everything in this presentation160 pages, 111 figures, 31 tablesCan be purchased on-line for immediate download

Two ways to order:https://Objective-Analysis.com/reports/#Emerginghttp://www.TomCoughlin.com/tech-papers.htm

37

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Questions?

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

Technical and Market AnalysisConsultingReports and Newsletter

Emerging Memories Poised to Explode: Emerging Memory ReportDigital Storage in Media and EntertainmentDigital Storage Technology Newsletter

© 2018 SNIA Persistent Memory Summit. All Rights Reserved.

OBJECTIVE ANALYSIS

ProfoundAnalysts

CustomConsulting

Reports &Services