34
GTC FALL 2020 FINANCIAL ANALYST EVENT

GTC FALL 2020 FINANCIAL ANALYST EVENT · 2020. 10. 12. · GTC Fall 2020 HERE WITH YOU TODAY Colette Kress EVP & CFO Jensen Huang Founder & CEO Paresh Kharya AI Computing Manuvir

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

  • GTC FALL 2020 FINANCIAL ANALYST EVENT

  • Forward Looking Statements

    Except for the historical information contained herein, certain matters in this presentation including, but not limited to, statements as to: our expanding ecosystem and the estimated number of AI andautonomous systems developers adopting NVIDIA AI; artificial intelligence as the most powerful technology force of our time; data center workload growing exponentially; our strategies, growth, position,opportunities, and continued expansion; the performance and benefits of our products and technologies, including the NVIDIA Bluefield-2 DPU, NVIDIA DOCA, the EGX Edge AI platform, NVIDIA Clara Discovery,and the Cambridge-1 AI supercomputer; the NVIDIA DPU roadmap; the impact of NVIDIA accelerated computing on VMware cloud foundation; the impact of GSK’s partnership with NVIDIA to build an AI drugdiscovery lab; our TAM; and other predictions and estimates are forward-looking statements within the meaning of the Private Securities Litigation Reform Act of 1995. These forward-looking statements and anyother forward-looking statements that go beyond historical facts that are made in this presentation are subject to risks and uncertainties that may cause actual results to differ materially. Important factors thatcould cause actual results to differ materially include: global economic conditions; our reliance on third parties to manufacture, assemble, package and test our products; the impact of technological developmentand competition; development of new products and technologies or enhancements to our existing product and technologies; market acceptance of our products or our partners’ products; design, manufacturingor software defects; changes in consumer preferences and demands; changes in industry standards and interfaces; unexpected loss of performance of our products or technologies when integrated into systemsand other factors. For a complete discussion of factors that could materially affect our financial results and operations, please refer to the reports we file from time to time with the SEC, including our AnnualReports on Form 10-K and our Quarterly Reports on Form 10-Q. Copies of reports we file with the SEC are posted on our website and are available from NVIDIA without charge. These forward-looking statementsare not guarantees of future performance and speak only as of October 5, 2020, based on information currently available to us. Except as required by law, NVIDIA disclaims any obligation to update these forward-looking statements to reflect future events or circumstances.

    © 2020 NVIDIA Corporation. All rights reserved. NVIDIA and the NVIDIA logo are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and/or other countries. Other company and productnames may be trademarks of the respective companies with which they are associated. Features, pricing, availability, and specifications are subject to changewithout notice.

  • AGENDA

    Computing for the Age of AI

    NVIDIA AI

    NVIDIA Enterprise AI

    NVIDIA Edge AI

    NVIDIA Healthcare

    GTC Fall 2020

    HERE WITH YOU TODAY

    Colette KressEVP & CFO

    Jensen HuangFounder & CEO

    Paresh KharyaAI Computing

    Manuvir DasEnterprise Computing

    Justin BoitanoEdge Computing

    Kimberly PowellHealthcare

  • COMPUTING FOR THE AGE OF AI

  • AI and Autonomous Systems Developers Adopt NVIDIA AI

    EXPANDING NVIDIA ECOSYSTEM

    2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020EST

    6MCUDA Downloads in 2020;

    20M downloads to date

    1,800GPU-Accelerated Applications

    6,500AI Startups

    DLSS 2.1

    RTX DI

    OptiX 7.2

    HPC SDK 20.9

    RAPIDS 0.16

    Parabricks 3.5

    DeepStream 5.0

    AI DRIVEMETRO ISAACCLARARAPIDSAERIAL

    5GRTX HPC

    NCCL 2.7.8

    GPUDirect StorageMAGNUM IO

    CUDA 11.1 CUDA

    NSIGHT 2020.5

    cuDNN 8.03

    TensorRT 7.2

    CUDA-X

    2.3MDevelopers

    80New SDKs

  • NVIDIA AI INFERENCE LEADERSHIP

    Paresh Kharya

  • DRUG DISCOVERY

    1,000X Faster SimulationsCaltech OrbNet

    ARTIFICIAL INTELLIGENCE —THE MOST POWERFUL TECHNOLOGY FORCE OF OUR TIME

    AlexNet

    ResNet

    BERT

    GPT-2

    Megatron-GPT2Turing NLG

    Megatron-BERT

    GPT-3

    1.E-03

    1.E-02

    1.E-01

    1.E+00

    1.E+01

    1.E+02

    1.E+03

    1.E+04

    2012 2014 2017 2020

    Pet

    aflo

    p/s

    -D

    ays

    EXPLODING MODEL COMPLEXITY30,000X in 5 Years | Now Doubling Every 2 Months

    HUMAN-LEVEL READING COMPREHENSION

    24% Better than Avg Human NVIDIA Megatron BERT

    HUMAN-LIKE CHATBOTS

    Half of Users Preferred AI Facebook BlenderBot

    DRONE DELIVERIES

    6X Safer Landings Caltech Neural Lander

    ALL-TERRAINWALKING ROBOT

    On the Fly Surface AdaptationNVIDIA RL Controller

    FIGHTING CORONAVIRUS

    Mapping Millions of ProteinsTechnical U. of Munich NLPs

  • A100 TAKES OFFFastest GPU Ramp Ever

    May ‘20 June ‘20 July ‘20 Aug ‘20 Sept ‘20

  • 3 PILLARS OF NVIDIA AI

    PRE-TRAINED MODELSSOTA Models

    Computer Vision

    Conversational AI

    Recommendations

    Reinforcement Learning

    TRANSFER LEARNING TOOLKITZero Coding | Speech, Vision, & NLU

    Customized Model

    Data

    Pre-Trained Model

    TLT

    TRITONInference Serving

    Frameworks TIS

    TensorRT 7.2

    TRT

    Result

    Query

    INFERENCEDATA ANALYTICS & TRAINING APPLICATION FRAMEWORKS

  • Celebrating 10 Years of NVIDIA GPU in the Cloud

    ACCELERATING ADOPTION OF NVIDIA AI INFERENCE

    Inference ExaOPS shipped: Represents 12-month periods from October of the previous year to September of the year shown

    2000+ Optimizations

    TensorFlow, PyTorch, ONNX

    1.3M Downloads

    16,000 Companies

    2017 2018 2019 2020

  • NVIDIA AI INFERENCE CUSTOMERS

    GRAMMAR CORRECTION

    Half a Trillion Queries per Year200ms Inference Response1/3rd Lower Cost Than CPU

    FRAUD PREVENTION

    Over $1 Trillion in Transactions | 115M Credit Cards 2ms Latency Enables Real-Time Fraud DetectionUp to 6% Higher Accuracy in Specific Segments

    RECOMMENDATIONS

    Videos, News, Music, AppsHundreds of Billions Queries per day

    GPU Inference In Production

    AMERICAN EXPRESSMICROSOFT OFFICE TENCENT PCG

  • NVIDIA AI INFERENCE CUSTOMERS

    CSPCONSUMER INTERNETAUTO RETAIL & FSIMEDICAL INDUSTRIALROBOTICS

  • NVIDIA ENTERPRISE AIDATA CENTER IS THE NEW UNIT OF COMPUTING

    Manuvir Das

  • Moving from Fixed-Function Appliances to Software Services on Servers

    MODERN DATA CENTERS ARE SOFTWARE-DEFINED

    NVIDIA NIC

    CPU

    Software-defined Storage Software-defined Networking

    Infrastructure Management Software-defined Security

    VMs Containers

    Acceleration Engines

    Manual Infrastructure Management

    Security Appliances

    Storage Systems

    Static Networks

  • DATA CENTER WORKLOAD GROWING EXPONENTIALLY

    NVIDIA NIC

    CPU

    Software-defined Storage Software-defined Networking

    Infrastructure Management Software-defined Security

    VMs Containers

    Acceleration Engines

    Microservices

    East-West Traffic

    Storage Access

    Zero Trust Security

  • Software-defined Data Center Infrastructure-on-a-Chip

    INTRODUCING THE DATA PROCESSING UNIT (DPU)

    DPU-ACCELERATED SERVERTRADITIONAL SERVER

    NVIDIA DPU with Arm Cores & Accelerators

    CPU

    Software-defined Storage Software-defined Networking

    NVIDIA NIC

    CPU

    Software-defined Storage Software-defined Networking

    Infrastructure Management Software-defined Security

    VMs Containers

    VMs Containers

    Infrastructure Management Software-defined Security

    Acceleration Engines

    Acceleration Engines

  • NVIDIA BLUEFIELD-2 DPUData Center Infrastructure-on-a-Chip

    Combines 8 64-bit A72 Arm Cores, 2 VLIW Acceleration Engines, and Mellanox ConnectX-6 Dx NIC

    Accelerated Security: Isolation, Root of Trust, Crypto, Key Management, Regular Expression Engine

    Accelerated Networking: RDMA/RoCE, GPU Direct, SDN/NFV

    Accelerated Storage: NVMe-oF, Elastic Block Storage, Data Integrity, De-Dup, Compression

    Out-of-Band Management

    2x 100Gb/s Ethernetand InfiniBand

    PCIe Gen 4.0

  • NVIDIA DOCAData Center Infrastructure-on-a-Chip Architecture

    SDK for BlueField DPUs

    Open APIs – DPDK, SPDK, P4

    Certified Reference Apps & Third-Party Solutions

    INFRASTRUCTURE APPLICATIONS

    DOCA

    StorageSPDK / Kernel

    SecurityDPDK / Kernel

    NetworkingP4 / DPDK / Kernel

    ManagementTelemetry

    ASAP2SNAP CRYPTO RoT RDMA

    Infrastructure Management

    Software-defined Storage Software-defined SecuritySoftware-defined

    Networking

  • BlueField-2X70 SPECINT60 TOPS AI200 Gbps

    2021 2022 2023

    1X

    10X

    100X

    BlueField-41000 SPECINT400 TOPS400 Gbps

    BlueField-270 SPECINT0.7 TOPS200 Gbps

    BlueField-3350 SPECINT1.5 TOPS400 Gbps

    NVIDIA DPU ROADMAPProgrammable Data Center Infrastructure-on-a-Chip

    1000X

    DOCA — One Architecture

    BlueField-3X350 SPECINT75 TOPS AI400 Gbps

  • NVIDIA ACCELERATED COMPUTING ON VMWARE CLOUD FOUNDATIONBringing AI to Every Enterprise, Enabling Next-Gen Hybrid Cloud

  • NVIDIA EDGE AIA TRILLION THINGS – THE NEXT INTERNET

    Justin Boitano

  • THE AGE OF AI — A TRILLION CONNECTED THINGS

    Edge Data CentersMillions of Edge DC

    Each with Thousands of Nodes

    2MFactories

    570MFarms

    5MCall Center

    Agents

    13MStores

    40MMiles of Road

    10TMiles Driven

    per Year

  • ANNOUNCING EGX EDGE AI PLATFORM

    NVIDIA Ampere Architecture GPU

    3rd generation Tensor Core

    New Security Engine for Confidential AI

    Secure, Authenticated Boot

    NVIDIA BlueField-2

    8x Arm Cores

    Dual 100 Gb/s Ethernet or InfiniBand

    Line-speed TLS/IPSec Crypto Engine

    Time Triggered Transmission Tech for Telco (5T for 5G)

    ASAP2 SR-IOV and VirtualIO Offload

  • EGX EDGE AI PLATFORM

  • EGX EDGE AI PLATFORM

  • NVIDIA CLARA COMPUTATIONAL DRUG DISCOVERY

    Kimberly Powell

  • Chemical Compounds

    AutoDock

    RAPIDS

    $1.25T Pharmaceutical Industry | $2B R&D Per Drug | 12 ½ Years To Market | 90% Failure Rate

    NVIDIA CLARA DISCOVERY

    NLP

    GENOMICS STRUCTURE DOCKING SIMULATION IMAGING

    O(109)

    O(1060)

    SEARCH

    Literature

    RAPIDS

    DrugCandidate

    BiologicalTarget O(102)

    SchrodingerNAMD, VMD, OpenMM

    MELD

    Clara Imaging

    MONAI

    CryoSPARC, Relion

    AlphaFold

    Clara Parabricks

    RAPIDS

    Real World Data

    Biomegatron, BioBERT

  • CAMBRIDGE-1 AI SUPERCOMPUTER

    HEALTHCARE & LIFE SCIENCE RESEARCH

    LARGE-SCALE AI & DATA SCIENCE RESEARCH

    COLLABORATION WITH UK INDUSTRY, UNIVERSITIES, STARTUPS

    EDUCATE FUTURE AI PRACTITIONERS

    80 NVIDIA DGX A100 | 400 PETAFLOPS AI COMPUTE | 20 TERABYTES/SEC INFINIBAND | 2PB NVME | 500KW

  • GSK PARTNERS WITH NVIDIA TO BUILD AI DRUG DISCOVERY LAB

  • Accelerated Computing | Data Science & Machine Learning | Deep Learning | NLP Language Models

    AI MOMENT IN HEALTHCARE

    16X SPEEDUP ACROSS DOMAINS | FULL STACK ACCELERATIONGPU Accelerated Applications vs CPU | GPU Optimizes Training Frameworks vs Open Source

    NVIDIA BIOMEGATRON ACHIEVES STATE OF THE ARTBiomedical Literature | Clinical Notes | Claims Data | Digital Health

    30X

    7X

    15X

    20X

    6X

    30X

    6X

    Genomics Structure Screening Docking Simulation Imaging NLP

    BIOMEDICAL NLP

    6.1B Words PubMeb

    Vocabularye.g. COVID

    BioMegatron345M Param

    Named Entity Recognition

    Relation Extraction

    Q&A

    Data AI Model AI Skill

  • GTC Fall 2020Colette Kress

  • GTC FALL 2020

    NVIDIA AI GAINING MOMENTUM

    20M CUDA downloads/6M in last year | Most shipped AI inference cloud compute capacity in the world

    NVIDIA POWERS ENTERPRISE COMPUTING

    NVIDIA AI integrated into VMware & Cloudera | NVIDIA DPUs “Data Center on a Chip Architecture"

    NVIDIA EDGE AI FOR THE INTERNET OF A TRILLION THINGS

    EGX Edge AI + FleetCommand recurring revenue service

    NVIDIA HEALTHCARE NEAR A TIPPING POINT

    NVIDIA Clara for Computational Drug Discovery | Cambridge-1 | GSK

    BROADENING ECOSYSTEM & CUSTOMER ADOPTION

    Every Server & Storage OEM | Hundreds of ISVs | Thousands of Enterprises | 2.3M Developers

  • NVIDIA AI includes estimated Total Addressable Market for accelerated computing platforms used in Hyperscale/Cloud.Source: NVIDIA estimates, incorporating data from Counterpoint, Dell’Oro, Gartner, IDC, IHS, Hyperion and Strategy Analytics

    COMPUTING FOR THE AGE OF AI

    NVIDIA HPC

    $10B $45B

    NVIDIA AI

    $30B

    NVIDIA ENTERPRISE AI

    $15B

    NVIDIA EDGE AINVIDIA RTX

    $8B

    Data Center Total Addressable Market by 20242020 Revenue*18% Trailing 5-year CAGR

    *Trailing 4-quarters through F3Q 2021 outlook for Gaming and Professional Visualization market platforms

  • Q&AJensen Huang & Colette Kress