HSA FOR APPLICATION

PROGRAMMING

Wen-mei W. Hwu

CTO, MulticoreWare, Inc.

Professor University of Illinois, Urbana-Champaign

CURRENT GPU COMPUTING PAIN

POINTS

Kernel launch overhead

Limited virtual and physical memory space

Extra data movement in I/O and networking

Tedious host code

Multiple source code development

KERNEL LAUNCH OVERHEAD

DESIRED DATA TRANSFER BEHAVIOR

Main Memory

(DRAM)

GPU card

(or other Accelerator cards)

CPU

DMADevice

Memory

Network I/O

Disk I/O

SAMOS 2013

ACTUAL DATA TRANSFER BEHAVIOR

Main Memory

(DRAM)

GPU card

(or other Accelerator cards)

CPU

DMADevice

Memory

Network I/O

Disk I/O

Each additional copy

diminishes application-

perceived bandwidth

SAMOS 2013

HSA COMMON ADDRESS SPACE

STANDARDIZED USER-LEVEL QUEUES

LOW OVERHEAD KERNEL LAUNCH

DYNAMIC COMPILATION AND BINARY

COMPATIBLITY

FAMILIAR COMPUTATION ORGANIZATION

EXAMPLE: COMPUTER VISION

EXAMPLE EXECUTION TIME

TOOLS WORKING GROUP

Tools Group will be looking at foundation for Developer Tools (compilation,

debugging and performance analysis)

Working with the working group to insure the right interface are in place Compilation,

Debugging, and Performance Analysis initially

We act as stewards for

LLVM backend for generating HSAIL (AMD/MCW)

HSA functional simulator with GDB support (AMD/MCW)

HSA performance simulator (AMD)

Loader Library for Simulator - BRIG object loading support ( AMD)

Longer Terms will spawn sub-group that will drive requirement for language

support for HSA

C, C++, C++ AMP

Java (JVM, Dalvik)

Python

JavaScript

DSL…

…Hwu 2013

CURRENT TIME TABLE

Kickoff Conference and Refined Charter –

November 2013

Tools Roadmap – December 2013

Initial Tools – December 2013

Initial Language Tool Chains – January 2013

Hwu 2013

Please join us and contribute!

HAS BOOK IN THE MAKING

Audience

Performance application developers

System architects

Component architects

Software stack developers

Hwu 2013

Heterogeneous System Architecture

For Application Programming

EDITORIAL BOARD

Gaster, Benedict – Qualcomm

Hegde Manju - AMD

Hwu, Wen-mei - MulticoreWare/UIUC

Jablin, Thomas – MultcoreWare

Lokhmotov, Anton – ARM

Lu, Chien-Ping – MediaTek

Whitecotton, Bob - AMD

Hwu 2013

CURRENT TABLE OF CONTENTS

HSA Overview (50 pages)

Chapter 1: What is HSA? (Hwu/Jablin)

Chapter 2: The HSA Architecture (Hwu/Jablin/Others)

Chapter 3: A Programmer's View of HSA (Hwu/Jablin)

Chapter 4: The Tools Framework for HAS,

(Hwu/Jablin/Others)

Chapter 5: Mapping of Classical algorithms onto the

HSA Architecture (Hwu/Jablin)

Hwu 2013

CURRENT TABLE OF CONTENTS (CONT.)

Representative Workloads:

Chapter 6: Photography, Minh Do, Professor UIUC, CTO

Personify

Chapter 7: Video-Audio Search, Ren Wu, Baidu

Chapter 8: Augmented Reality Chein-ping Lu, MeidaTek

Chapter 9: Biometrics (Face Detection) Mike Jones, MERL

& Harris Gasparakis, AMD

Chapter 10: Audio-Video processing Bill Herz, Sr. Fellow

AMD

Hwu 2013

CURRENT TABLE OF CONTENTS (CONT.)

Chapter 11: Ray-Tracing, TBD

Chapter 12: Natural user Interfaces, Navneett Dallal,

CEO Flutter

Chapter 13: Physics Processing, Ronald Fedkiw,

Professor Stanford U. and Eftychios Sifakis

Chapter 14: Graphics enhancement, Ignacio Vargas, CTO,

Nextlimit (Interested)

Chapter 15: Communications and networking, Don Banks-

Cisco (Interested)

Chapter 16: Data/Business Analytics , Zubin Dowlaty,

CTO Mu Sigma

Hwu 2013

CURRENT TABLE OF CONTENTS (CONT.)

Chapter 17: Hadoop, Memcached and cloud frameworks,

Bharath Mundlapudi, CTO Orzota

Chapter 18: Bioinformatics Wu Feng, VirginiaTech

Chapter 19: Scientific Computations, Byunghyun Jang,

Univ Miss.

Chapter 20: Computer Aided Design and Engineering,

Martin Wong, Professor UIUC

Chapter 21: Oil and Gas, Nacho Navarro, UPC/BSC

(interested)

Hwu 2013

CURRENT TABLE OF CONTENTS (CONT.)

Chapter 22: Financial Services & Analysis, Surra

Yanamadala, CA VP

Chapter 23: Computer Vision facial expression,

Elnar Hajiyev, Realeye

Chapter 24: Legacy Code Interoperability, Wen-

mei and Tom Jablin, MCW

Chapter 25: Java for HSA, Gary Frost, AMD

Hwu 2013

MAJOR UPCOMING MILESTONES

Author Algorithm and Code Due – February 2014

Author Chapters Due – April 2014

Review Due Back to Authors – May 2014

Chapters to Elsevier – June 2014

Books available – October 2014

Hwu 2013

THANK YOU!

ANY MORE QUESTIONS?

Hwu 2013