Minwook Ahn
Module Leading Developer
2018.10.02
Speech Recognition powered by Xilinx FPGA
for Virtual Personal Assistant, NUGUPresented By
XILINX CONFIDENTIAL
Contents
˃ Introduction: SK Group & SK Telecom
˃ NUGU: Virtual Personal Assistant
˃ SKT AIX: Neural Network Accelerator for NUGU on Xilinx FPGA
˃ Technical Roadmap
XILINX CONFIDENTIAL
Introduction: SK Group & SK Telecom
NUGU AI Speaker
Navigation withNUGU HD Map Self-driving Car
Surveillance CloudMedia ServicesSK Telecom
SK Hynix
SK C&C
SK planet
No.1 Mobile Comm. in Korean
No.2 Memory Semiconductor Manufacturer in Global Market
Total IT Service Provider
Platform Provider
XILINX CONFIDENTIAL
NUGU: Virtual Personal Assistant
XILINX CONFIDENTIAL
NUGU: Virtual Personal Assistant
XILINX CONFIDENTIAL
SKT AIX: Neural Network Accelerator for NUGU on Xilinx FPGA
XILINX CONFIDENTIAL
FPGA Resource Utilization for SKT AIX
LUT as logicLUT as
memoryFlipFlop BRAM DSP
Available 663360 293760 1326720 2160 5520
Used 292781 24910 491916 1002 5212
Utilization 44.14% 8.48% 37.08% 46.39% 94.42%
XILINX CONFIDENTIAL
SW stack for NUGU
XILINX CONFIDENTIAL
SDK for SKT AIX
Neural Network designed by Caffe, Tensorflow, or MxNet
Compression (Quantization/Factorization)
Acceleration Op Creator
Neural Network Execution Engine
Accelerator opsCPU opsGPU ops
SKTAIX
DL Framework
SK AI Inference
SDK
SK AI Inference
Accelerator
XILINX CONFIDENTIAL
SKT AIX performance
5x Performance16x Performance-Per-Watt
compared to GPU
0
5,000
10,000
15,000
20,000
25,000
0 20 40 100 120 140
fram
es/s
ec
60 80
# of channels
CPU-28Core GPU-TitanX AIX-FPGA
0.00
100.00
200.00
300.00
400.00
500.00
0 20 40 100 120 140
ms/
bat
ch
60 80
# of channels
CPU-28Core GPU-TitanX AIX-FPGA
Throughput according tonumber of concurrent channels
Latency according tonumber of concurrent channels
Environment: 28-Core CPU, 8-Batch
Power Consumption
CPU-28Core
GPU-TitanX
AIX-FPGA
150W
250 W
75 W 100 200
XILINX CONFIDENTIAL
Technical Roadmap
3
XILINX CONFIDENTIAL