Introduction of Post-K development

Yutaka IshikawaRIKEN AICS

9:30AM – 9:55AM, 12th of December, 2017

RIKEN

2

National institute for basic research in Japancovering physical to biological sciences

Foundation in 1917

3,000 researchers, 400 administrators

14 centers in 9 sites across Japan includingAICS in Kobe

10 joint laboratories abroad

Annual budget: 83 billion JY (690M$)

A Sendai

B Tsukuba

C Wako

D Tokyo

E Yokohama

F Nagoya

G Osaka

H Kobe

I Harima

A

BCD

EFG

HI

20017/12/12

RIKEN

3

A Sendai

B Tsukuba

C Wako

D Tokyo

E Yokohama

F Nagoya

G Osaka

H Kobe

I Harima

A

BCD

EFG

HI

National institute for basic research in Japancovering physical to biological sciences

Foundation in 1917

3,000 researchers, 400 administrators

14 centers in 9 sites across Japan includingAICS in Kobe

10 joint laboratories abroad

Annual budget: 83 billion JY (690M$)

20017/12/12

RIKEN Advanced Institute for

Computational Science

Computer building

Substation SupplyChillers

Research Building

【Computer Building】floor space 10,500㎡construction area 4,300㎡building structure steel cooling system 1B 14 units

2F 50 units

【Heat and Power Buiding】

【Seismic isolation system】Resistent to strong earth quakes up to shake strength 6

Total electric power 15MWElectric facilities

70kV high-voltage input gas turbine

co-generation system

RIKEN AICS (Advanced Institute for Computational Science)

4

【cross sectional view】

Research building Computer building

K computer

Global file system

Air cooling system

Air cooling system

office

office

office

office

office

Machine roomMachine room

Air conditioner room

Computer room

Computer roomoffice

office

20017/12/12

Specification 11.28PFlops with 88,128 nodes

SPARC64TM VIIIfx x 8 (128 Gflops) 1.27PB(16GB/node) memory 6 D mesh-torus network 30PB disk

Top 500 ranking No. 1 in Jun. & Nov. 2011 No. 8 in Nov. 2017

FLAGSHIP2020 Project

20017/12/12

LoginServersLoginServers

MaitenanceServers

MaitenanceServers

I/O NetworkI/O Network

………

……………………… Hierarchical

Storage SystemHierarchical

Storage System

PortalServersPortalServers

Missions• Building the Japanese national flagship supercomputer, 

post K, and• Developing wide range of HPC applications, running on 

post K, in order to solve social and science issues in Japan

Project organization• Post K Computer development

• RIKEN AICS is in charge of development• Fujitsu is vendor partner.• International collaborations: DOE, JLESC, CEA

• Applications• The government selected

• 9 social & scientific priority issues and their R&D organizations.

• 4 Exploratory Issues

Status• “Basic Design” was finalized and now in 

“Design and Implementation” phase.• We have decided to choose ARM v8 with 

SVE as ISA for post‐K manycoreprocessor.

• We are working on detail evaluation by simulators and compilers

5

Target science: 9 Priority Issues

20017/12/12 6

重点課題① ⽣体分⼦システムの機能制御による ⾰新的創薬基盤の構築

①Innovative Drug Discovery

RIKEN Quant. Biology Center

重点課題② 個別化・予防医療を⽀援する 統合計算⽣命科学②Personalized and Preventive Medicine

Inst. Medical Science, U. Tokyo

重点課題③ 地震・津波による複合災害の統合的予測システムの構築③Hazard and Disaster induced by

Earthquake and Tsunami

Earthquake Res. Inst., U. Tokyo

重点課題④ 観測ビッグデータを活⽤した気象と地球環境の予測の⾼度化④Environmental Predictions

with Observational Big Data

Center for Earth Info., JAMSTEC

重点課題⑥ ⾰新的クリーンエネルギー システムの実⽤化

⑥Innovative Clean Energy Systems

Grad. Sch. Engineering, U. Tokyo

重点課題⑦ 次世代の産業を⽀える新機能デバイス・⾼性能材料の創成⑦New Functional Devices and High-Performance

Inst. For Solid State Phys., U. Tokyo

重点課題⑧ 近未来型ものづくりを先導する ⾰新的設計・製造プロセスの開発⑧ Innovative Design and Production Processes for the Manufacturing Industry in the

Near Future

Cent. for Earth Info., JAMSTEC重点課題⑤ エネルギーの⾼効率な創出、変換・貯蔵、 利⽤の新規基盤技術の開発⑤High-Efficiency Energy

Creation, Conversion/Storage and Use

Inst. Molecular Science, NINS

重点課題⑨ 宇宙の基本法則と進化の解明⑨Fundamental Laws and Evolution of the Universe

Cent. for Comp. Science, U. Tsukuba

Society with health and longevity

Disaster prevention and global climate

Energy issues

Industrial competitiveness

Basic science

Target science: 4 Exploratory Issues

20017/12/12

萌芽的課題⑪ 複数の社会経済現象の相互作⽤のモデル構築とその応⽤研究

萌芽的課題⑩ 基礎科学のフロンティア－ 極限への挑戦Frontiers of Basic Science -

challenge to extremes -

Interactive Models of Socio-Economic Phenomena and their

Applications

萌芽的課題⑫ 太陽系外惑星（第⼆の地球）の誕⽣と太陽系内惑星環境変動の解明Formation of exo-planets (second

Earth) and Environmental Changes of Solar Planets

萌芽的課題⑬ 思考を実現する神経回路機構の解明と⼈⼯知能への応⽤Mechanisms of Neural Circuits

for Human Thoughts and Artificial Intelligence

7

CPU Architecture

Armv8-A + SVE (Scalable Vector Extension)

20017/12/12 8

FP64/FP32/FP16

Fujitsuʼs extensions Inter core barrier Sector cache Hardware prefetch assist

https://developer.arm.com/products/architecture/a-profile/docs

Reducing fork/join sync.

An Overview of Post K Compute Node, Compute + I/O Node Arm V8 SVE + Fujitsu Extension Many Cores (Compute Cores + OS Cores)

6D mesh/torus Interconnect 3-level hierarchical storage system Silicon Disk Magnetic Disk Storage for archive

9

LoginServersLoginServers

MaintenanceServers

MaintenanceServersI/O NetworkI/O Network…

HierarchicalStorage SystemHierarchical

Storage System

PortalServersPortalServers

…

……………

…

……

20017/12/12

Software Stack developed by Fujitsu and RIKEN

Light-Weight Kernel:McKernel

LinuxKernel

Linux + McKernel

Linux Kernel

Linux OnlyTwo runtime modes are transparently provided

Fujitsu RIKEN AICSBatch Job System Technical Computing Suite

Programming Language

Fortran, C/C++, OpenMP,Java

XMP (XcalableMP),FDPS (Framework for Developing Particle Simulator),Contribution to LLVM for SVE

Math Library BLAS/LAPACK/ScaLAPACK, SSL II

Enhancement of BLAS and etc.,EigenEXA, Batched BLAS, …

Tool Eclipse plugin, … RIKEN SimulatorFile System and File I/O

FEFS ( Fujitsu Exabyte File System), LLIO

DTF (Data Transfer Framework),FTAR(Flagmented TAR)

Communication OpenMPI MPICH, LLCProcess/Thread Management PiP (Process in Process)

OS Kernel Linux McKernel

20017/12/12 10