HPC in Thailand

Putchong Uthayopas, Ph.D

Acting Vice President for Information,

Kasetsart University Bangkok, Thailand

putchong@ku.th

First Generation: The dawn of HPC• 1994 NECTEC put Thailand's first vectorized multiprocessor

supercomputer, the Cray EL98

• Computational Chemistry

• Computational Physics

• 1996 Thai Meteorological Department (TMD) use IBMSP

• NWP (Numerical Weather Prediction) project

• 1997 the Computational Science and Engineering Program Consortium was established as a cooperative effort among Thai universities and the National Science and Technology Development Agency (NSTDA).

• 1999 Kasetsart University built 72 nodes Beowulf Cluster “Pirun”

• Academic and research applications

• Start of the booming of Beowulf Cluster in Thailand

• 2001 Thailand transition into Grid Era by the start of “ThaiGrid” Project between KMITNB and KU later many universities join : AIT, KMUTT, Burapa, Chula

Second Generation: Grid Computing

ThaiGrid projectStart

2000

Linking KMITNB-KU

2001 2002 2003 2004 2005

Virtual Screening On Grid

National Grid project approved

National Grid project started

ThaiGrid has 5 members

ThaiGrid link more than 100 processors from 5 universities

PRAGMA participation byNECTEC/KU

Forming National Grid project proposal ThaiGrid Join

SCGlobal2004ThaiGrid forming the first function globus grid of 14 universities

2006

ThaiGrid reach 1000 processors core

2007 2008 2009

Thailand has a First SC exhibit at RENO SC2007

SILA Cluster (TERAFLOP) on line

Tera Server: The First Teraflop machine went on-line given 2.5 Rmax and 4.5 Rpeak on HPL benchmark

Thai National grid Center start working in temporary office

ThaiGrid has 22 members

10TF cluster at BIOTEC online

Edge Switch 1Gbps Ethernet

FESunyata

FEAraya

WinHPC(FE)

TERA(FE)

SPARE1(FE)

SPARE2(FE)

FS1 FS2 FS3 FS4

4 nodes 4 nodes64

nodes

96 nodes +

16 sparenodes

200 Ports Gigabit Ethernet switch

Storage Tier 5TB Lustre FS

Anatta(FE)

15nodes

KU Fiber Backbone(1Gbps Fiber)

2.5Gbps to UninetStorage 48 TB

1 Gbps Ethernet/Fiber

Automotive Grid

Animation Grid

Financial Grid

Argricultural Grid

Environmental Grid

Friendship Grid is the Lasting one

Third Generation: Uninet2 and National E-science Infrastructure Consortium

National Education Network

• Thai Government approved Stimulus Package (SP2) in 2009• 116 M US$ to Integrate all Education Network to National Education Network

(NEdNet)

• This project belong to Uninet a government agency under the Ministry of Education.

• Road Map

• Fiber optic to accommodate the core network (Backbone) that can support bandwidth 20 - 50 Gbps.

• Interconnecting educational institutes on fiber optic with the following target• 293 Universities (1,000 Mbps each of the N x 1,000 Mbps).

• 415 Vocational Education (100 - 1,000 Mbps)

• 3,000 schools (10 - 100 Mbps).

National Research and Education Network : NREN

• Optical Network Backbone with DWDM

@ N x 10 Gbps

• Fiber to the University @ Gbps

(NxGbps)

• Fiber to the school @ 100-1000 Mbps

• Public libraries @ 100-10000 Mbps

Members Number of Members

Universities/Institutes 194

Vocational Education 415

Educational Service Area 185

Basic Education (schools) 9 749

Municipality Public Library 151

Research and other Education 51

Total 10,745

BK_NIX CAT_NIX CAT_IIG JGN Asi@connect

ThaiRENUniNet/NEdNet

ThaiSARN

20G 40G 100G 1 Gbps 1.6 Gbps

1G

1G1G

MOE_Net

:National Internet Exchanged

:International Internet Gateway

:Research and Education Network

10G

Internet2

1G

National Research and Education NetworkNetwork Peering

Examples of Network Services, Applications, and Project Collaborations

• Project E-Science

• IPv4/IPv6

• eduroam

• E-learning/Tele-education

• Tele-medicine

• Live video stream transmission

• Earth observation data transfer

• Cloud Education

• Future Internet technology

• Founded in 2011 • 8 member institutes• Objective

• Develop the computing, data storage, and fundamental data set as a sustainable infrastructure to support research in Thailand

• Project Area• High Energy Physics• Computational science and engineering• Computer science and engineering • Water resources• Energy and environmental• Climate change

• Collaboration with CERN• High Energy Physics – ALICE project

• part of European Data Grid

4,100 CPU core; 1,254 TBsupport 3 application areas

SUT656 C, 150 TB

TINT80 C, 3.6 TB

KMUTT224 C, 30 TB

HAII896 C, 112 TB

CU340 C,106 TB

NARIT540 C, 100 TB

NSTDA688 C, 660 TB

SLRI596 C, 80 TB

EGA80 C, 13 TB

960 Core

200 TB, 15MB(2018)

High Energy Particle Physic

Computational Science & Engineering

Computer Science & Engineering

e-Science National e-Science Infrastructure Consortium (2011-present)

1.32.5

4.15.3

8.4 8.9

14.8

2011 2012 2013 2014 2015 2016 2017Million Hours Expon. (Million Hours)

Users 31 organiations

Usage statisticsProjects

246

Average Utilization86%

Users25164 Researcher

187 Students

e-Science National e-Science Infrastructure Consortium (2011-present)

Hydro and Agro Informatics Institute (HAII)

Vision: Developing and applying S&T knowledge for agricultural and water resource management to cope with critical climate change

Ministry of Science and Technology

Missions: 1. Developing and applying S&T for agricultural and water resource management2. R&D in water management technology and system3. Promoting collaboration on S&T research and development4. Expanding services and disseminating the R&D outcomes

2012 to present

National Hydroinformaticsand Climate Data Center (NHC)

www.thaiwater.net

1999 20032004 2006 2007

2008-092010-11

1 TB +1 TB +1 TB +4 TB +8 TB +12TB

+15TB

+24TB

+10TB

HAII’s High Performance Computing

Over 1000 CPU cores; 2088 GPU cores; 100 VMs; 300 TB storage

Server farms, clustering-GRID environment

Current Capacity

2014-16

+38TB

+72TB

Applications of HAII’s HPC

http://thaiwater.net/v3/wrfroms/rain_forecast_pre/tab1/image1

http://thaiwater.net/v3/wrf/swan

Coupled Model (WRF-ROMS)

Rainfall forecast

Wind forecast

Pressure forecastWave Height

WRF: Weather Research and Forecasting ROMS: Regional Ocean Modeling System

SWAN: Simulating WAve Near shore

SWAN

22

2. HPC TMD’s System.

System computer types-HPE Apollo 2000 series

Proliant XL170r Gen 9

- 192 Nodes (compute) (3 types)

- Performance : 228 TF

-Main memory : 128 GiB per node

-High-speed storage: 3PB

Operating system : Linux

Model : WRF-ARW

Thai Meteorological Department (TMD) have been running the Weather Research and

Forecasting (WRF) Model version 3.8.1 was made fully operational in October 2017. Now,

Weather Research and Forecast (WRF) Model is running and generate daily output on Website

and utilize daily weather forecast and special weather forecast. Necessary arrangements for the

physical parameterization and sensitivity testing on the performance of the Model need to carry

out. TMD run WRF with data assimilation technique by Grid point Statistical Interpolation System

(GSI) 3DVAR Assimilation, and future plan to run 4DVAR and Hybrid

(Forecasting System (HPC + Model))Forecasting Process

HPC

Storage (3PB)

Computer graphics

High speed interconnection

NCEP/GTS/FTP

SYNOP, SHIP, BUOY,…

TEMP, PILOT, WIND-

PROFILER

Aircraft (AMDAR, AIREP)

Satellite (ATOVS, AIRS, IASI,

SSMI, HIMAWARI. Etc.)

Decoding Pre/Post Process Sever

API Decoded Files (OOB)

Observation data Preprocessing (NCEP)

VAR: FDDA

SURF: Surface A nalysis

WRF

Local (WRF)

Regional Model (WRF)

Post-

preprocessing/Application models User

internet

HPC system for simulation WRF Model

GSI

HPC-WRF

OPS: QC Test

Data Assimilation(3/4 DVAR)

TMD Weather Forecast API

The Fourth Generation?

• Expansion of Traditional HPC

• CFD, Computational Chemistry, Physics, Biology

• Big Data

• Banking, Retail, Telco

• AI and machine learning

• Advanced data analytics

• Specialized GPU system for deep learning

• NSTDA Platform is a new exciting project

NSTDA Computing Infrastructure Roadmap

InfraDev.

Computing Infrastructure Development(1994-2011)

e-Science National e-Science Infrastructure Consortium (2011-present)

NSTDACI

NSTDA Computing Infrastructure(2018-2020)

CCSCenter for Computational Science(Future)

EECi EECi-ARIPOLIS Center for Computing Innovation

• Nanomaterials

• Catalysis and adsorbent

• Biofuel from biomass

• Carbon-based materials

• Engineering testing

• Industrial design

• Computer-aided engineering

• Salinity intrusion management

• Computer vision

• Deep learning for FR & NLP

• Precision medicine

• Biobank

• Bioinformatics

• Plant genome

BIOTEC NECTEC

NANOTECMTEC

Nanomaterials Design and SimulationsNanoscale Simulation Laboratory (NANOTEC) aims to design and predict the properties of functional nanomaterials, and to create a unique understanding of the physicochemical processes at nanoscale regime by using:

first principle computational chemistry molecular dynamics simulations

computational method development mathematical modeling based on continuum approach

Impact

HPC for Computer-Aided Engineering (CAE)

Finite element analysis (FEA) of dynamic structural problems Computational fluid dynamics (CFD) of fluid flow problems

Contact: Dr. Somboon Otarawanna, MTEC

The Wheel Impact Test O2 Gas Distribution in A Chemical Reaction Tank

NECTEC State-of-the-Art NLP

Optical

Character Recognition

Technology Readiness

Machine

Translation

Exis

ting D

ata

Siz

e Speech

Recognition

Sentiment

Analysis

Text-to-

speech SynthesisQuestion

Answering

Fundamental

Text Processing

denotes the technology advanced by Deep Learning

Artificial Intelligence & Big Data Technologies

Computer Vision

ComputerVision

CCTV image analytics• Vehicle classification• Vehicle tracking• Surveillance

Particle analysis• Rice breed classification• Car park monitoring• Silk egg monitoring• Plant-hopper detection

Contact: Dr. Chai Wutiwiwatchai, NECTEC

National BioBank

Thailand’s Biodiversity: 10% of the world

How to maintain rich biodiversity in Thailand?

National Biobank for conservation, research, and utilization

Finite element analysis

Computational fluid dynamics

Molecular dynamics

Bioinformatics

Water resource simulations

Natural language processing

Density functional theory

AI & data analytics

Stencil & finite difference method

N-body problem

Sparse matrix

I/O & memory intensive computing

Dense matrix operations

Tensor computation

Graph computing

Compute-Intensive

nodes

Memory & IO intensive

nodes

GPGPU nodes

User Applications

Computing Characteristics

NSTDA Computing Infrastructure

• Genome Database Service• Data Analytics Platform as a Service• AI Research : Deep Learning,

Language Processing, Behavior Analysis

Computing Platform for Data Analytics (DA)Data Driven and Statistical Analysis

• Analytics of National Genome• Computational Fluid Dynamics• Quantum chemistry simulation for adsorbent material

design• Catalytic mechanism & design for biomass conversion

High Performance Computing (HPC)

Computational Model and Scientific Computing

NSTDACI

NSTDA Computing Infrastructure(2018-2020)

Link with National e-Science Infrastructure Consortium that NSTDA supported

National HPC infrastructure

Center for Computational Scinece

National Research Facility

e-Science

Open serviceFocus Area: Computational Science and Data Analytic

CCSCenter for Computational Science(Future)

Present Solution Future Benefit

Enabling Platform for Smart Thailand

Free graphic: www.freepik.com/free-vector/city-buildings-in-flat-design_764231.htm'>Designed by Freepik</a>

ARIPOLIS

Smart Factory

Smart Farm

Smart Living

Center for System &

Service Innovation

Center for Sensing

Innovation

Center for Computing Innovation

System

Inte

grators

Industry 2.0

Traditional Farming

Unsustainable-citiesand-communities

Productive Growth

Inclusive Growth

Green Growth

EECi EECi-ARIPOLIS Center for Computing Innovation

Summary

• HPC in Thailand is increasingly more active

• Driven by• New demand on data science , AI, IOT• More government spending in R&D

• Thailand 4.0• EEC/EECi

• Main collaboration platform• National e-science infrastructure consortium• Uninet Wunca conference• PRAGMA consortium (KU/TU/MU)

• Expected to see more HPC activities, more people• Team from Kasetsart University , Thailand is selected for

student cluster competition in ISC2018 and ASC2018

Reference

1. Panjai Tantasanawong, NREN update, The 3rd ASI@Connect Project Meeting/ March 26 2018,Matrix Building, Biopolis, Singapore

2. Somkuan Tonjan, “Development of Weather Forecasting System with High Performance Computing (Phase 1) “, Numerical Weather Prediction Sub-Division,Weather forecast Bureau , Thai Meteorological Department, Thailand (TMD)

3. Chalee Vorakulpipat, Thailand National E-science Consortium ,, National Electronics and Computer Technology Center (NECTEC)

4. Piyawut Srichaikul, NSTDA and Thailand HPC infrastructure, NAC2018

5. Manaschai Kunaseth, NSTDA HPC & DA Research, Development, and Engineering, NAC2018.

6. Kanoksri Sarinnapakorn,HAII Infrastructure and Project , HAII, Thailand

Thank you