Open Data Policy for Digital Economy Innovation

ZENG Qin, LIU Na, CHEN Donghui, Liu Yiming

National Meteorological Information Center, CMA

1

The Digital Economy incorporates all economic activity reliant on, orsignificantly enhanced by the use of digital inputs, including digital technologies,digital infrastructure, digital services and data. It refers to all producers andconsumers, including government, that are utilizing these digital inputs in theireconomic activities.

—— OECD, Organization for Economic Co-operation & Development

In our economic reforms, we must concentrate on improving the property rights

system and ensuring the market-based allocation of factors of production.

—— statement from Chinese Policy

Data is regarded as a new factor of production

2

Integrated into Smart Power Grid Integrated into harbor management

Met Data has been deeply integrated into digital economyWeather Enterprise Needs Participants of multi-stakeholders

People-to-People weather service is evolving into Machine-to-Machine Data Driven Process3

DigitalTransformation

SensorsObservations

SeamlessMet-Service

ImpactForecastSectors NMHS

2.2 billions package deliveredfrom minutes to 7 Days

High Quality Development of Economy and Society based on New Infrastructure- ChinaDigital Meteorological Infrastructure(Cloud Computing, Earth system data, AI, Algorithms, Network)

New Technologies Accelerated the Process

4

QC/Derived OBS

Raw OBS

Analysis & PredictionAI/Sci-experiment Dataset

Time Series

Service Product

NMHS alone cannot step into the Earth System Era

CMA’s Classification of Earth System Data

Government cannot afford the whole earth system data retrieval

5

All data has a MOIDMeteorological Object Identifier

WIGOS MetaData formats

CF-complianceWIS metadata

OIDIP metadata

Data Aggregation & OpenOne Unified Open Data Policy plus Diverse Business models

Freely Open Data PolicyInternet(Data Feed, API, FTP)

Online data-algorithmsCrowd-sourced Data Entry

Offline Dataset

CMA Online Data Service

(Big Data + Big Computing) for Small Data

Tools & Techniques for Local User Data

Better Services for Local User Data

Collaboration on Dataset Refinement

Public - Private - Academia – Trial + Buy

Exchange

More Data Goes into Open data inventory

Wholesale + Retail for Diverse Needs

Exchange

Exchange

Collaboration

Collaboration

Purchase

Devices Purchased for Wider Range Data Purchase

6

Free & Open （Inventory）

—— the Unified Data Policy： Inventory based Opening

数据分类体系调研

1999

Regulationfor Scientific Data

Management

Regulation forAggregation of Meteorological

Observation data

Regulation for meteorological

information service

National Action plan for promoting the

development of big data

MeteorologicalLaw

Data Security LawOf the People’s

Republic of China

IP protection, Security Concern Inventory based data opening

2015 2015 2017 2019 20201999

Open Data Policy (Domestic/International)

7

Domestic & cross-border circulation of data

AdditionalBasic ObservationBasic AnalysisBasic Forecast

Essential

HigherSpatial

Resolution

HigherTemporal

Resolution

RegionalAnalysis

&Forecast

WMO ResolutionRes40,Res25,Res60

National Policy

GTS/WIS

Customized for industries

Value-added

Impactbased

Products

Review

Update

Review

Update

Through Security/Privacy/IP Review Non-security-involvedNon-secret-involvedNon-security-involved

Meteorological Law guarantees the authoritative voice of weather alert

Review

Update

Free & Unrestricted Open & Licensed with MOID Labeled with MOID

8

Alert (GMAS)……

Higher DensityHigher FrequencyMore variety in OBSMore Detail in product

……

Domestic law & regulationsNon-Redissemination

Intellectual Property

Non-open Observation Commercial sensitivePrivacy sensitiveSecurity sensitive

……

Accelerating Data Circulation Legallyfor Economic and Societal Benefit

New Res 42

Met-data contributes 18% of the increase revenue of our users9

We serve 350,000 users globally, and 29 industries in China

CMA Online Data Cloud Service(free/unrestricted + licensed)

Meteorological17.7% Environment &

Safety13.7%

Aerospace13.4%

Agricultural12.2%

Hydrology11.5%

Transportation6.1%

Earth Science

4.0%

Communication5.5%

Education & Research

3.5%

Forestry3.0%

Medical2.7%

Financial Insurance

1.8%Bioscience

1.7% others0.1%

Distribution of met-data users from 29 industries

>10PB

<1PB

Met Data has been deeply integrated into digital economy

10

Crowdsourcing

Private sector

Sci-experiments

volunteers

Public sector

NMS

Provincial Met-services

Municipal Met-services

County Met-services

Data aggregation

By Met-LAW

Does not mean “free”

Business Models

Crowd sourcing Industries : tourism Weather company Scientific Experiment

Met-LAW Request Met-data Aggregation

Business Model 1Local data for better local service

Join a Big Observation Network, and Enjoy Customized Micro-services

City BrainTourism

Wind Energy

Power Grids

Highway-CompanyLamp Posts

11

Exchange

Business Model 2DCaaS (Big Data + Big Computing) Service for Small Data

User Algorithm1

User Algorithm2

X1

X2

X3

X498

a1

a2

a3

a1024

a1023

.

.

.

.

.

.

498 features(hgt,sst,vort)

1024 cells

Input Layer1

a1

a2

a512

.

.

.

512 cells

a1

a64

.

.

.

256 cells

a1

a2

a1023

.

.

.

64 cells

a2

Layer2 Layer3

Layer4

Output(Typhoon

Frequency)

(x)hθ

Layer5

User Algorithm3

Cloud Provider：Security Certificated, Trusted Cloud, Also as an aggregator

Private Sectors & Other Users

Private Datapermitted

Feed-back

Like Alibaba, Amazon, Microsoft , Google Cloud12

Computational Result

Exchange

Business Model 3Free Data tools & techniques for Local Data

User contributes data， NMS provides analysis tools for free access data

Multi-source data fusion Algorithm 3D Data visualization Toolkit Downscaling algorithm

Cloud based NMHS-Database

contribution Free access via tools

13

Exchange

Reward Points/Bonus

Severe Weather Training and Test Dataset: Open Data for (AI, ML/DL)

Business Model 4Collaboration on Dataset Refinement

Open Data community vs. Opensource community

Limitations：Severe Events（Time/location/Severity）

Private Company

Local Met-Service

Academia

Refined Dataset

14

Not yet

2012-2018 Severe Weather AI Training & Data Set

Collaboration

Business Model 5:Public - Private - Academia – Trial + Buy

Academia

PrivateSectors

Non-Traditional Observation：Nano-Sat，Phased Array Radar

NMSMet

Service

Trial

BuyTrial

15

Collaboration

Business Model 6Wholesale+ Retail for diverse needs

Global Data & Regional Data Requirement

Holistic

National Data Center

Provincial MetSrv1 Provincial MetSrv2 Provincial MetSrv3

Source2 Source3 Source4

The Third Party

Integrated Nationalwide

Large scale monitoringNWP requirementsClimate monitoring

Small scale monitoringLocal government supportLocal (Smart city) service

Avoid duplicate purchaseSource1

16

Purchase

Thousands in provincesImage & Videoper 5 minitue

For non-commercial use and non-privacy-violation

Business Model 7

LOCAL

Global

Devices purchased for more data sharing

Purchase & install low-cost observations, access to wider-range data

17

Purchase/Exchange

Support :Global Data Community？

18

Data InventoryFree& unrestrictedOpen & Licensed

Charged

WMO/Bilateral

Earth ObsOrganizations

ScientificExperiments

PrivateSectors

GovernmentDepartment

Earth system modeling

Life threatening DRR

Climate monitoring

Sustainable development

Climate resource utilization

Before we exchange data， we find and organize them

Meteorological Open Data Inventory

Quality labeling

Discovery Metadata

Data License

Free & unrstricted

Network of Earth system Data Resources

Meta Data

Federated Cloud based Platform

Evaluating the contributions of members in the communityTracking & protecting the intellectual property concerned data

Data with a unified object identifier

19

Support ：Blockchain？

Open Cloud Platform

Public Private Researcher Volunteers

Tools…

Model

Data &Product

block1

block2

block n

Blockchain

DecentralizationNo-tampering

Data rightsData securityTraceability

Public Private Researcher Volunteers

Interoperability

20

ConclusionComplex World: Holistic approach, Ecosystem

By 2030, we see a world where all

nations, especially the most

vulnerable, are more resilient to the

socioeconomic consequences of

extreme weather, climate, water and

other environmental events; and

underpin their sustainable

development through the best

possible services, whether over land,

at sea or in the air.

Our Vision

Thanks for your attention!

21