117
#UNGlobalPlatform UN Global Platform Mark Craddock #UNGlobalPlatform @mcraddock @UNBigData 1

UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN Global PlatformMark Craddock

#UNGlobalPlatform@mcraddock@UNBigData

1

Page 2: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 2

Vision: A global collaboration to harness

the power of data for better lives

Page 3: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Global Platform◎ Trusted Data ◎ Trusted Methods◎ Trusted Learning◎ Trusted Partners

◎ AI/ML Ready

Page 4: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 4

Data revolution

Digital transformation

New data sources

Competition among data

providers

Globalisation

Sustainable development

Geo-referencing

Quality vs. resources

Reduced budgets

Reducing response burden

Differentiation of users

Integrated monitoring

Timeliness

Drivers of innovation and modernisation

Page 5: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 5

Page 6: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN GWG (Big) Data Organisational Structure

6

Page 7: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN GWG (Big) Data Membership

7

Australia; Bangladesh; Brazil; Cameroon; Canada; China; Colombia; Denmark; Egypt; Germany; Indonesia; Ireland; Italy; Mexico; Morocco; Poland; Netherlands; Oman; Pakistan; Philippines; Republic of Korea; Saudi Arabia; Switzerland; United Arab Emirates; United Kingdom; United Republic of Tanzania; United States of America

United Nations Statistics Division, United Nations Economic Commission for Africa , Nations Economic and Social Commission for Asia and the Pacific, United Nations Economic Commission for Europe, United Nations Statistical Institute for Asia and the Pacific, United Nations Global Pulse, International Telecommunication Union, Universal Postal Union, African Development Bank; CARICOM, GCCSTAT, Eurostat/European Commission, International Monetary Fund, OECD, World Bank

Page 8: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Australia

8

Page 9: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Bangladesh

9

Page 10: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Brazil

10

Page 11: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Cameroon

11

Page 12: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Canada

12

Page 13: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

China

13

Page 14: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Colombia

14

Page 15: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Denmark

15

Page 16: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Egypt

16

Page 17: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Germany

17

Page 18: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Indonesia

18

Page 19: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Ireland

19

Page 20: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Italy

20

Page 21: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Mexico

21

Page 22: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Morocco

22

Page 23: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Poland

23

Page 24: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Netherlands

24

Page 25: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Oman

25

Page 26: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Pakistan

26

Page 27: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Philippines

27

Page 28: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Republic of Korea

28

Page 29: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Saudi Arabia

29

Page 30: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Switzerland

30

Page 31: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

United Arab Emirates

31

Page 32: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

United Kingdom

32

Page 33: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

United Republic of Tanzania

33

Page 34: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

United States of America

34

Page 35: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 35

Data Collaborative

Page 36: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 36

Using the

Platform

Become a trusted partner

Access the new platform

Discover new data

and methods

Share data

Set-upproject based collaboration

Learn from best practice

modernize statistics and

analysis

Page 37: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

AI/ML Ready

37

Page 38: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

AI/ML Ready

◎ Earth Observation Service◉ Train Machine Learning Models◉ Analyse Satellite Imagery

◎ Methods Service◉ Deploy and manage machine

learning models◉ API enable machine learning

models

38

Page 39: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

AI/ML Ready

◎ Location Analytics Service◉ ML / Pattern of Life

39

Page 40: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Online Community

40

Page 41: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Online Community

◎ Sharing / Collaboration◎ 230+ people in 14 timezones◎ 4,000+ messages over last 30 days◎ Algorithms, Data, Services, Methods,

AIS, ADS-B, Cloud Vendors, Privacy Task Team, Task Teams

◎ Join (http://bit.ly/join-ungp-slack)41

Page 42: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Working Practices

42

Page 43: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Working Practices

◎ Work in the open◉ Transparent, sharing, collaborating

◎ Working Online◉ Online document sharing, online

communications channels, online kanban/activity tracking, online training

43

Page 44: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Working Practices

◎ Delivery first◉ Agile practices, prototype/demo,

publish early working functionality, reuse-recycle, iterate, user and customer focus, empowered teams and individuals

44

Page 45: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Global Standards

45

Page 47: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Security

47

Page 48: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Security

◎ DDOS/DNS◉ CloudFlare◉ The DDoS That Almost Broke the

Internet◉ Multi user administration / access◉ Audit logs

◎ Content Delivery Network (CDN)◉ CloudFlare

48

Page 49: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Security

◎ CloudFlare - Project Galileo◉ If you are an organization working

on behalf of the arts, human rights, civil society, or democracy, you can apply for Project Galileo to get Cloudflare’s highest level of protection, for free.

49

Page 50: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Strategy

50

Page 51: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 51

Strategy

Page 52: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 52

Wardley Maps

Page 53: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Global Billing

53

Page 54: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Global Billing

Task Team

A

Hub

Task Team

Y

Hub

Task Team

B

Project Y

54

Hub

Page 55: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Global Billing

◎ Consolidate Billing Globally◉ Alibaba, Amazon, Azure, Microsoft,

Service Partners◎ Leverage Discounts◎ Manage Credits◎ Allocate Budgets

◉ Per Task Team◉ Per Partner◉ Per Program

55

Page 56: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology StrategyHandbook

56

Page 57: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Mapping the Technology Landscape◉ Cloud◉ Machine Learning◉ Big Data◉ Serverless◉ IoT◉ Privacy Preserving Techniques

57

Page 58: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Mapping the Technology Landscape◉ Anchor, Position & Movement

◎ Strategy Cycle◉ Why of Purpose, Landscape,

Climate, Doctrine, Leadership◉ Observe. Orient and Decide, Why

of Movement. Why should we be taking this action over that action.

58

Page 59: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Mapping the Landscape◉ Cloud◉ Machine Learning◉ Big Data◉ Serverless◉ IoT◉ Privacy Preserving Techniques

59

Page 60: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Strategy Cycle

60

Page 61: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Doctrine◉ Know your users (e.g. customers,

shareholders, regulators, staff)◉ Focus on user needs ◉ Focus on high situational

awareness (understand what is being considered)

61

Page 62: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Doctrine◉ Use a common language

(necessary for collaboration) ◉ Be transparent (a bias towards

open)◉ Challenge assumptions (speak up

and question) ◉ Use a systematic mechanism of

learning (a bias towards data)62

Page 63: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Doctrine◉ Remove bias and duplication◉ Think small (as in know the details) ◉ Use appropriate methods (e.g.

agile vs lean vs six sigma)◉ Move fast (an imperfect plan

executed today is better than a perfect plan executed tomorrow)

63

Page 64: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Technology Strategy Handbook

◎ Doctrine◉ Be pragmatic (it doesn’t matter if

the cat is black or white as long as it catches mice)

◉ Manage inertia (e.g. existing practice, political capital, previous investment)

◉ Effectiveness over efficiency◉ Leave no-one behind

64

Page 65: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Privacy Preserving Techniques Handbook

65

Page 66: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Cryptographic Techniques

◎ Multi-party Computation

◎ Fully Homomorphic Encryption

◎ Zero Knowledge Proofs

◎ Trusted Execution Environments

◎ Differential Privacy66

Page 67: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Cryptographic Techniques

◎ UN Privacy Preserving Techniques Handbook

◎ Proof of Concepts for 62nd ISI World Statistics Congress◉ Health Statistics◉ Trade Statistics◉ Synthetic Data

67

Page 68: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Business Case/Model

68

Page 69: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Business Case/Model

◎ Business Model◎ Business Case◎ Funding Model◎ Operations Model◎ Programs & Partnerships

69

Page 70: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Platform Business Model

◎ A means of connection◎ Orchestrates an

ecosystem◎ Utilises the network effect◎ Aggregates supply and

demand◎ Remove frictions◎ Can have more than one

type of value exchange going on

70

Means of connection

Orchestrates Ecosystem

Utilises Network

EffectAggregates Supply and

Demand

Removes Friction Platform

Business Model

Page 71: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Programs & Partnerships

71

Page 72: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Platform Partners

◎ Provide Core Platform Services◎ Provide Services within the Platform◎ Joint Marketing◎ Conferences

72

Page 73: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Hubs

◎ Official Partners◎ Research◎ Global Support◎ Program Based◎ Specialists

◉ AI / ML◉ Environment◉ Mobile

73

Page 74: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

● 24/7 ‘follow the sun’global support model

Global Support ModelAmericas

Europe

Middle East and Africa

APAC

Page 75: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Hub/Partner Framework

◎ Policies◎ Principles◎ Data Ethics◎ Data Policy Framework◎ Technical Standards

75

Page 76: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN Global PlatformGavin Phillips

#UNGlobalPlatform

@UNBigData

76

Page 77: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Achievements - March ‘19

Earth Observation

Service Alpha

Global Billing Marketplace

Business Model Options

Location Analytics

Service Alpha

Global Datasets:AIS, ADSB,

Satellite

Draft Information Technology

Strategy Handbook

77

Methods Service Alpha

Privacy Techniques Handbook

Code Repository

Service

Developers Service

Global Cloud Services

Page 78: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Global Datasets

78

Page 79: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

3Global Big Datasets

40,000,000+AIS Records / Day

100,000,000,000+ADS-B Records

79

Page 80: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Automatic Identification System (AIS)

◎ 40 Million Records / Day◎ Ship Position / Movement◎ 3 Months Trial

◎ Analysis via◉ Methods Service◉ Location (Stealth) Service◉ Jupyter Notebooks◉ APIs

80

Page 81: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Automatic Dependent Surveillance (ADS-B)

◎ 3 Million Records / Second◎ Aircraft Position / Movement◎ 100 Billion Records

◎ Analysis via◉ Methods Service◉ Location (Stealth) Service◉ Jupyter Notebooks◉ APIs

81

Page 82: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Satellite Imagery

◎ Open Data◉ Landsat◉ Sentinel

◎ Commercial◉ Planet (Trial)◉ AirBus (Trial)

○ 1.5m Resolution○ 0.5m Cities

82

Page 83: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN Global PlatformServices

83

Page 84: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Marketplace

AIS

ADS-B

SatelliteImagery

Global Billing

Trusted Methods Service

Earth Observation

Service

Developers Service

Location Analytics Service

84

OnlineCommunity

AI / ML Ready

Page 85: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN Global Platform - Update

◎ Trusted Methods Library/Service◉ https://methods.officialstatistics.org

◎ Earth Observation Service◉ https://eo.officialstatistics.org

◎ Location Analytics Service◉ https://location.officialstatistics.org

◎ Marketplace◉ https://marketplace.officialstatistics.org/

85

Page 86: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN Global Platform - Update

◎ Jupyter Service◉ https://jupyter.officialstatistics.org

◎ Operations Service◉ https://operations.officialstatistics.org

◎ Helpdesk Service◉ [email protected]

86

Page 87: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Operations Service

87

Page 88: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Marketplace

88

Page 89: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Marketplace

◎ Alpha Marketplace Live◎ One place to search for

trusted data, applications, partners, methods, algorithms and services

◎ Self Manage Listings (Task Teams, Partners, NSIs)

89

Page 90: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Demo Time

90

Page 91: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Location Analytics Service

◎ Visualise and Analyse Location Data◉ AIS◉ ADS-B◉ Mobile Phone◉ “Anything that moves”

◎ Real time data feeds◎ Visualise and Analyse Anything That

Moves

91

Page 92: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Location Analytics Service

◎ AIS Data Source 1◉ 6GB / Day Ingest◉ 1.23TB◉ From Oct ‘18

◎ AIS Data Source 2◉ 29GB / Day Ingest◉ 1.41TB◉ From April ‘19

*15th May 2019

92

Page 93: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Location Analytics Service

◎ ASDB Data Source◉ 13GB / Day Ingest◉ 4.49TB*◉ From Oct ‘18

*15th May 2019

93

Page 94: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Location Analytics Service

94

Page 95: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Demo Time

95

Page 96: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Methods Service

96

Page 97: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

AnalyseData

ProcessData

CollectData R, Python

Programming

EvaluateData

Crowdsourcing, Polling & Web surveys

Commercial Data

Web Scraping & Text Mining

Statistics & DataSkills

Geospatial Analysis

Forecasting & Modelling

Administrative Micro-Data

DesignData

Policy Simulation & Visual Data Analytics

DisseminateData

SHARE &DESIGN

ALGORITHMSMANAGE D

ATA

LIFECYCLE

APPLY DATA SCIENCE

TECHNIQUES

NEW

DATA SOURCE

Page 98: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 98

Method Service

◎ Methods and algorithms must be easy to share and reuse

◎ Methods must be documented and of known quality

◎ Methods must not place too many technology dependencies on users

Page 99: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 99

Methods Service

◎ Provides a library for trusted methods and algorithms that:◉ Member countries can

collaboratively populate, manage and use

◉ Allows easy sharing and development of new algorithms

◉ Does not require specialist knowledge or equipment

Page 100: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 100

Methods Service

◎ The library needs to:◉ Scale◉ Integrate with the rest of the UN

Global Platform technology stack◉ Be extensible to new use cases

Page 101: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform 101

Method Service

◎ Code, documentation and execution◎ Deploy without software engineers◎ Scalable workers & GPUs◎ Organisations: code collaboration,

inheritance & governance◎ Standard APIs to call all algorithms◎ Use for production and prospective

purposes

Page 102: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Demo Time

102

Page 103: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Earth Observation Service

◎ Analyse Satellite Imagery◎ Common Satellite Data◎ Commercial Satellite Data◎ Common Algorithms (NDVI, NDWI)◎ Machine Learning

103

Page 104: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Earth Observation Service

◎ Roles Based Access Controls◉ Users◉ Teams◉ Organisations◉ Share/Publish◉ Collaboration

104

Page 105: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Earth Observation Service

105

Page 106: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Historical AVHRR satellite images

106

Page 107: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Historical AVHRR satellite images

107

Page 108: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Demo Time

108

Page 109: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Roadmap

109

Page 110: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Roadmap - March ‘20

Global Authentication

Service

March ‘2051st UNSC

Framework Agreements

5th International Conference

onBig Data for

Official Statistics

Privacy Techniques

PoCs

110

Release Strategy

Handbook

AlphaData as a Service

Privacy Task Team

Legal Sub-Group

62nd ISI Conference

Final Business

Case/Model

Page 111: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Roadmap - March ‘20

111

◎ Alpha◉ Data Service◉ Developers Jupyter Service

◎ Beta◉ Global Billing◉ Marketplace◉ Earth Observation Service◉ Geospatial Analytics Service◉ Methods Library/Service

Page 112: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

How Can You Get Involved?

112

Page 113: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

How Can You Get Involved?

◎ Task Teams◎ Administration Tasks◎ Technical Specialists◎ Cloud Specialist Group◎ Machine Learning Models

◎ Covered by an MOU

113

Page 114: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

UN Global Platform

Faster. Quality. Statistics

114

Page 115: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Thanks!

Any questions?You can find me at @mcraddock & [email protected]

115

Page 116: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Additional Information

116

Page 117: UN Global Platform...collaboration to harness the power of data for better lives #UNGlobalPlatform Global Platform Trusted Data Trusted Methods Trusted Learning Trusted Partners AI/ML

#UNGlobalPlatform

Future Events

◎ 62nd ISI World Statistics Congress◉ UN Statistics Division (UNSD)

Symposium on Data Science and Official Statistics jointly organized with UNESCAP and UN Global Working Group on Big Data for Official Statistics, 15 - 17 August 2019

117