The Age of Data Driven Science and Engineering

Ali SyedPersontyle Data Science Centre of Excellence Founder and Chief Data Scientist ali.syed@persontyle.com

CoSy Seminar – 13 Oct 2015

Center for Interdisciplinary Mathematics

Uppsala University

Next 50mins….

Together we will explore…

what's happening to the world we live in,

what is all this fuss about the digital world and datafication,

why we all need to rethink and reimagine how we define and perceive academic disciplines,

emergence of data driven sciences and engineering,

explore why talent is the most important ingredient,

how EDSA is addressing the skills shortage and mass-scale upskilling challenge.

My Safe Harbour Statement!

"Any sufficiently advanced technology is indistinguishable from magic.“

Arthur C. Clarke

It seems unbelievable at first.

Amazing view of Manhattan, New York, in 1944.

Disney Research has developed the technology foraugmented reality coloring books...

DIGITIZATION

9 BillionInternet Devices

in 2012

50 BillionBy 2020

90% Created withinLast Two Years

50X GrowthBy 2020

MOBILITY

6 BillionMobile

Subscribers

87%of World’s Population

Mobile Data

Growing 78% CAGR

90%of new software

delivery for Public Cloud

Public IT cloud services will

grow to $107B in 2017

This changes the way the world works…

A continuously transforming wold.

Experience the digitization…

THE SECOND MACHINE AGE WILL HAVE GREATER IMPACT THAN EVEN THE FIRST INDUSTRIAL REVOLUTION.

A n d r e w M c A f e e a n d E r i k B r y n j o l f s s o n

“The AIs are going to take our jobs! No. They are going to transform us and our society.”Tim O'ReillyFounder and CEO, O'Reilly

All actions, interactions and behaviours both of humans and machines are stored and transmitted across

networks to keep the engines of the digital age running.

Explosion of the data…

The amount and complexity of data produced in science, business, and everyday human activity are increasing at staggering rates.

e.g. supply chain data landscape

Source: Mamatha Upadhyaya, Capgemini

Industry analysts, consultants, pundits and gurus urging the “data-naïve” to wise up to the potential of “Big Data”.

“Big data is here to stay, as it should be. But let’s be realistic: It’s an important resource

for anyone analysing data, not a silver bullet.”

GARY MARCUS & ERNEST DAVIS

Data science is an emerging and multidisciplinary way of applying our

curiosity, intuition and scientific methods to create value from

data that solves our most difficult problems.

Data science is not just a rebranding of statistics or machine learning

but rather a field unto itself.

Doing Data ScienceRachel Schutt and Cathy O'Neill.

Data science “Taking a hunch you have about the world and pursuing it in a

structural, mathematical way to understand something new

about the world.”

Hilary Mason

STATISTICS

MACHINE LEARNING

SOFTWARE ENGINEERING

DOMAIN EXPERTISE

DATABASE DESIGN & DEVELOPMENT

MATHEMATICS

DATA SCIENCESTATISTICS

MACHINE LEARNING

SOFTWARE ENGINEERING

DOMAIN EXPERTISE

DATA ENGINEERING

MATHEMATICS

SOCIOLOGY

PSYCHOLOGY

ORGANIZATION BEHAVIOUR

HUMAN COMPUTER INTERACTION

PROGRAMMING

STRATEGY & PERFORMANCE MANAGEMENT

GAMIFICATIONSOCIOLOGY

PSYCHOLOGY

ORGANIZATION BEHAVIOUR

HUMAN COMPUTER INTERACTION

PROGRAMMING

STRATEGY & PERFORMANCE MANAGEMENT

FUTURE????

I DON’T KNOW

“Our age reveres the specialist but humans are natural polymaths, at our best when

we turn our minds to many things”Robert Twigger

https://xkcd.com/755/

Unusual collaborations can often lead to….

“‘Data Scientist’ is a Data Analyst who lives in California”

"A data scientist is someone who is better at statistics than any software engineer and

better at software engineering than any statistician."

“A data scientist is a business analyst who lives in New York.”

"A data scientist is a statistician who lives in San Francisco."

"Data Science is statistics on a Mac."

Data science an uninspiring ho-hum?

One of the difficult aspects of cultivating an data driven culture is that there is a lot of noise on the topic.

Many organizations believe in the power and potential of data science but are challenged in establishing a sustainable data science capability.

Source: Balázs Kéglhttps://medium.com/@balazskegl/the-data-science-ecosystem-678459ba6013

“Distinguishing the signal from the noise requires both scientific knowledge and self-knowledge: the serenity to accept the things we cannot predict, the courage to predict the things we can, and the wisdom to know the

difference.”Nate Silver

Lot of tools for managing and reproducing complex data projects.

Typical Data Science Process

Define Objective

Extract and Analyze data

Pre-processing

Feature and Target

construction

Feature selection

Model training

Model scoring

Evaluation

Train/ Test split

Data Science is all about

building teams and culture.

“Data by itself is meaningless. It’s the skill of the data scientist that makes the difference.”

Dr. Josh Sullivan

Demand for analytics skills outstrips supply in all sectors.

“A lot more data than qualified talent. Finding talent in big data is very difficult. Retaining talent in big

data is even harder. “

Dr. Usama Fayyad

“There is a storm approaching on the Big Data talent front”

Tom Davenport

A growing divide between those that realise the potential of that data, and those with the technical skills to process, analyse and predict from it.

It is also estimated that there will be a 160% increase in demand for Big Data specialists between 2013-2020 to 346,000 new jobs.

Big Data has the potential to directly contribute €206 billion to the EU economy by 2020.

over the past 5 years the demand for Big Data staff in the UK alone had risen tenfold and currently 77% of Big Data roles are hard to fill.

Unfortunately the space is filled with a lot of charlatans masquerading as experts.

This project has received funding from theEuropean Union's Horizon 2020research and innovation programmeunder grant agreement No 643937

www.edsa-project.eu

ENABLING DATA DRIVEN DIGITAL EUROPE

Data is at the centre of the future knowledge economy and society

“NOT EVERYONE NEEDS TO BE A DATA SCIENTIST, BUT NEARLY EVERYONE WILL NEED TO LEARN

TO UTILIZE THE DATA TO MAKE MORE DATA-DRIVEN DECISIONS.”

Dr. Jeffrey CammUC Center for Business Analytic

University of Cincinnati

A well-balanced European consortium containing 9 partners from 6 European countries (UK, Germany, Sweden, Slovenia, The Netherlands and France).

Partners represent Universities (OU, KTH, SOUTHAMPTON, TU/e), Research institutions (FRAUNHOFER, JSI) SMEs (ODI, IDEXLAB SAS, Persontyle)

The EDSA consortium

www.edsa-project.eu

European Data Science Academy (EDSA) will establish a virtuous learning production cycle for Data Science, and will:

1. Analyse the sector specific skillsets for data analysts across Europe’s main industrial sectors;

2. Develop modular and adaptable curricula to meet these Data Science needs; and

3. Deliver training supported by multiplatform and multilingual learning resources based on these curricula.

Initial Version of Module

Final Module: eBook & Course

Webinar –Final Recording

Webinar –First Recording

Collection ofModule Materials Slides – First Version

Slides – Final Version

Stakeholder CommunitiesIndustrial Advisory Board

Demand AnalysisReflection

Module DisseminationOnline & F2F

Learnin

alytics

CurriculaEDSA Analytics

Dashboard

Reconfiguring & Repurposing

LearnersLearning Delivery

EDSA Design and Delivery Approach

EDSA Initial Curriculum

Source: http://www.exploringdatascience.com/

Delivery Channels - Rich Interactive OERs

Delivery Channels - VideoLectures.NET

Content

Events : 950Authors: 13, 000Lectures: 17, 600Videos: 20, 000Organisations: 7000Categories : 600Comments: 8500

Website

Video views: 6.5 millionPage views: 29 millionSigned in users: 25, 000Average time: 36 minAttachments: 620, 000Files: 1,5 million8 servers New Visitor: 60.83%Licenses: Creative Commons

Top countries: United States, India, Slovenia, UK, Germany, China, Canada

Tutorials: 350Keynote: 800Interviews:250

Delivery Channels - iTunes U

Mooc Illustration: Adam Simpson

Delivery Channels - MOOCs

Help to shape the future of data science training in Europe.

We need your data.

Help us provide the EU data science community with relevant information about the field from the inside. The more voices we can incorporate into this project, the more detail we can provide, detecting patterns and separating noise from the signals and vice versa.

Please take 10-15 minutes to fill out the demand survey.

TAKE THE SURVEY

"LISTENING TO THE DATA - DOING EXPERIMENTS, ANALYZING THE RESULTS, DIGGING DEEPER, FOLLOWING UP

ON SURPRISES - IS THE PATH TO SUCCESS."

PROF. PEDRO DOMINGOS

ALI SYED @aaalee

EMAILali.syed@persontyle.com

JOIN THE CONVERSATION:@persontyle@schooltds

WWW.PERSONTYLE.COM

The Age of Data Driven Science and Engineering

Data & Analytics

Semantic Model-driven Engineering

Assessing a Model-Driven Web-Application Engineering Approach · 2014-05-20 · Model-Driven Engineering (MDE), Software Process Assessment, Web-Engineering 1. Introduction Model-Driven

Web technologies: Model Driven Engineering

StimulatingActiveLearninginHydrologyUsingResearch-Driven ... · c American Society for Engineering Education, 2015 age 26.1400.1. Stimulating Active Learning in Hydrology Using Research

The Rise of Engineering-Driven Analytics - MathWorks · The Rise of Engineering-Driven Analytics. 2 The Rise of Engineering-Driven Analytics ... improving performance. 7 Transactions

Model Driven Engineering + Aspect Oriented Programming ... · Model Driven Engineering + Aspect Oriented Programming = Agile Model Driven Architecture ... Agile Model Driven Architecture

Model Driven Engineering : Basic Concepts - CNRlabsewiki.isti.cnr.it/_media/projects/gulyx/gssi/mde20142015/lect3.pdf · Model Driven Engineering : Basic Concepts ... Model-Driven

Data Driven Engineering 2014

Model Driven Software Engineering for Web Applications · Model Driven Software Engineering for Web Applications Summary Model driven software engineering (MDSE) is becoming a widely

Model Driven Method Engineering

Metrics-Driven Engineering

iMDE : international Market-Driven Engineering

The Age of Data-Driven Medicine

Search-Based Model-Driven Engineering€¦ · Search-Based Model-Driven Engineering ... Model-Driven Engineering (MDE) [31], [9] is a software engineering practice which uses disparate

Model driven software engineering - TU/ejohanl/educ/2II45/2010/MDEMDA.pdf · Model driven Architecture ... Model driven software engineering • UML is unified: ... • Automatic

The Rise of Engineering-Driven Analytics · The Rise of Engineering-Driven Analytics Loren Shure Consulting Application Engineer Language of Technical Computing. 2 The Rise of Engineering-Driven

Metrics-Driven Engineering at Etsy

Software Engineering, 2005Test-Driven Development 1 Test-Driven Development Software Engineering Test-Driven Development Mira Balaban Department of Computer

mobl - model-driven engineering lecture

Architecture-Driven Engineering of Cloud-Based Applications caval… · · 2013-06-25Architecture-Driven Engineering of Cloud-Based Applications ... Architecture-Driven Engineering