Smart Systems? · learning Rule-based automation Optimisation algorithms Decision Support tools...

Dr Nabil Abou-RahmeGlobal Practice Leader, Data Science

23 November 2017

Harnessing the power of big data to findcreative solutions

Smart Systems?

22/11/2017 Mott MacDonald | Presentation 2

Harnessing the power of big data

1FutureIntelligence

2DigitalTransformation

3LearningFramework

4ValuingData

5ConvergingStreams

1FutureIntelligence

3LearningFramework

4ValuingData

5ConvergingStreams

Data as fuel for a circular economy

• Big data• Internet of things• Artificial intelligence• Blockchain• Quantum

1FutureIntelligence

3LearningFramework

4ValuingData

5ConvergingStreams

Mott MacDonald’s Transformation

Be digital by default

GoDigital is aboutchanging mindsets andbehaviours – it’s aboutthe way we do things.

GoDigital is an integral partof our businesstransformation and enablesdelivery.

Infrastructure Sector TransformationA call to action…

Leadership

Investment

Standards

Dialogue

Infrastructure Sector Transformation

NIC IPA

P13 i3P

Treasury BEIS

DBBCLC

CSIC UK BIMAllianceBSI

ICG ‘Project 13’ – from Transaction to Enterprise

Simple collaboration Integratedfunctions andrelationships

High performingenterprise

GovernanceOrganisationIntegration

Capable ownerDigital transformation

ICG ‘Project 13’ – Strategic Themes

Technology

ICG ‘Project 13’ – Sector Wide Approach

Infrastructure

1 2 3 4 5 6 7 8 9 1 2 3 4

1FutureIntelligence

3LearningFramework

4ValuingData

5ConvergingStreams

SCADA Customerbilling

GPS Ticketing/Counting survers

GIS CCTV

DataGenerated by assets,networks and people

Assets Customers Costs Datastorage

GIS CCTV

Data managementData is harvested,cleansed andstructured.

ImprovedintelligenceModelling Middleware Analytics

GIS CCTV

Sense makingValue is added bymaking sense of thedata. Intelligencegained can be used tosee and understandwhat’s going on.

Rule-basedautomation

DecisionSupport tools

Improved decisions

GIS CCTV

Decision makingBetter decisions, fasterand cheaper enableasset performance tobe optimised andefficiency maximised.

Improved decisions

GIS CCTV

Communicationconnects the layers andprovides an interfacewith the outside world.

This includes machine-to-machine andmachine-to-humancommunications.

Small isolated data sets

Bespoke applications

Simple decision trees

Improved decisions

GIS CCTV

Now:Responsive

Improved decisions

GIS CCTV

Datacleansing

Datastructure

Activities

SCADA Satelliteimagery

Customerbilling

BIM GPS Manufacturers’data

Ticketing/Counting survers

GIS Controlsystems

Improved decisions

Improvedintelligence

Better quality,open structure

Data analytics platform

Enhanced decision support

HUMANMachinelearning

Optimisationalgorithms

Modelling Middleware Analytics

Datacleansing

Datastructure

Activities

Customerbilling

GIS Controlsystems

An abundance of data sources at low marginal cost

Improved decisions

Next:Predictive

Datacleansing

Datastructure

Activities

Customerbilling

GIS Controlsystems

An abundance of data sources at low marginal cost

Improved decisions

Datacleansing

Datastructure

Activities

Customerbilling

GIS Controlsystems

Improved decisions

Big data streams

Federated analyticsplatforms

System intelligent decisions

Datacleansing

Datastructure

Activities

Customerbilling

GIS Controlsystems

Plus data we haven’t dreamed of yet

Improved decisions

Ideal:Adaptive

Datacleansing

Datastructure

Activities

Customerbilling

GIS Controlsystems

Plus data we haven’t dreamed of yet

Improved decisions

Datacleansing

Datastructure Activities

Customerbilling

Ticketing/Counting survers GIS Control

systemsCCTV

Improved decisions

Customer

AssetGenerated

NetworkGenerated

PersonGenerated

1FutureIntelligence

3LearningFramework

4ValuingData

5ConvergingStreams

Data science is the extraction ofactionable knowledge directly fromdata through a process ofdiscovery, hypothesis andanalytical testing – akin to thescientific method.

A convergence of expertiseData science is where our full range of skills and experience meet

Research

Datascience

Analyticsystems Algorithms

Programming skills

Domainexpertise

Statisticsdata mining

(Source: US National Institute forStandards and Technology (NIST))

22 November 2017 Mott MacDonald | Presentation 34

Disciplines that underpin data science

StrategicConsulting

MathematicalModelling

DomainIntelligence

Data Engineering Data Analytics Data Visualisation

DigitalInfrastructure

CyberSecurity

SoftwareEngineering

Hackathons

Open data is part of the answer

ODS Platform and API

22 November 2017 Mott MacDonald | Presentation 38

1FutureIntelligence

3LearningFramework

4ValuingData

5ConvergingStreams

Smarter Cities

Buildings Water

EnergyTransport

HealthyFulfilled

Maximisingpotential

Citizen

Smart data: data put into service forbetter outcomes; connecting diversedata sources, two-way interactionswith citizens

Smart infrastructure: integratedsystem of systems, for more efficient,resilient and sustainable outcomes,responsive to changing citizen needs

Smart organisation: structureddecision making and supply chain toorganise information, improveresponsiveness and achievecontinuous optimisation

Strategic Asset Management

Capableorganisation

Adaptiveresilience

Smartinfrastructure

Coherentstrategy

Integratedplanning

Targeteddelivery

Aligned objectives

Timely, effective and efficient interventions

Resilient and sustainable business that delivers its promises to its stakeholders

Continuousimprovement

1 2 3 4 5 6 7

Enablers

Decisions

Outcomes

Outputs

Mott MacDonald’s Digital Toolset

Client services

Inception Design Construction

4Site (3D multi-sector above &below ground mapping)

H2kn0w-how (real time waternetwork monitoring)

Apollo (land referencing)

Operation

STEPS (pedestrian movement) Fieldbook (GIS energy tool for utilities/pipelines)

Optimum (3D scenario & visualisation tool for space/time conflict planning)

Carbon Portal (capital & operational carbon calculating)

Design Portal (multi-sectordesign platform)

Digital Master planning (rapid collation & visualisation of available site data facts)

Strat-e-gis (congestion monitoring)

Strat-e-gis (congestion monitoring)ReVERB (noise & vibration modelling)

(real time road network monitoring)

(multiple agency coordination)

Mott MacDonald’s Integrated Platform

Client services

Inception Design Construction Operation

Thank you

To continue this conversation…

Dr Nabil Abou-RahmeGlobal Practice Leader, Data ScienceETW

nabil.abou-rahme@mottmac.com+44 121 234 1590mottmac.com

ProjectLondon 2012 OlympicGames: TransportCoordination Centre (TCC)

ClientTransport for London

LocationLondon, UK

ExpertiseSystems delivery

Opportunity:

20M spectator journeys were made during the London2012 Olympic Games. This needed to be managed toensure maximum capacity and minimal disruption.

Solution:

Merlin, our crisis and incident management system,provided stakeholders with fast access to real timeinformation, streamlining decision making.

Outcome:

This intuitive platform enhanced collaboration and helpedoperators keep the transport network moving throughoutthe Games.

ProjectWater and wastewatermanagement projects

ClientVarious local authorities

LocationVarious locations, NewZealand and Australia

ExpertiseSmart infrastructuresolutions

Opportunity:

Using the power of real-time data management can bringhuge efficiencies to the way we manage our water andwastewater assets.

Solution:

We developed H2knOw-how – an innovative sensor-based water visualisation tool – to bring real-timeunderstanding and better management to water andwastewater networks.

Outcome:

H2knOw-how is being used by 12 local authorities tostreamline asset management, improving service,releasing capacity, and cutting costs.

ProjectFlood visualisation studies

ClientVarious local authorities

LocationVarious coastal towns, UK

ExpertiseVisualisation, datamanagement

Opportunity:

Climate change is causing increasing incidents of coastalflooding, where tidal surges overtop flood defences.Visualising the impact will help mitigate the effects.

Solution:

Our Water and Wave Overtopping Tool (WWOT) bringstogether a GIS model with LiDAR data, aerialphotography and Ordnance Survey information to modelthe impact of coastal flooding.

Outcome:

Understanding the impact of coastal flooding enables usto improve flood defences, adapt relief strategies andbetter plan infrastructure investment for at risk areas.

ProjectOsprey trafficmanagement system

ClientVarious UK local authorities

LocationVarious locations, UK

ExpertiseTraffic management, smartinfrastructure

Opportunity:

UK motorists spend over 100 hours stuck in trafficjams each year. With limited scope to expand theroad network, smart solutions are needed to increaseefficiency of the road network.

Solution:

Osprey uses multiple data sources to give trafficmanagers a real-time view of how the road networkis being used, enabling congestion to monitored andmitigated through human or automated responses.

Outcome:

Osprey is now being used by 14 local authoritiesin the UK, improving traffic management andcutting congestion.

ProjectRemote sensing-basedInformation and Insurancefor Crops in EmergingEconomies (RIICE)

ClientInternational RiceResearch Institute (IRRI)

LocationEast and South East Asia

ExpertiseCost benefit analysis

Opportunity:

Rice accounts for one fifth of all calories consumedworldwide. Damage to production can have acatastrophic impact on health and the economy,especially in the rice-producing countries of Asia.

Solution:

Radar-based imaging by satellite enables the regionalgrowth of rice crop to be monitored, allowing shortfalls inyield to be predicted and relief strategies to be put inplace. A regional insurance scheme helped mitigateeconomic losses.

Outcome:

RIICE has improved food security and economicresilience in six Asian countries, while enabling scientiststo monitor the long-term effects of climate change on riceproduction.

ProjectJaipur Smart City

ClientJaipur Nagar Nigam

LocationRajasthan, India

ExpertiseStakeholder engagementand urban masterplanning

Opportunity:

The Indian government has set the goal of developing100 smart cities which are socially inclusive, sustainableand prosperous.

Solution:

We worked with stakeholders and local citizens todevelop a masterplan for Jaipur, leading to it comingahead of 97 rival cities.

Outcome:

Jaipur is now lined up for transformation into a smart city,allowing its residents and businesses to tap into thedigital economy.

ProjectCarbon Portal

ClientVarious

LocationWorldwide

ExpertiseData handlingand modelling

Opportunity:

Cutting carbon cuts costs, but until now there were notools to quantify the emissions footprint of individualBIM objects to help drive down carbon during thedesign process.

Solution:

We developed the first ever BIM-enabled carboncalculator which accurately quantifies capital andoperational carbon emissions for entire assets basedon each single BIM object.

Outcome:

We have used the Carbon Portal to optimise designand cut carbon for several clients, leading to cheaper,more sustainable assets.

ProjectHeathrow Terminal 2

ClientBAA

LocationLondon, UK

ExpertiseDesign, manage andintegrate (DMI) role

Opportunity:

Our team was chosen to design the complex ICT systemfor the £2.5bn Terminal 2 project and then to overseeprogramme delivery.

Solution:

We designed and coordinated the entire ICT systemincluding data networks, wireless and cellularcommunications, radio, security and search, CCTV,access control, building management, lighting controland displays.

Outcome:

We achieved successful implementation of the entire ICTsystem with the airport-wide ICT system, on time and onbudget, meeting Heathrow’s commercial, technical,reliability and security objectives.

ProjectHALOGEN

ClientHighways England

LocationEngland, UK

ExpertiseSystems integration

Opportunity:

Data management can help traffic managers improve theperformance of the road network, but the challenge is tohandle, store, analyse and use all this data effectively.

Solution:

We developed a range of reporting tools, website andsystem interfaces to provide the client with access toreal-time and historic data from the road network.

Outcome:

HALOGEN allows Highways England to analyseperformance of its road network, assess effectiveness ofroadside technology that supports the network andprovides a real-time feed of fault data, enabling betterroad management.

ProjectAsset records and mapviewing for field personnel

ClientPublic Service Electricand Gas (PSEG)

LocationNew Jersey, US

ExpertiseGIS, IT, documentmanagement

Opportunity:

PSEG – one of the largest combined gas and electricityutilities in the US – needed a way to bring crucialunderground infrastructure documents to their fieldcrews in a secure and reliable way.

Solution:

We uploaded the scanned images and indexes for morethan 1M service records onto Fieldbook and relayed thisto PSEG staff via secure wide area wirelessconnections.

Outcome:

Fieldbook’s data handling capability, ease of use andstrong helpdesk support system means more than 600PSEG fieldworkers can intuitively access the informationthey need, when they need it.

ProjectUnderstanding New andImproving Existing TrafficData (UNIETD)

ClientVarious nationalroads authorities

LocationEurope

ExpertiseITS research

Opportunity:

Using improved traffic data from mobile devices canprovide benefits to all road users.

Solution:

We researched new capabilities for traffic data qualityevaluation and social media harvesting to create bettersystems for short-term traffic prediction.

Outcome:

Our software toolkit enabled road authorities to providebetter and more cost-effective traffic managementservices.

Smart Systems? · learning Rule-based automation Optimisation algorithms Decision Support tools...

Documents

Dirty Data Data Cleansing

Data Quality / Data Cleansing in BW · Data Cleansing? • Data cleansing occurs at all levels. • Avoid tendency to attempt cleanse only within the BW extraction process. • Often

Cleansing/Matching Data Using the SAS Data Quality Toolset

Data Profiling and Data Cleansing Introduction · Data profiling and data cleansing are prerequisites for all of these! Other technologies to approach Big data Big Data Rule Mining

Data Quality / Data Cleansing in BW

Data Cleansing

UMDONI MUNICIPALITY ENHANCEMENT... · 2019. 11. 1. · 4.1.3 How data cleansing is done The data cleansing process is divided into three stages: (a) Database Data Cleansing. (b) Returned

GCI D'Clenz Health Data Cleansing Solutions

Data Cleansing Manual Substance Validation Group (SVG) · 2020. 9. 4. · 3 Data Cleansing Process Data cleansing as part of the EU-SRS project is performed per Substance Type and

Data Cleansing (Very Good)

Data Profiling and Data Cleansing Introduction · Introduction to research group Lecture organisation (Big) data Data sources ... Data profiling and data cleansing are prerequisites

Introduction to Data Warehousing, Profiling and Cleansing

Government Data Cleansing Services - Ricoh Europe Cleansing...Data Cleansing Services Comprehensive support for data removal from your print devices Government Ricoh’s Data Cleansing

Data Cleansing Services: Boon for Businesses

Data Cleansing Nilai Fst

Data Cleansing - cse.ust.hkdimitris/5311/P7b-DC.pdf · What is Data Cleansing •Data cleansing (data cleaning) is the process of detecting and correcting (or removing) errors or

Adaptive Data Cleansing with StreamSets and Cassandra

Data analysis and cleansing

IEJoin and Big Data Cleansing

Data Cleansing Using Best Practice Software