Upload
rainer-sternfeld
View
3.550
Download
0
Embed Size (px)
Citation preview
Rainer Sternfeld, CE September 2014
Designing a Better Planet with Big Data and Sensor Networks
November 4, 2014
ISN Conference 2014, Eindhoven Rainer Sternfeld
@rsternfeld
2 November 2014
ABB Baltic States 2006-2011 Business Development Manager, Baltics
(1,300 people, $300M revenue)
Business Development • Fast-charging network for electric cars
(first nation-wide in the world)
• Regional + Local BU strategies
• New product rollout and ramp-up
• Production management software dev.
Corporate Development • OneCampus production facilities
• SAP implemented in 3 countries
• 5S + COPQ implementation
• New operations, processes and policies
• Restructuring of operations
Statue of Liberty of Estonia (2007-2009)
ABB OneCampus (2009-2011)
eMobility Estonia (2011)
Data buoy for phytoplankton (2008-2011)
UGV+manipulator for DoD (2005-2006)
About the author | Rainer Sternfeld
3 November 2014
Data management will not scale as we know it
Sensor data will outgrow social data in 3 years
Sensor data is too big to move
Swimming in sensors, drowning in data
4 November 2014
Current Market
Connecting Devices Higher velocities Larger volumes Wider varieties
Future MarketAutomated Industries Real-time Decisions Data & Insight Markets
VERACITY
VELOCITY
Trends in industrial machine data
5 November 2014
2004 2014
• Nobody talks about Big Data (really)
• No easy and cheap way to scale business
• New growth driven by social media
• Smartphones “don’t exist” in the public eye
• MapReduce was becoming a household name(although Google had already abandoned it)
• Data is manageable
• “One size fits all” horizontal solutions
• Companies invest heavily in Big Data
• Amazon S3 has changed how new software is built
• Growth driven by connected devices
• Hadoop is the de facto data processing engine
• HDFS is the de facto storage layer
• The semantic web dream is crushed
• Companies don’t know what data they have
• Domain-specific integrated engines
Source: Bryan Cantrill, Joyent CTO, http://www.slideshare.net/bcantrill/velocity2014
A decade of Big Data
6 November 2014
We love our conscious devices
7 November 2014
Map of all devices on the Internet
August 2, 2014
8 November 2014
What about the real world? Air. Land. Oceans. Space.
9 November 2014
Sensor Data Value Chain
SATELLITES DRONES CARS BUOYS OIL PLATFORMS SHIPS TRACTORS LIGHTING
PHYSICAL CHEMICAL BIOLOGICAL OPTICAL NON-OPTICAL (RF)
TIME-SERIES RASTER ARRAYS VECTORS SEISMIC VIDEO ACOUSTIC
QA/QA OUTLIER DETECTION MODELING DATA FUSION DATA LOGISTICS VISUALIZATION ENHANCEMENT DERIVATIVES
HARDWARE SENSORS RAW DATA SOFTWARE ANALYTICS
CUSTOMER APPLICATIONS
ENERGY WEATHER AGRICULTURE TRANSPORTATION INSURANCE TELECOMMS LIGHTING HEALTHCARE
EXCLUSIVITY AND UNIQUE SOLUTIONS ARE KEY
10 November 2014
• Poor interoperability, metadata and standards
• Legacy formats and protocols
• More data, more noise
• High barrier of entry (know your market and workflows)
• High barrier of entry 2 (know your hardware)
• Miscalibration due exposure to the environment
• Diverse data acquisition patterns and sampling rates
• Irregular updates, whitelists, lost data, lost devices
Luckily, sensor data is easy. Right…
11 November 2014
Robotic ocean-borne sensor platforms
increase productivity
LIQUID ROBOTICS WAVE GLIDER
12 November 2014
A decade in marine acoustics sensor data
summer year-round
2004 2014
2K 400Kn < 10 n > 10002D 4D6 weeks 6 months
sample rate# of sensorsdimensionstime spanactivity
PGS SURVEY VESSEL, 12KM STREAMERS
13 November 2014
THE MOST NORTHERN OIL PLATFORM IN THE ARCTIC, LUKOIL (RUSSIA)
Tomorrow’s offshore oil exploration is unthinkable without integrated data systems
• MetOcean planning, expertise and monitoring • Fast crisis response • Common Operating Picture • Data vendor delivery, reporting, logs • Helps reduce non-productive time • Full software integration for centralized access to data
USE CASES
14 November 2014
• Contextual data streams across sources • SCADA • Weather and environmental data • Drones and other robotic measurement platforms • Satellite imagery
• 3D Common Operating Picture • Full software integration for centralized access to data • Event notifications
USE CASES
More data needs powerful tools. Increase the data fluency of your operations.
15 November 2014
Not so fast… Using data, Maersk proves smart routing pays off
MAERSK LINE
16 November 2014
Statistical weather models don’t work any more.
Data-driven forecasting is the only viable way.
Image Credit: NASA
17 November 2014
Prediction models are applied to local sensors and are domain-specific
18 November 2014
Satellites are getting smaller and cheaper.
150 launched since 2011 (3x of the market estimate)
SPIRE, A SAN FRANCISCO STARTUP BUILDING NON-IMAGING LOW-ORBIT NANOSATELLITES USING RF SENSORS
19 November 2014
Unmanned vehicles are estimated to grow 10x in 10 years
Image Credit: Northrop Grumman
20 November 2014
Precision Agriculture is a $3.7 trillion market
Image Credit: http://iphonedroneimagery.com/
21 November 2014
Connected cars are the next frontier in consumer markets
GOOGLE’S SELF-DRIVING CAR CONCEPT 2014
22 November 2014
Sensor Data Discovery Engine
23 November 2014
Analytical Sensor Data PlatformOcean Data Management
From a small buoy to Big Data
X-Buoy 450Market: $2 billion
Competitors: 100+ producers Scalability: poor to limited
2008 2012 2014
Market: $5 billion Competitors: 25+
Scalability: good but slow
Market: $100+ billion Competitors: 15+
Scalability: very scalable & fast if P/M fit
24 November 2014
One interface to discover local, remote, open and vendor data
25 November 2014
Explore, visualize, monitor and build datasets
Advanced Data Discovery Raster data / heat map overlays Access with third party applications
Raster data / quiver plots Graph Monitor Build custom datasets
26 November 2014
Integrate, curate, control access and monitor dataflows
Rich browsing experience of existing data Integrate and configure new data channels
Roles, authorizations and logs Dataflow Dashboard
27 November 2014
Access to vendor and open dataImage Credit: NASA
• 42,000+ data streams • 33 organizations • Up to 100 years of historic data • 7,400+ professionals
OPEN DATA
• Discover data you didn’t have • Buy single datasets • Instantly subscribe to vendor deliveries • All your vendors in one place
VENDOR DATA
28 November 2014
<
Keep the data where it is. Let us discover and index it.
DATA PIPELINE
Acquisition
Transformation
Indexing
Storage
Configuration
Dashboard
DATA CURATION
DATA DISCOVERY
DATA STUDIO
Access Control
Data Curation
Asset Directory
Metadata Edit
References
Audit Logs
Query
Browse
Contextualize
Visualize
Grouping
Bookmark
Filter
Visualization
Data Fusion
Monitoring
Annotation
Collaborate
Marketplace
Analytics
Dynamic Datasets
APIs
EMBEDDED FEATURES
Crawlers
LOCAL SOURCES
REMOTE SOURCES
VENDORS DATA
OPEN DATA
Crawlers
Integration
Integration
29 November 2014
Supported data types and formats
29
VIDEO SONARS (ADCP)
SPATIO-TEMPORAL INDEXING
TIME-SERIES
DATA TYPES
VECTORS
ARRAYS
RASTERS
INSTRUMENTS
SATELLITES
IN-SITU DEVICES
MODELS
HF RADARS
SEISMIC
M
M
M Metadata-level
30 November 2014
Sources http://www.wired.com/images_blogs/beyond_the_beyond/2012/11/ge-industrial.jpg
Image Credit: General Electric
31 November 2014
Sources http://www.environmentalleader.com/wp-content/uploads/2012/11/GE-industrial-internet.jpg
Image Credit:General Electric
32 November 2014
Image Credit: CISCO
33 November 2014
What about security?
CONFIDENTIALITY
INTEGRITY
AVAILABILITY
STANDARDS
34 November 2014
There are always the bad guys
35 November 2014
• Trusted digital certificates to authenticate the identity of devices
• Tools to protect software code integrity from being compromised
• Protecting a user's private information
• Protecting and managing digital content rights
Big Data clouds need trust management
36
Index the real world