Upload
hadoop-summit
View
550
Download
0
Embed Size (px)
Citation preview
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Tom Bryans
Delivery ManagerFord Motor CompanyConnected Vehicle Data Platform
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Shift in Business Model
A car company AND A mobility company
Connected Vehicle
Ford Copyright 2016 ©
Connected Vehicle Data Platform
What is a connected Vehicle?
Vehicle has the means to transmit data.
Vehicle has the means to receive data.
Ford Copyright 2016 ©
Connected Vehicle Data Platform
How do we collect data from Connected Vehicles?Data Over Voice
Embedded Modems
Plug In Devices
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Where does data go from the Vehicle?Data Over Voice
Embedded Modems
Plug In Devices
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Where does data go from the Cloud?
Store
Land Transform
Ford Copyright 2016 ©
Connected Vehicle Data Platform
What data is collected from Connected vehicles?• Signals/Messages
• Diagnostic Trouble Codes
• Warning Indicator Lamp Status
Ford Copyright 2016 ©
Connected Vehicle Data Platform
How much data can a Vehicle Generate?A single Vehicle can generate 25GB of Controller Area Network (CAN) Traffic in an hour.
What does the data look like ? TkEiASwYVQxwFSRRM0ZBNlAwU1UyRFIzMzIzNTkBaCILAAF+ItYvADkl0AoYVQxvAggiFwAQAAQEAAAAAAjgKyQABAAAKIAB/4H/gF4ABiXcAAYmFQA/AjgCcBACCwgPBb0BIIFRQb/AACAgpQQAgsINjB+ItYvADkl0 ……
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Use Case: SYNC Connect Remote Start
RS Rcvd Fr MblRS Sent To Veh
RSC Rcvd Fr VehRSC Sent To Mbl
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Use Case: Variable Lease
Odometer$350/Month 24 months 24k miles
$250/Month 24 months + $.xx /mile
Connected Vehicle Data Platform
Ford Copyright 2016 ©
Receive Azure Event Hub SFTP RESTful WS Internal
DataBase
SqoopStorm Spout & Bolts
Oozie Workflow
Java application
Yes
Java Web Service
ORC Hive TablesData Access
Data Loading
Transform
Scheduling
Landing
Ingestion
HDFS
No
HBase
Java MapReduce PiG
De-dup Logic Data Classification Hive Partitioning Validation
Security Ranger
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Opportunities
Data Privacy
Integration with Partnersand SuppliersSecurity
Standards & Frameworks
Country Specific Regulations
Storage & Updates
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Production:• 261 Data Nodes• 5220 CPU Cores• 65 TB RAM• 5 PB Usable Storage• 10 Racks / 130 kW Power
Hadoop Capacities
Note: Usable storage assumes 3x replication in cluster.
Ford Copyright 2016 ©
Connected Vehicle Data Platform
Questions & Answers