Embed Size (px)
Citation preview
BigDatainTransitandRail
2
BigDataOverview• WhatisBigData?
AnylargevolumeofdataStructuredorUnstructuredCoinedinearly2000’sHadoopisBigDataFramework
• The4V’sofBigData
Volume– theScaleoftheDataVelocity – AnalysisofStreamingDataVariety – DifferentFormsofDataVeracity – QualityofData
3
BigDataVolumes
4
BigDataVelocity• Certaininformationvaluedecaysovertime.Incident orequipmentfailuredatatodayisoflessusetomorrow.
• Railvehicle sensors generatemassivelogdatainrealtime• Ridershipbehaviorcanalsobecapturedinreal-timeANDstoredfortrendanalysis
5
CybersecurityChallengesofBigDataThe“Elephant”intheRoom
• Hadoopisanopensource,java-basedprogrammingframeworkdevelopedforstoringandprocessinghugedatasets
• Aswithmostopensourcesoftware,Hadoopwasnotwrittenwithsecurityinmind
• Hadoopisfrequentlyusedwithmultiplevendorproductswhicharealsosecuritychallenged.
• TheCostofaDataBreachwithBIGDATAisnotquantifiablecurrentlybutassuredlywillbequitelarge.
• TheBiggertheData,theBiggertheRisk.• September2017:RecentsecuritybreachatEquifaxexposestheenterprisetolawsuitsestimatedtobeinthebillionsofdollars.
6
UseCase– ElectronicFarePaymentSystems
• HopFastpass(Portland,OR/Vancouver,WA)– Account-based: real-timeprocessingofpaymenttransactionsandsystem
performanceinformation– OpenArchitecture:keysysteminterfacesbasedonpublishedApplication
ProgrammingInterfaces(APIs)
– InformationProtection:separatedatarepositoriesforcustomerPII andtransitusedata
• TypesofDataAvailable– Ridership:byindividual(anonymous),farecategory,agency,typeof
service,date/time,geolocation– SalesChannel:web,mobile,retailoutlet,transitstore,vendingmachine– CustomerData:collectedviasurveyslinkedtoanonymousHopcustomer
accounts(age,income,first/lastmile,#inhousehold,etc.)– OperationalData:equipmentfailure(responseandanalysis)
7
• ServicePlanning&CustomerService
– IdentifyridershippatternsnotaccuratelycapturedbyridersurveysorAPCssuchasinter- andintra-agencytransfers
– Realtimeinformationforenhancedcustomerserviceandserviceplanning(i.e.crowdsourcingviamobile)
– Assetmanagementprovidesproactivedevicemaintenance– AccurateandsimplifiedNTD Reporting
• Third-partyIntegrations– IncentivizeTransitUse:gamifying(usetransitXX-timesearnsadiscountat
alocalretailer)– BikeShare:enhancedcustomerconvenienceandtoinfluencefirst/last
milemodechoice– CityParking:enhancedcustomerconvenienceandtoinfluencemode
choice– CongestionManagement:byknowingandinfluencingcustomerbehavior
UseCase– ElectronicFarePaymentSystemsHowMightDataBe Used?
8
Account-basedArchitectureAllSystemsFeedIntoDataWarehouse
Internet
Internet (VPN) / TriMet LAN
Mobile Inspection Device
Mobile Website and Applications
$
Bank
Transit Store POS System
Device Monitoring Tool
TVM Back Office
Maintenance Management Tool
Reporting Tool
CRM Tool
Onboard Validators
Off-Board Validators
System / Device Development Outside of Contractor Scope
Payment Gateway
Data Warehouse
Reporting System
System Monitoring and Management
Application
Retail Network
TriMet MMIS
Financial Clearing and Settlement System
Maintenance Management
System
Retail Device
TriMet General Ledger
Fare Data (to ABP)
Customer Data (to CRM)
Financial Data
Device Management Data
Legend
Customer Relationship Management (CRM) System
Web Server
Customer Website
Institutional Website
Account Management and Processing System
Fareboxes (Not Integrated)
CAD / AVL
Ticket VendingMachines
9
OtherBig Data OpportunitiesinTransitRailVehicleSensors- TheValueofNOW
10
• SafetyandSecurity – CCTValertsenableoperationsandsecurityresponse
• OperatorReportCard– fortrainingandincidentinvestigation
• RealtimeMaintenanceandFailureAlerts – fortimelypredictivemaintenanceandimprovedservice
• AccurateVehicleLocation – enhancedcustomerserviceandagencyperformancemonitoring
OtherBig Data OpportunitiesinTransitHowMightDataBe Used?
11
Trends ForBigDatainTransportation
• ThevalueofNOWmeansprocessinginreal-timeprovidesactionableinformationnotjusthistoricaldatafortrendanalysis
• ConvergenceofIoT,bigdata,andcloudservicesprovidedbyAmazonAWS,GoogleCloud,andMicrosoftAzureisenablingtransitagenciestoutilizecloudservicedashboards
• AgencieswithrecentbigdataInitiativesper2016APTA TCRPstudyinclude:
MBTA,SanJoaqin RTD,LACountyMTA,TriMet,PortAuthorityofAlleghenyCounty,CapitalMetro,UtahTransitAuthority,YorkRegionTransit,YumaCounty,andWMATA
• Thelistoftransitagencybigdataprojectswillcontinuetogrow
12
CH2MContactInformation
BrinOwen,VPPaymentSystemsCH2MSanFranciscoOffice- [email protected]
RajaKadiyala,VPIntelligentSystemsCH2MOaklandOffice- [email protected]
SusanHowardIntelligentSystemsCybersecurityAnalystCH2MPortlandOffice- [email protected]
ThankYou
