Upload
brandon-obrien
View
41
Download
2
Embed Size (px)
Citation preview
Streaming Data PlatformsBrandon O’Brien@hakczarExpedia, Inc
Outline Use Cases
Streaming Data Opportunities & Challenges
Streaming Data Platform at Expedia
Questions?
Outline Use Cases
Streaming Data Opportunities & Challenges
Streaming Data Platform at Expedia
Questions?
Use Case: Streaming Analytics
Outline Use Cases
Streaming Data Opportunities & Challenges
Streaming Data Platform at Expedia
Questions?
Streaming Data: Opportunities
Data -> Insights -> Products -> $$$
Fresher data = better
However…
Streaming Data: Challenges Today’s Challenge: System integration
System level: N^2 integrations Team level: Roadmap alignment
Streaming Data: Solutions Solution:
Kafka with Streaming Data Platform Decoupled systems & roadmaps Easy publish Easy consume Central data depot
Talk Focus: Streaming Data Platform that makes life easier
for Kafka producers and consumers
Outline Use Cases
Streaming Data Opportunities & Challenges
Streaming Data Platform at Expedia
Questions?
Platform Architecture
Streaming Data Platform Self-Service
Centralized Data Depot (logical)
DevOps: Primer, CICD, Cloud
Elastic Components
Monitoring: Velocity, Lag
Streaming Data Platform cont’d Producers
Publish data to HTTP Ingestor endpoint Ingestor -> Kafka Ingestor -> S3
Consumers Create skeleton apps with built-in Kafka
integration CICD pipeline for deployments
Changes the Conversation
Streaming Data PlatformsBrandon O’Brien@hakczarExpedia, Inc
Questions?