Embed Size (px)
Citation preview
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Solving Big Data Database
Challenges with Redis
December 1, 2016
DAT308
Manish Gupta, Jacqueline Hufford-Jensen,
George Chiramattel, Kyle Oppenheim
2
Panel
Kyle OppenheimVP, Engineering
Jacqueline Hufford-JensenSr Mgr, Database Administration
George ChiramattelPrincipal Engineer
Manish GuptaCMO
3
Industry Dynamics
Data Complexity
Cloud/Hybrid
Real-Time Insights
Systems of Innovation vs. Systems of Record
Performance
Scalability
Flexibility
Ease of Use
Economic Impact
Technical Talent
250+ Databases
dBaaS / dbPaaS
Managed Services
Multi-model
Memory Flexibility
Macro Drivers Database Challenges Industry ResponseAdvancedMachine Learning
Big Data
Web
CRM
ERP
4
Introduction
The open source home and commercial provider of Enterprise Redis software and Redis-as-a-Service.
Open source. The leading in-memory database platform, supporting any high-performance operational or analytic use case.
5
NoSQL Relational
Redis
CassandraMongo
Caching
Key-Value
Search Graph
Oracle
MySQL
Microsoft SQL
PostgreSQL
DB2
Specialized
Redis’ Market Position
is the Home of Redis.
6
Redis’ Popularity
……..#1 NoSQL in User Satisfaction and Market Presence
……..#1 NoSQL among Top 10 Data Stores
……..#1 database on Docker
#1 NoSQL database deployed in containers
………#1 in growth among top 3 NoSQL databases
………#1 database in skill demand
………# 1 database in Top Paying Technologies
7
Power of Redis
Simplicity Extensibility Performance
ListsSorted Sets
Hashes Hyperlog-logs
Geospatial Indexes
Bitmaps
SetsStrings
Bit field
NoSQL Benchmark Redis Data Structures Redis Modules
8
Redis Labs Innovation
INN
OV
ATI
ON
VALUE
Open Source Redis
Enterprise Redis Service
Redis-on-Flash
Redis Modules
SimplicityPerformance
AvailabilityScalability
Deployment Flexibility
Time to MarketResource Efficiency
+ + +
Enterprise Redis OnPrem
Redis Machine Learning
9
Financial Services
Redis Labs Deployments
Advertising
Media
Technology
Communications
Education
Gaming
Banks
Retail/E-commerce Business Services
Social Travel
60,000 Accounts6600 Enterprise Customers 230K+ Databases 450 Databases/day
10
Redis Labs Ecosystem
+OSS
Community
Modules
Solutions PaaS
IaaS
Hardware
Services Resellers
Languages & Libraries
11
Redis Addresses Diverse Use Cases
High-Speed Transactions
Analytics
Time-Series Caching
Data Ingestion Job & QueueGeo Search
Social Functionality
12
Redis Labs’ Survey Results
What is your Redis use case? What type of solution are you using Redis in?
Consumers Small Businesses Accounting Professionals
Who we serve:
15
Intuit: Real Time Redis
Why Redis:• Functions as database, message
broker, cache, effortlessly at very high performance
• Highly available, stable performance with very low hardware requirements
• Message broker in mobile
application
• Personalization -
Recommendations engine
• High-performance caching for
API layer
Redis used for:
Intuit Use Cases
16
Intuit: Internal Redis Use Case
X
X
X
X
Business Challenge
Need to have fast response times from the front end service to the back-end service for the call center system.
Redis Labs Solution Redis is the Primary Data store
Redis is the integration DB and system of record. It stores conversation and appointment state data and lookup information
Conversation service uses Redis to store and access conversation data to support the high load and fast response to the front end while buffering high volumes from the back-end services
Key: Performance, multi-DC replication, and support because this is mission critical
18
LifeLock Use Case
LifeLock: Redis Cost/Performance Wins
Why Redis:• Keystore functionality• High Availability• Cost of Redis• Straightforwardness of
implementation – limited SMEs• Deployed Internally/On-Premises • Session management
• OAuth
• Token-based authentication
• Token-based authorization
Redis used for:
19
LifeLock: Additional details
Component Interaction
Diagram (Just the OAuth flow)
R1 R3R2
More than 1 billion units sold
Over $20 billion saved for consumers life-to-date in North America
50 million active customers
60% of transactions on mobile
21
Groupon: Relying on Redis
Why Redis:• High performance – helps
application stay responsive and scale to handle gigantic Groupon audience
• Versatile, flexible for many different uses with variably structured data
• Choosing relevant deals for users
• Fraud countermeasures
• Inventory control
• Task queues for orders & email
Redis used for:
Groupon Use Cases
22
Groupon: Choosing Relevant Deals
Great Deals
Data
Aggregator
Ranked Offers
Usage Logs
Redis ingests Groupon usage data in near-real-time.
That data influences the deals users see.
23
Groupon: Preventing Fraud
Redis helps find duplicate accounts quickly.
user_id = 1000
Kyle Oppenheim
3101 Park BlvdPalo Alto, CA 94306
Visa:4111 1111 1111 1111
10.0.0.1
cookie: oatmeal
user_id = 9876
Manish Gupta
3101 Park BlvdPalo Alto, CA 94306
Visa:4111 1111 1111 1111
192.168.0.1
cookie: peanutbutter
Visa:4111 1111 1111 1111
10009876
Key Value
(set)
Woah!Two users sharing a credit
card?
24
Panel
Kyle OppenheimVP, Engineering
Jacqueline Hufford-JensenSr Mgr, Database Administration
George ChiramattelPrincipal Engineer
Manish GuptaCMO
Visit us at booth #615
Thank you!
Remember to complete
your evaluations!
