Upload
voltdb
View
517
Download
0
Embed Size (px)
Citation preview
page
TRANSFORMING YOUR BUSINESS WITH FAST DATA – FIVE USE CASE EXAMPLES
1
page© 2015 VoltDB
OUR SPEAKERS
2
Dheeraj RemellaDir. of Solutions Architecture, VoltDB
Peter VescusoCMO, VoltDB
page© 2015 VoltDB
DATA-FICATION OF LIFE"Smartness can be embedded everywhere," said Professor Sangiovanni-Vincentelli, EE/CS at University of California at Berkeley. "The entire environment is going to be full of sensors of all kinds. Chemical sensors, cameras and microphones of all types and shapes. Sensors will check the quality of the air and temperatures. Microphones around your environment will listen to you giving commands.“
The 10 Trillion Device World
Computerworld, September 2015
3
page
FAST = ADVANTAGE
4© 2015 VoltDB
page© 2015 VoltDB
IN THE FUTURE….
5
All businesses will compete on their ability to make decisions “in the moment” using Fast Data.
page
6
Big Data
“Perishable insights can have exponentially more value than after-the-fact traditional historical analytics.”
Mike Gualtieri, Principal Analyst, Forrester Research
Fast Data
page
WHAT’S NEW HERE?
7
Analytics Action
page© 2015 VoltDB
TRANSFORM YOUR BUSINESS TO FAST
• Fast is different than Big
• VoltDB is the industry’s only purpose-built architecture for fast data
• VoltDB has helped hundreds of developers build fast data apps
8
page© 2015 VoltDB
TRANSFORM YOUR BUSINESS TO FAST
Use Cases
9
Interactive personalized, customer engagementPrecision resource counting and billing
Real-time policy enforcementOperations and manufacturing
IoT sensor data processing
page© 2015 VoltDB
VOLTDB: DESIGNED BY DATABASE ‘SUPER FRIENDS’• Fast Data Technology
• In-Memory operational DB + Data Pipeline• Scale-out architecture, SQL + Java
• Designed by database ‘super friends’• Mike Stonebraker, MIT, 2014 Turing Award Winner• Dan Abadi, Yale• Sam Madden, MIT• Andy Pavlo, CMU• Stan Zdonik, Brown University
10
page© 2015 VoltDB
DATA FLOWS
11
Pipeline Data Lake
Ingest
Real Time Analytics
Export
Using Real Time Data
Request/ Response
page© 2015 VoltDB
COUNTING / BALANCE KEEPING
12
• High rate of ingestion• Rapidly changing data• Materialized Views• Real-time Group By counts and sums
page© 2015 VoltDB
COUNTING / BALANCE KEEPING
13
• “Last Dollar” problem• Accuracy is important:• For billing• To decide the right action
page 14© 2015 VoltDB
AIRPUSH
• Pay for placement, bill for clicks• Correlate clicks to ad budgets• Ad campaign balance tracking• Cost of overshooting budget:
• Lost revenue• Opportunity cost• Bidding cost (would have been a lower bid)
• Real-time analytics to support budget optimization• Reduced infrastructure costs
page© 2015 VoltDB
MaxCDN
• Content delivery network (CDN)• Real-time analytics of content delivery
• Over 32 TB of daily web server log data• 300K log records per second
• Accurate billing• Custom bulk-loading to batch records by partition• Procedures load a batch of hundreds of records• Ad-Hoc SQL queries• Reduced infrastructure costs
15
page© 2015 VoltDB
SESSIONIZATION / CORRELATION
• Sessions consist of segments or events • Can arrive out of order• While ingesting each event:
• Query to correlate with previous events in session• Process when session is complete
• Known “last” event arrives• Check for a complete set
16
Events Sessions
page© 2015 VoltDB
Business model: convert from free to fee• They needed to select a database that could
• Give consistent single figure millisecond response times for complex transactions
• Maintain in near real time potentially hundreds of transactionally consistent metrics for a user
• This is vital in the online game industry• Games change on a weekly basis to sustain growth• Massive numbers of players, creating billions of
data points• Real-time in game interaction to catch the player at
exactly the right point17
DELTADNA
page© 2015 VoltDB
EVENT DETECTION
• Filtered events• Aggregate events crossing
thresholds• Calendar events within range• Geo-spatial entry or exit events
• Patterns of events• A then B• A then B then 3 or more C’s• Threshold exceeded then 2 or
more D’s• Complexity leads to a Rules Engine
18
Raw Events Business Events
page© 2015 VoltDB
PERSONALIZATION
• Personalized experiences• Fast retrieval and intelligent use of
user data• Segment• Preferences• History• Recommendations
19
page© 2015 VoltDB
REAL-TIME EVENT DECISIONINGPLATFORM
20
Deliver the best interaction
aligned to each
individual customer in
real-time to drive customer
engagement & maximise
business results
page© 2015 VoltDB 21
• Ingest Mobile Phone usage events in real-time• Detect marketing opportunity events
• First time use of a feature• Plan usage thresholds: 50%, 75%, 90%, 95%, 100%• Time left, or time since activation, first use, etc.
• Personalize offers by segment and history• Pre-paid phones = much more customer
engagement• Measure success rate of offers• A/B testing
Emagine results show the power of real-time to be
1.5 to 2.5 times greater
page© 2015 VoltDB
REAL-TIME CALCULATIONS
• Similar to Counting:• High rate of ingestion• Rapidly changing data• Materialized Views• Group By counts and
sums• Real-time• Accurate
• More complex calculations• Not just aggregation• Stored procedures
retrieve history to calculate and update values
22
page© 2015 VoltDB
MAJOR FINANCIAL CUSTOMER• National Best Bid and Offer (NBBO)
• The lowest available ask price and highest available bid price across all markets
• Upsert a table with the latest prices for each stock from each market, then query to find the best prices
• Volume-weighted average price (VWAP)• SUM(price*quantity)/SUM(quantity)
• Time-weighted average price (TWAP)• SUM(price*seconds at that price)/(elapsed seconds since market opened)
23
page© 2015 VoltDB
BARCLAYS• Real-time Slippage
• Comparing trades & executions to the market• Not getting the best available price• Incurring market impact costs
24
MAJOR FINANCIAL CUSTOMER
page© 2015 VoltDB
FAST DATA: A WIDE VARIETY OF USE CASESMobile• Subscriber engagement,
personalization• User session Management• OSS/BSS – policy, billing, routing
25
Financial Services• Risk management (portfolio,
trading)• Fraud detection• Compliance (BB&O)• Customer engagement
Media and Entertainment• Personalization• Digital advertising• Content delivery• Gaming
IoT/Sensors• Smart Energy• Connected Home• Patient monitoring
page© 2015 VoltDB
WHY POWER YOUR FAST DATA APPS WITH VOLTDB?
Faster
Simpler Better
Faster• tps, response latency
Simpler• Fraction of components and coding vs
alternatives• Easier to test, maintain and support
Better• Correct results• Lower overall system risk• Higher availability and reliability
page© 2015 VoltDB
RESOURCES
Fast Data and the New Enterprise Data Architecture:http://learn.voltdb.com/EBookFastData.html
Download VoltDB:www.voltdb.com/download
27