Embed Size (px)
DESCRIPTION
A NoSQL database is ideal for storing, querying, and managing the any-structured information and new data types of the Big Data world … but does that mean a NoSQL database is ready for the enterprise? We say yes. People assume that Relational is always ACID and NoSQL is always BASE. Is that actually true? We say no. In this 45-min webinar, Jason Hunter, Chief Architect of MarkLogic, and his colleague, Diane Burley, Chief Content Strategist, will discuss MarkLogic, the world's only Enterprise NoSQL Database. You will learn: - What's different about a NoSQL database - What makes MarkLogic an Enterprise NoSQL Database - How you can do ad hoc queries against ad hoc structured data - How MarkLogic handles the CAP theorem limitations - How MarkLogic opens up new opportunities in Big Data
Citation preview
Slide 1 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Diane BurleyMarkLogic
Jason HunterMarkLogic
Databases, CAP, ACID, BASE, NoSQL... Oh My!
#MarkLogic
Slide 2 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
What we can agree NoSQL is …
It’s Not Only SQL
A Break from Relational Model
Solves a different type of problem
Slide 3 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
NoSQL MarkLogic
Schema-agnostic
Massive Scale
Commodity hardware
Rapid development
Hadoop sink/source
“Free”
Community
Search
Universal Indexes
Transactional
Security
Enterprise hardened
Examples:• MongoDB• Couchbase• HBase• Cassandra• Accumulo• Riak• …
Slide 4 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
RDBMS MarkLogic
Secure
Enterprise hardened
Indexes (tabular)
SQL
Analytics
Incumbent
“Free”
Career path
Search
Scale-out onCommodity hardware
Rapiddevelopment
Schema-agnostic
Universal Indexes
Examples:• Oracle• SQLServer• DB2• MySQL• Postgres• …
Slide 5 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
SearchEngine
MarkLogic
Indexes (text, fields)
Schema-agnostic
Community
“Free”
Real-time
Structure aware
Rapid development
Consistency
Transactional
Scale-out
Enterprise hardened
AnalyticsExamples:• ElasticSearch• Solr• Lucene• FAST
Slide 6 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Hadoop MarkLogic
Commodity hardware
Scale-out
“SQL”
HDFS
Real-time &batch analytics
“Free”
Community
Batch
Real-time
Indexes
Secure
Consistent
Enterprise hardened
Examples:• Cloudera• Hortonworks• MapR• Apache• …
Slide 7 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
ATOM vs BASE
ATOM BASE
Strong Consistency Weak Consistency – stale data OK
Isolation Last Write Wins
Transaction Programmer Managed
Available/Consistent Available/Partition-Tolerant
Robust Database/Simpler Code Simpler database, harder code
Slide 8 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Real Value From Big Data
Make The World More Secure
Provide Access To Valuable Information
Create New Revenue Streams
Gain Insights to Increase Market Share
Reduce Bottom Line Expense
The FAA enhances airline safety with real-time monitoring.
Slide 10 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
The FAA enhances airline safety withreal-time monitoring & dashboards.
Monitor and track emergencies and severe weather, and update a real-time dashboard for crisis management.
Goals
Proof of concept complete in 2 weeks. Entire system went from purchase to Beta in 6 months. Able to deliver mission-critical system that had previously failed on RDBMS.
Benefits
ChallengesRepository for multi-source, complex, multi-structured data; supports geospatial enrichment, faceted navigation & search; integrated with Google Earth, Microsoft SharePoint & internal systems.
Solution
Weather reports
Social media
Share Point
Airline informa
tion
GEMSInternalSystem
s
Load data “as is”
SEARCH
“Global Oil Co.” makes real-time trading decisions based on real-time, global information.
Slide 12 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
We help “Global Oil Co.” maximise their price advantage when buying or selling oil.
Get a complete picture of oil and gas market influencers to maximise profits.
Goals
ChallengesSystem pulls in real-time political, weather, vessel data, location, terminal data and trading data, and sends alerts to traders to notify them of noteworthy issues, so they can make fastest decisions possible.
Solution
Traders use the system to ensure they are able to get the best price on the market. Reduced Total Cost of Ownership (TCO) by 75%
BenefitsNotify me if…..
More than “mmm” barrels of crude are in transit in the Gulf of Arabia
Severe weather in excess of force 8 scheduled to hit Gulf of Mexico
Medicare and Medicaid (CMS) helps customers easily research, select and enroll in the right insurance plan...
while ensuring that the systems are future-proof and can adapt to change.
Slide 14 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
CMS has a future-proof system that can easily adapt to change.
Citizens, providers, payers can identify, verify
and enroll in selected insurance plan
Different insurance, eligibility sources from 50 states, federal agencies, medical providers and payers, and potentially 30-50 million citizens
Load data “as is”
UNIFIED DATA
Slide 15 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
New Generation Fraud Prevention
Analytics
Profile ConfigurationTools
Profile Data Extracted from Claims Data
Provider andBeneficiaryProfiles
The Press Association & BBC let you connect to your favorite team – even from thousands of miles away.
Slide 17 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
BBC Sport Video Supply Chain
Slide 18 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Global browsers across the games
Some Numbers Behind the Olympics
55 Million
Record of global browsers in single day 9.5 Million
Requests for BBC Olympic video content 106 Million
UK browsers from Mobile Devices9.2 Million
Requests for Mobile Video12 Million
Data delivered in the busiest day2.8 Petabytes
Data requests over the 2 Olympics 45 Billion
Daily average queries against web and mobile services2,160,000,000
Average transactions PER SECOND25,000
Slide 19 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
What is Coming Next?
Slide 20 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
To Find Out More
Jason Hunter <[email protected]>Diane Burley <[email protected]>
Paper:
