Upload
mark-smalley
View
108
Download
0
Tags:
Embed Size (px)
DESCRIPTION
For more information, please visit - http://nosqlasia.org/blog/nosql-kl-01
Citation preview
Exploring The Technologies Behind Big Data Week
Twitter :: @nosqlasia
Hash-Tags :: #bdw13 #nosqlkl
Facebook :: http://facebook.com/groups/nosqlkl
NoSQL Asia Sponsors
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
http://nosqlasia.org/sponsors
What is NoSQL Asia …?
Mission Statement: It is the mission of NoSQLasia.org to provide free access to NoSQL news, event placement, product announcements and service promotion for individuals, companies and organizations throughout South East Asia Manifesto: http://nosqlasia.org/blog/nosql-asia-manifesto
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Why me …?
• Been living in Asia for over 15 years
• Early adopter / evangelist for MongoDB
• Established network of industry contacts
• Experience running meet-ups / events
• Experience presenting on stage
• Enjoy sharing knowledge with others
• Fanatical about OpenSource standards
• Truly believe life is sweet beyond SQL
• Tirath convinced me to do it !!!
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Big Data Week :: Malaysian Partners
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
http://bigdataweek.com/kualalumpur
Big Data Week :: Final Event Tomorrow @ 2pm
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
http://www.amiando.com/bdw_kl_dj.html
Big Data :: Takes More Than a Week
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
http://facebook.com/groups/bigdatamy
Created by:
How Big is Big …? -- According to IBM :: 90% of the World’s Data Created in The Last 2 Years --
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
What is NoSQL …?
History Lessons
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
A LONG TIME AGO (1974) IN A GALAXY FAR, FAR AWAY ( the relational database was born )
Building Reports = Good
Impedance Mismatch = Bad
• Before needing multiple servers, there was
the relational database …
• This model is still good for reports, though
often leads to impedance mismatch …
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Then Came Web Apps
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Research Papers & Hash-Tags
• Google developed and discussed BigTable
• Amazon developed and discussed DynamoDB
• This inspired a new generation of solutions
• Those developing these solution started a meet-up and needed a hash-tag
• MongoDB, CouchDB, Cassandra all at that same meet-up and someone picked #nosql
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Defining NoSQL with Characteristics
• Non-Relational and OpenSource
-- OR –
• Cluster-Friendly and Schemaless
-- AND –
• 21st Century Hipster Qualities
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Alternative Data Model Families
• Key Value Stores (simplicity) Riak, Redis
• Documents (rapid development) MongoDB, CouchDB, RavenDB
------------------------------------------------------------------------
• Column (inline indexing) Cassandra, HBase
• Graphs (persistent relationships) Neo4j, Titan
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
What about Aggregate Orientated models…?
• Key Values act as Documents with Meta Data
• Documents act as Key Values with IDs
• Both of these (and columns) aggregate data
• But what about relationships and natural joins?
• New wave of module database (ArangoDB / OrientDB)
• Time-series databases such as KairosDB
• More importantly, where does HyperDex fit in?
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Then Came Trolls
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Definitely Maybe Acidic
• Consistency comes in many forms (logic and replication)
• RDBMS = ACID (Atomic, Consistent, Isolate, Durable)
• NoSQL = BASE (Basically Available, Soft-State, Eventually Consistent)
• Scaling ACID compliant systems often looses true acidity
• Graph databases require and bolster acidity
• Aggregate orientation is designed NOT to have acidity
• Offline locks through version numbers to the rescue!
• ACID within a single Aggregate
• Consistency Vs Availability Vs Response Time
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
CAP THEOREM 101
CAP THEOREM THE SEQUEL
Navigating Through HyperSpace
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Search Index Sharding
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
The Future of Data
• Distributed Designs (Spanner, Bitcoin)
• Polyglot Persistence and Event Sourcing …
• Domain driven design must be at forefront …
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
NoSQL Myths & Failures
• Relational Databases are ACID Compliant
• NoSQL Databases are NOT ACID Compliant
• Aggregate Orientation is good until you want or
need to change the basis of aggregation
• Most environments have implicit schemas
• Decisions, decisions - time is money
Twitter :: @nosqlasia
Facebook :: http://facebook.com/groups/nosqlkl
Exploring The Technologies Behind Big Data Week
Twitter :: @nosqlasia
Hash-Tags :: #bdw13 #nosqlkl
Facebook :: http://facebook.com/groups/nosqlkl