Oracle NoSQL Database release 3.0 overview

Copyright © 2013, Oracle and/or its affiliates. All rights reserved.1

NoSQL DatabasesRobert Greene, Anuj Sahni,Product Management


The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.


NoSQL – in the eyes of the Oracle

Key-Value

Graph

Fundamentals


Design driversSystems Friendly

Usability

Scalability

Predictably Responsive

NoSQL – in the eyes of the Oracle


Systems Friendly

Data Collaborations– Orchestrating– Monitoring– Process and/or

Data movement

Eventing

NoSQL

HDFS

RDBMS

Useful Services

Cache


OEP for event-driven & streaming applications

Oracle NoSQL DB accessed from KV Cartridge

NoSQL DB data directly accessible via CQL queries

Features

NoSQL DB and Event Processing




Integration with RDFRDF Use Cases

• Unified content metadata for federated resources

• Validate semantic and structural consistency

Social MediaAnalysis

Analyze social relationsusing curated metadata

- Blogs, wikis, video- Calendars, IM, voice

Semantic Metadata Layer

Find related content & relations by navigating connected entities

“Reason” across entities

Text Mining & Entity Analytics


Commodity Servers

NoSQL DB Driver

Processing Application DataConnector

Servers

Big Data Acquisition

Real Time Access


Engineered Systems

NoSQL DB DriverProcessing Application

HDFS, Hadoop, CDH

Map ReduceORCH ‐ Stats

Map ReduceHive ‐ Activities

Map ReducePig ‐ Sessionize


Batch Processing

Big Data Appliance


Real Time Access

DataConnector


Usability– Major/Minor KV ParadigmUser mailbox data Key Space : /user/id/-/folder/inbox/arrival date

/user/id/-/folder/deleted/arrival dateValue : {

“name" : "Email","namespace" : "com.companyX.email.avro","type" : "record",

"fields": [{"name": "from", "type": "string", "default": ""},{"name": "to", "type": "string", "default": ""},{"name": "sender", "type": "string", "default": ""},{"name": "cc", "type": "string", "default": ""},{"name": "subject", "type": "string", "default": ""},{“name”: “msgBody”, “type”: “string”, “default”: “”} ] }


Dev Usability– Modeled as Nested TablesUser mailbox data

UserID FolderName

ArrivalDate

From To Sender CC Subject MsgBody

Parent Table Name: User

Major KeyInherited from parent table

Primary Key “Value”

UserID Primary KeyMajor Key

Child Table Name: Folder


SNMP (Enterprise Edition Only)– MIBs in SNMPv2 format – Storage node SNMP agent – admin and rep nodes– Performance metrics – Via polling – Service change events – Via traps or polling– Notifications (Traps) – Latency and throughput limits

OEM Integrated for holistic RDBMS / NoSQL Monitoring

Standard Protocol Support

Admin Usability - Enterprise Manager Integration


We did do it! Admin commands available to

describe safe upgrade order Scripted available hands-free

upgrade experience Read/Write availability throughout

the upgrade process

What’s the Big Deal

Admin Usability – Online Rolling Upgrades

0

2.5

5

7.5

10

12.5

15

17.5

72 (24x3) 144 (48x3) 216 (72x3)Tim

e to

Upg

rade

(min

)

Total Nodes (Shards x Rep. Factor)

Online Rolling Upgrade

Ever tried to upgrade a 200 node system while it’s active?


Scalability Architecture – Applications View

Elastic Shards (split, add, contract)

Store

Partition

M

Partition

M

R

Partition

M

R R

ApplicationNoSQL Driver

R R

R

Writes to elected node

Reads from any node in system


Increase Data Capacity– Add more storage nodes– New shards automatically created

Increase Data Throughput– More shards = better write

throughput– More replicas/shard = better read

throughput

Smart Topology NoSQL DB Driver

Application

Master

Replica

Replica

StorageNode StorageNode StorageNode

Shard-1

Master

Replica

Replica

Shard-2

Scalability– Elastic Cluster Expansion


Supports heterogeneous storage topology

Replicas move from over-utilized to under-utilized storage nodes

Number of shards and replication factor remain unchanged

Improve Performance

Scalability - Rebalance an Unbalanced Store

Storage Node 1 Storage Node 2 Storage Node 3

Represents a vnode


1.6 billion records 94K insert/sec 25K read/update/sec Low latency Linear scalability


YCSB – Benchmark Commodity Servers


• Twitter sees ~500M tweets/day• This is 350K a minute• Capture twitter activity with 3

commodity servers• 1.25M ops/sec • 2 billion records • 2 TB of data• 95% read, 5% update• Low latency, High Scalability


YCSB - Benchmarking with SSD’s

0

1

2

3

4

0

200,000

400,000

600,000

800,000

1,000,000

1,200,000

1,400,000

6 (2x3) 12 (4x3) 24 (8x3) 30 (10x3)

Aver

age

Late

ncy

(ms)

Thro

ughp

ut (o

ps/s

ec)

Cluster Size ( 3->15 servers )

Mixed Throughput

Throughput (ops/sec) Write Latency (ms)Read Latency (ms)


YCSB – Benchmarking PredictabilityOracle NoSQL Database: Designed for Predictability

0

1

2

3

4

5

6

7

8

0

10,000

20,000

30,000

40,000

50,000

60,000

70,000

80,000

144(48x3)

20% 40% 60% 80% 216(72x3)

216*(72x3)

Aver

age

Late

ncy

(ms)

Thro

ughp

ut (o

ps/s

ec)

Nodes (Shards x RF)

95/5 Read/Update Throughput

Throughput (ops/sec) Read Latency (ms) Update Latency (ms)


Simple Key-Value Data Model Horizontally Scalable Highly Available Elastic Configuration ACID Transactions Simple administration Transparent load balancing Commercial grade software and support Secondary Indexing Authentication / SSL Security Data Center support

Features

Oracle NoSQL Database Scalable, Highly Available, Key-Value Database

Application

Storage NodesDatacenter B

Storage NodesDatacenter A

Application

NoSQL DB Driver

Application

NoSQL DB Driver

Application


Oracle NoSQL Database Subscription Model

Oracle NoSQL Database Community Edition– Open Source AGPL Edition

Support is now available for Community Edition– Price is $2,000/year per server – No upfront license fee– Provides for full Oracle support policy response– Purchase online via the Oracle Store

Offers affordable support option for startups Provides Oracle expertise for production deployment

New business-friendly support service

The Store https://shop.oracle.com/


Oracle NoSQL DB Licensing

Enterprise Edition– Closed Source. Standard Oracle License.

Community Edition has all of the basic functionality and APIs. Gets you started. Enterprise Edition for large, production,

multi-data center, Oracle integration-centric customers and/or non-GPL compliant customers.

Community -or- Enterprise Edition


Oracle NoSQL DB Resources

NoSQL DB Use Cases, White Papers, Data Sheets, Benchmarkshttp://www.oracle.com/technetwork/products/nosqldb/overview/index.html

NoSQL DB Documentationhttp://www.oracle.com/technetwork/products/nosqldb/documentation/index.html

NoSQL DB Downloadshttp://www.oracle.com/technetwork/products/nosqldb/downloads/index.html

NoSQL DB OTN Forumhttp://forums.oracle.com/forums/forum.jspa?forumID=1388

OU Training Classeshttp://bit.ly/V5qbmY

Great Application Development article on OTN:http://www.oracle.com/technetwork/articles/bigdata/oracle-nosqldb-appdev-1891870.html



Data & Analytics

Oracle NoSQL Database release 3.0 overview