OrientDB the database for the web 1.1

The database for the Web

www.orientechnologies.com

Why do I need anotherDBMS?

But the question is:are DBMSs ready for

the Web age?

Web means:Hundreds of users today,

thousands ormillions tomorrow

Web means:Idea → Demo in few weeks

Web means:Fast and frequent

changes of requirements anddata structures

Web means:+ social + relationships

+ interconnections= graph

Web means:Low usage of resourcesrun on cheap hardware

Web means:Speak HTTP, REST and JSON

please

Why is the databaseso important

in modern applications?

Becausemodern applicationsare mostly I/O Bound

notCPU bound

NoSQL= “Not Only SQL”

= make the best choice for youruse case

Can I trustnew DBMSs?

Non exhaustive list of NoSQL products:

AllegroGraph, Amazon SimpleDB, Amazon Dynamo, Dynomite, BerkleyDB, Google BigTable, Cassandra, CouchDB, DB4O, Hbase, Hipertable,

Hive, Jackrabbit, InfiniteGraph, InfoGrid, Memcached, MemcacheDB, Mnesia, M/DB/DT.M,

MongoDB, Neo4J, OrientDB, Pig, Project Voldemort, RavenDB, Redis, Riak, Scalaris,

Sesame, Sones, Terrastore, Tokyo Cabinet/Tyrant, Yahoo! Pnuts/Sherpa

“NoSQL container” groups sovery-very-verydifferent products,

no standard,difficult to choice,

difficult to learn them

Can I have aFast, scalable, flexible

storagewith ACID Tx, SQL, Securityeasy to use and maintain?

The fastest NoSQL document-graph dbms

+12 yearsof research

+1 yearof design and develop

=best features of newest NoSQL solutions

+best features of Relational DBMS

+new ideas and concepts

Ø configdownload, unzip, run!

cut & paste the db

No dependencieswith 3rd parties software

no conflicts with other softwarejust 1 Mb of run-time libraries

150,000records per second

Schema-lessschema is not mandatory, relaxed model,

collect heterogeneous documents all together

Schema-fullschema with constraints on fields and validation rules

Customer.age > 17Customer.address not nullCustomer.surname is mandatoryCustomer.email matches '\b[A-Z0-9._%+-]+@[A-Z0-9.-]+\.[A-Z]{2,4}\b'

Schema-mixedschema with mandatory and optional fields + constraints

the best of schema-less and schema-full modes

ACID Transactionsdb.begin();

try{ // your code ... db.commit();

} catch( Exception e ) { db.rollback();}

Complex typesnative support for collections, maps (key/value)

and embedded documentsno more additional tables to handle them

Relationshipsare direct links

no Relational JOINS to connect multiple tables

Load trees and graphs in few ms!

SQLselect * from employee where name like '%Jay%' and status=0

For the most of the querieseveryday a programmer needs

SQL is simpler,more readable and

compact thenScripting (Map/Reduce)

SELECT SUM(price) as prices, SUM(cost) as costs, prices-costs, margin/price FROM Balance

VSfunction (key, values) { var price = 0.0, cost = 0.0, margin = 0.0, marginPercent = 0.0; for (var i = 0; i < values.length; i++) { price += values[i].price; cost += values[i].cost; } margin = price - cost; marginPercent = margin / price; return { price: price, cost: cost, margin: margin, marginPercent: marginPercent };}

Asynchronous Queryinvoke callback when a record matches the condition

doesn't collect the result setperfect for immediate results

useful to compute aggregates

Java®

runs everywhere is available JRE1.5+robust engine

Language bindingsJava as native

JRuby, Scala and Javascript readyC, C++, Ruby, Node.js in progress

Your language isnot supported (yet)?

Write an adapter using theC, Java or HTTP binding

HTTP RESTfulfirewall friendly

use it from the web browseruse it from the ESB (SOA)

Native JSON{ '@rid' = '26:10', '@class' = 'Developer', 'name' : 'Luca', 'surname' : 'Garulli', 'company' : '19:76'}

Import/Exportuses JSON format

online operations (don't stop the database)

Binary protocolFast compressed JSON over tcp/ip

available for Javaand soon C, C++ and Ruby

RB+Tree index

the best of B+Tree and RB-Treefast on browsing, low insertion costIt's a new algorithm (soon public)

Contactname : string

surname : string

OO InheritanceDefinition of Classes of documentsClasses can extend others classes

Queries are polymorphics

Customerorders : List<Order>

Providerproducts : List<Product>

Hookssimilar to triggers

catch events against records, database and transactionsimplement custom cascade deletion algorithm

enforce constraints

Fetch plansChoose what to fetch on query and document loading

Documents not fetched will be lazy-loaded on request

Securityusers and roles, encrypted passwords

fine grain privileges

4 storage modesembedded

client/serverdistributedin-memory

Embedded modereally fast

runs in the same JVM of the application,less resources, no tcp/ip used

Client/server modeclient and server are separated JVMsthousands of clients concurrently

remote tcp/ip binary transport

Distributed modedistribute database clusters on

multiple servers (in alpha status)

In-memory modeDatabase lives only in memory

No disk is usedDestroyed at shutdown

Document Database

Key/Value Database Graph Database

Object Database

User API

Document Databasethe base of all DB implementationsdocuments have dynamic structure

something like a smart Map<String,Object>

Open the databaseODatabaseDocumentTx db = new ODatabaseDocumentTx( "remote:localhost/demo" );

db.open("admin", "admin");

} finally { db.close();}

Open the database 'demo'from a remote server

Create a documentODocument doc = new ODocument( db, "Person" );

doc.field( "name", "Luke" );

doc.field( "surname", "Skywalker" );

doc.field( "city", new ODocument("City" ).fields("name","Rome") );

doc.save();

Relationship

SQL QueryList<ODocument> result = db.query( new OSQLSynchQuery( "select * from person where city.name = 'Rome'" ) );

for( ODocument d : result ) { System.out.println( "Person: " + d.field( "name" ) + d.field( "surname" ) );}

Native QueryList<ODocument> result = new ONativeSynchQuery<ODocument, OQueryContextNativeSchema<ODocument>>( db, "Profile", new OQueryContextNativeSchema<ODocument>()) {

@Override public boolean filter(OQueryContextNativeSchema<ODocument> iRecord) { return iRecord.field("city").field("name").eq("Rome").and().field("name").like("G%").go(); };

}.setLimit(20).execute();

Update a documentList<ODocument> result = db.query( new OSQLSynchQuery( "select * from person where city.name = 'Rome'"));

for( ODocument d : result ) { d.field( "local", true ); d.save();}

// IT'S THE SAME OF:int changed = db.command( new OSQLCommand( "update person set local = true where city.name = 'Rome'")) .execute();

Delete a documentList<ODocument> result = db.query( new OSQLSynchQuery( "select * from person where city.name = 'Rome'" ) );

for( ODocument d : result ) { d.delete();

// IT'S THE SAME OF:int deleted = db.command( new OSQLCommand( "delete person where city.name = 'Rome'")).execute();

from/to JSON // EXPORT JSONSystem.out.println( document.toJSON() );

// IMPORT JSONdocument.fromJSON( “{ '@class' = 'Developer', 'name' : 'Luca', 'surname' : 'Garulli' }” );document.save();

Use hooks (triggers)public class HookTest extends ORecordHookAbstract { public saveProfile(){ ODatabaseObjectTx database = new ODatabaseObjectTx("remote:localhost/demo"); database.open("writer", "writer");

database.registerHook(this);

@Override public void onRecordAfterCreate(ORecord<?> iRecord){ System.out.println("Record created successfully"); }}

Key/Value Databasebucket / key / value

HTTP RESTful protocolHazelcast plug-in to distribute database

Key/Value = RB+Treeworks mainly using RB+Tree custom indexessort of Map<String,Map<String,Record>>

Object Databasewrapper on top of Document Database

binds POJO from/to the databaseno OR-Mapping complexity

no enhancement, no Java Proxies

POJO mappingUses the reflection to bind POJO fieldsat start-up caches reflection meta-data

1-to-1 bindingconfigurable options by @annotations

Open the databaseODatabaseObjectTx db = new ODatabaseObjectTx( "remote:localhost/demo" );

db.open("admin", "admin");

} finally { db.close();}

Same usage of DocumentDatabase, but the class

is different

Create a persistent POJOPerson person = new Person();

person.setName( "Luke" );

person.setSurname( "Skywalker" );

person.setCity( new City( "Rome" ) ); db.save( person );

Relationship

Polymorphics SQL QueryList<Person> result = database.query( new OSQLSynchQuery("select from person where city.name = 'Rome'"));

for( Person p : result ) { if( p instanceof Customer ) System.out.println("Customer: " + p.getName() + “ “ + p.getSurname() );}

Queries are polymorphicsand subclasses of Person can be

part of result set

Graph Databasewrapper on top of Document Database

Few simple concepts: Vertex, Edge,Property and Index

Example of a Graph

TinkerPop technologiessort of “standard” for GraphDB

a lot of free open-source projects

http://tinkerpop.com

TinkerPop Blueprintsbasic API to interact with GraphDB

implements transactional andindexable property graph model

bidirectional edges

GraphDB & Blueprints API

OrientGraph graph = new OrientGraph("local:/tmp/db/graph”);

Vertex actor = graph.addVertex(null);actor.setProperty("name", "Leonardo");actor.setProperty("surname", "Di Caprio");

Vertex movie = graph.addVertex(null);movie.setProperty("name", "Inception");

Edge edge = graph.addEdge(null, actor, movie, "StarredIn");

graph.shutdown();

TinkerPop scripting language

easy to learn and understandUsed for operations against graphs

Graph examplegraph-example-1.xml

Load graph Run the console, open the database and load a graph in xml format

marko:~/software/gremlin$ ./gremlin.sh

\,,,/ (o o)-----oOOo-(_)-oOOo-----gremlin> $_g := orientdb:open('/tmp/graph/test')==>orientgraph[/tmp/graph/test]gremlin> g:load('data/graph-example-1.xml')==>truegremlin> $_g==>orientgraph[/tmp/graph/test]

SearchDisplays outgoing edges of vertices with name equals to 'marko',

then the name of inbound vertices

gremlin> g:key-v('name','marko')/outE==>e[6:0][5:2-knows->5:1]==>e[6:1][5:2-knows->5:4]==>e[6:4][5:2-created->5:0]gremlin> g:key-v('name','marko')/outE/inV/@name==>vadas==>josh==>lopgremlin> g:close()==>true

API resumeobject, key/value and graph elements all work on top of Document

you can always access to the underlying document

changes to the document are reflected to theobject, key/value and graph elements

and viceversa

High-AvailabilityCluster of distributed server nodesSynchronous, Asynchronous and Read-Only

replicationLoad-balancing between client servers and↔

Servers Servers↔

Server #1(Leader+Owner)

Client A

Server #2(Synchronous)

Client B Client A Client B

Synchronous scenarioServer #1 owns all the data, used for reads/writes

Server #2 is the backup replica, can be used for readsClients receive ack only when both are updated

Server #1 and #2 are Always Consistent

Client A

Server #2(Asynchronous)

Asynchronous scenarioAs for synchronous, but:

Server #2 is Eventually ConsistentClients receive ack just when Server #1 is updated

update-delay=x

Client A

Fail-overServer #1 logs changes while Server #2 is disconnected

Transparent client switch to good servers (alpha status)

Running transactions will be repeated transparently (v0.9.26)

Logchanges

Server #2(Synchronous)

Mixed scenarioUse Server #1 and #2 for cases when Strict Consistency is acceptable

Use Server #3 for cases when Eventually Consistency is acceptable

update-delay=0

CustomersUSA

(owner)

CustomersEurope

CustomersUSA

CustomersEurope(owner)

PartitioningCluster level granularity

Place the “owner” close to the clients to reduce latency

Asynchronous (update-delay=0)

Server main(Leader)

Server USA

Main Copy(Synchronous)

Real world scenario IDistribute data across multiple sites

Play with sync/asynch+delayKeep synchronous copies close and propagate in asynch

China Copy(Synchronous)

Server Main(Owner)

Server Farm Europe

USA Copy(Synchronous)

CustomersUSA

CustomersAsia

CustomersEurope

CustomersUSA

CustomersAsia

CustomersEurope

CustomersUSA

CustomersAsia

CustomersEurope

Server China(Owner)

Server USA(Owner)

Asynchronouspropagation

Server Copy(Synchronous)

Real world scenario IIPut server nodes in chainLoad-balance requests

Server China(Asynchronous)

Server Main(Leader-Owner)

Server USA(Asynchronous)

China EastRead-only

China WestRead-only

China NorthRead-only

USA SouthRead-only

CanadaRead-onlyUpdate European Customer:

Propagate the change

Server Copy(Synchronous)

Choose the best strategyfor your use-case

Server China(Asynchronous)

China NorthRead-only

Client Aconsistent reads,

direct writes

Client Bconsistent reads,delegated writes

Server Main(Leader-Owner)

Client Dev. consistent reads,

no writes

Client Cev. consistent reads,

delegates writes

Enhanced SQLSQL is not enough for collections, maps, trees and graphs

need to enhance SQL syntaxEasy syntax derived from JDO/JPA standards

SQL & relationshipsselect from Account where address.city.country.name = 'Italy'

select from Account where addresses contains (city.country.name = 'Italy')

SQL & trees/graphsselect from Profile where friends traverse(0,7) ( sex = 'female' )

(Soon new specific operators for trees and graphs)

SQL & stringsselect from Profile where name.toUpperCase() = 'LUCA'

select from City where country.name.substring(1,3).toUpperCase() = 'TAL'

select from Agenda where phones contains ( number.indexOf( '+39' ) > -1 )

select from Agenda where email matches '\bA-Z0-9._%+-?+@A-Z0-9.-?+\.A-Z?{2,4}\b'

SQL & conversionsselect from Shapes where area.toFloat() > 3.14

select from Agenda where birthDate.toDateTime() > '1976-10-26 07:00:00'

select from Workflow where completed.toBoolean() = true

SQL & schema-lessselect from Profile where any() like '%Jay%'

select from Stock where all() is not null

SQL & collectionsselect from Tree where children contains ( married = true )

select from Tree where children containsAll ( married = true )

select from User where roles containsKey 'shutdown'

select from Graph where edges.size() > 0

SQL & documentsselect from Vehicle where @class = 'Car'

select from Friend where @version > 100

select from File where @size > 1000000

ConsoleORIENT database v.0.9.23 www.orientechnologies.comType 'help' to display all the commands supported.

> connect remote:localhost/demo admin adminConnecting to database [remote:localhost/demo] with user 'admin'...OK

> select from profile where nick.startsWith('L')---+--------+--------------------+--------------------+--------------------+ #| REC ID |NICK |SEX |AGE |---+--------+--------------------+--------------------+--------------------+ 0| 10:0|Lvca |male |34 1| 10:3|Leo |male |22 2| 10:7|Luisa |female |273 item(s) found. Query executed in 0.013 sec(s).

> closeDisconnecting from the database [demo]...OK

> quitwww.orientechnologies.com

OrientDB Studio/SQL query

Resultset is editable andchanges are immediately

persistent!

OrientDB Studio/db structure

Physical structureof database

OrientDB Studio/server profiler

Statistics and timing arecollected in real-time

Always FreeOpen Source Apache 2 license

free for any purposes,even commercials

Prof€$$ional$€rvic€$

by a network of companies throughOrient Technologies

support, training, consulting, mentoring

OrientDBfor Java developers

8 hours

OrientDBMaster Development

14 hours

OrientDBfor SOA

6 hours

OrientDBand the power of graphs

6 hours

OrientDBfor DBA

6 hours

OrientPlanetfor Web Developers

6 hours

Certification Programto be part of the network

do coursesshare revenues for support

work as consultant

Contactcommercial@orientechnologies.com

Luca GarulliAuthor of OrientDB and

Roma <Meta> FrameworkOpen Source projects,

Member of JSR#12 (jdo 1.0) and JSR#243 (jdo 2.0)

CTO at Asset Data and Orient Technologies

Technical Manager atRomulus consortium

www.twitter.com/lgarulli@Rome, Italy

OrientDB the database for the web 1.1

Technology

OrientDB - The First Few Days In Five(ish) Minutes

Meetup Oracle Database: 1.1 Servicios de Oracle Database en la nube

OrientDB, the fastest document-based graph database @ Confoo 2014 in Montreal (CA)

Design your application using Persistent Graphs and OrientDB

OrientDB - tutorialspoint.com · OrientDB also belongs to the NoSQL family. OrientDB is a second generation Distributed Graph Database with the flexibility of Documents in one product

OrientDB: a Document-Graph Database ready for the Cloud - Dell'Aquila

OrientDB: graph database in practiceaurelijus.banelis.lt/prezentations/orientdb-2015/orient...Summary (2/3) 13 WHAT Graph Graph database WHY Real world example HOW With PHP With relational

Works with persistent graphs using OrientDB

OrientDB - the 2nd generation of Multi-Model) NoSQLpresentations2015.s3.amazonaws.com/47_presentation.pdf · OrientDB - the 2nd generation of ... has been created in the last two

OrientDB a database for the Web

OrientDB & Lucene

The database designed for the modern world - OrientDB€¦ · Owning that data to build transformative applications is now more critical than ever. That’s why OrientDB developed

OrientDB Distributed Architecture v2.0

OrientDB vs Neo4j - Comparison of query/speed/functionality

OrientDB – The Multi-Model and Graph Database · Introduction to NoSQL, graph databases and OrientDB Introduction OrientDB is a multi-model database. It is based on a NoSQL engine

Change RelationalDB to GraphDB with OrientDB

1.1 - Relational database concepts.pdf

Managing Database/Database Management Systemsebooks.lpude.in/management/mba/term_3/DCAP204... · Unit 1: Database Fundamentals 1 ... 1.1 Database Management Systems (DBMS) ... 1.9

Graph Databases and OrientDB

Download OrientDB Tutorial