node.js workshop- node.js databases

node.js databases

Thomas Dunajskigfnork webentwicklungsunternehmen

Redis, NoSQL, MongoDB, drivers

What is Redis?NoSQL key-value data store"memcached with built-in persistence" open source

Why should I use Redis?fast (saves data in RAM if possible)keeps a copy on Disc scales goodrarely used values are swapped out to disk if RAM is lowcan save complex javascript objectseasy to usegreat for Apps with small reqirements

What is SQL/NoSQL? (very simplified)SQL databases store data in tables all data needs to match the format of the tabletend to be more stabelare scaled by using better hardware(vertical scaling)NoSQL does not use tablesitems in the database do not need to have the same formatare scaled by using more hardware(horizontal scaling)depending on what you want to do one will be better than the other

NoSQL database typesKey-value storesitems are keys(names) with one valueDocument databases each key has a complex data structure instead of a valueGraph storesstore information about networks (i.e . social connection)Wide-column storesstore columns of data together instead of rows

How to get Redis running?download it on http://redis.io/downloadcompile itrun src/redis-servernpm install redis

How to use Redis?var redis = require("redis") , client = redis.createClient();

client.set("key", "Your Data", function (err, reply) { //do something }); client.get("key", function (err, reply) { console.log(reply.toString()); });=> Your Data

Import the redis driver

make an Instance of

a connection

How to use Redis?

client.set("key", "Your Data", function (err, reply) { //do something });

Insert Command Value CallbackKey

How to use Redis?

client.get("key", function (err, reply) { console.log(reply.toString()); });

Load Command Key Callback

Questions?var redis = require("redis") , client = redis.createClient();

MongoDB

What is MongoDBNoSQL document-orientated-database cross platform open source

Document databasesdocument databases pair keys with complex data structuresthis complex data structures are called documentsdocuments can contain key-value pairskey-array pairsnested documents

Why should i use MongoDBfast (saves data in RAM if possible)scales great(sharding)failure resistent(replica sets)easy to usehigh development speedunderstands JSONsuports geo-querys

What is a Replica Set?multiple machines have the same dataif one crashes the data is still accessiblesuch a group of machines is called Replica Set

Replica Sets

Node 1

Primary

Node 1

Secondary

Node 1

Secondary

Replica Sets

Node 1

Secondary

Node 1

SecondaryElection

Replica Sets

Node 1

Node 1Node 1

Secondary Primary

Replica Sets

Node 1

Secondary

Node 1

Secondary Primary

What is Shardingspliting data on multiple machinesdata packages are called chunkscunks that exeed 64MB are split in twosingle machines are called shardsthe shard key is the value that decides to witch chunk a entry belongsWARNING: the shard key can only be set once

Sharding

Shard1

Shard2

Sharding

Shard1

Shard2

Sharding

Shard1

Shard2

Real Deployment

mongod

Replica Set

mongod

Replica Set

mongod

Replica Set

mongod

Config Servers

mongos

Client

How to get MongoDB running(Ubuntu)?sudo apt-get install mongodb sudo service mongodb start

How to get MongoDB running(Windows)?go to http://www.mongodb.org/downloadsdownload the setup install itrun mongod.exe

What is ORM?Object-Relational Mapper is a piece of software that transforms objects to relations that can be saved in a database and vice versa

What Driver should you use?depends on your needs...Mongoose – Object Relational Mapper MongoskinNode MongoDB Native Driver

MongooseProsschema-basedbuilt-in type castingbuild-in validation and other usefull features

Consslow

MongoskinProsfastlightweight

Conslightweight

Node MongoDB Native DriverProsfastest DriverConsLeast comfortable

I only use Node MongoDB Native Driver when I need maximum performance Mongoskin is fast enough for almost anything

How to use Mongoskin?//npm install mongoskin var db = require('mongoskin').db( 'localhost:27017/Workshop');

db.collection('participants').insert({name: "Noob", skills: []}, function(err, result) { if (err) throw err; if (result) console.log('Added!');});=>Added!

db.collection('participants').insert({name: "Geek", skills: ['Node.js' , 'MongoDB']}, function(err, result) { if (err) throw err; if (result) console.log('Added!');});=> Added!

How to use Mongoskin?

var db = require('mongoskin').db('localhost:27017/Workshop');

assigning Connection to

dbimport Connectiong

Host Adress Port

Database Name

db.collection('participants').insert({name: "Noob", skills: []}, function(err, result) { if (err) throw err; if (result) console.log('Added!');});

Get a Collection

Collection Name

Insert Command

A Java Script Object

Callback

Questions?//npm install mongoskin var db = require('mongoskin').db( 'localhost:27017/Workshop');

db.collection('participants').find().toArray(function(err, result) { if (err) throw err; console.log(result); }); =>[ { _id: 5375ea17898372a81425297a, name: 'Noob', skills: [] }, { _id: 5375ea17898372a81425297b, name: 'Geek', skills: [ 'Node.js', 'MongoDB' ] } ]

db.collection('participants').find().toArray(function(err, result) { if (err) throw err; console.log(result); });

Returns a Collection

Search Command

Converts a Cursor to an

db.collection('participants').findOne({name:'Geek'}, function(err, result) { console.log('Geeks skills:'); console.log(result.skills);});=>Geeks skills: [ 'Node.js', 'MongoDB' ]

Returns a single Object

can be used like any other

Object

How to use Mongoose?var mongoose = require('mongoose').db( 'localhost:27017/Workshop'), db = mongoose.connection;

db.on('error', console.error.bind(console, 'connection error:'));db.once('open', function callback () { console.log('Connected!')});

var participantSchema = mongoose.Schema({ name: String, skills:[String]});var Participant = mongoose.model('Participant', participantSchema);

How to use Mongoose?

var mongoose = require('mongoose').db( localhost:27017/Workshop'),

import Connectiong to db

Host Adress Port

Database Name

assigning Connection to Variable db

db.on('error', console.error.bind(console, 'connection error:'));

Reactiong to Event Event Name Handling

ErrorWhere the

Ountput gets piped to

String attached to

Error Message

db.once('open', function callback () { console.log('Connected!')});

Event that will only be done once

Event Name

var participantSchema = mongoose.Schema({ name: String, skills:[String]});

Schema Name

Mongoose Object

Function for defining Schemas

Variables

var Participant = mongoose.model('Participant', participantSchema);

Model NameFunction for

creating Models

Model Name Schema Name

Questions?var mongoose = require('mongoose').db( 'localhost:27017/Workshop'), db = mongoose.connection;

How to use Mongoose?var noob= new Participant({ name: 'Noob', skills:[]});noob.save(function( err, result) { if( err) return console.error(err); if (result) console.log('Added!');});=> Added!var geek= new Participant({ name: 'Geek', skills:['Node.js' , 'MongoDB']});geek.save(function (err, result) { if (err) return console.error(err); if (result) console.log('Added!');});=> Added!

var noob= new Participant({ name: 'Noob', skills:[]});

Creating new Instance of

JS Object matching Schema

How to use Mongoose?var noob= new Participant({ name: 'Noob', skills:[]});noob.save(function( err, result) { if( err) return console.error(err); if (result) console.log('Added!');});=> Added!var geek= new Participant({ name: 'Geek', skills:['Node.js' , 'MongoDB']});geek.save(function (err, result) { if (err) return console.error(err); if (result) console.log('Added!');});=> Added!

noob.save(function( err, result) { if( err) return console.error(err); if (result) console.log('Added!');});

Function for saving

Questions?var noob= new Participant({ name: 'Noob', skills:[]});noob.save(function( err, result) { if( err) return console.error(err); if (result) console.log('Added!');});=> Added!var geek= new Participant({ name: 'Geek', skills:['Node.js' , 'MongoDB']});geek.save(function (err, result) { if (err) return console.error(err); if (result) console.log('Added!');});=> Added!

How to use Mongoose?Participant.find(function (err, result) { if (err) return console.error(err); console.log(result)});=> [ { _id: 5375fb170ccdac981527120e, name: 'Noob', __v: 0, skills: [] }, { _id: 5375fb170ccdac981527120f, name: 'Geek', __v: 0, skills: [ 'Node.js', 'MongoDB' ] } ]

Participant.find(function (err, result) { if (err) return console.error(err); console.log(result)});

Returns An Array of Objects

How to use Mongoose?Participant.findOne({ name: 'Geek' }, function (err, result) { if (err) return console.error(err); console.log('Geeks skills:'); console.log(result.skills);});

=> Geeks skills: [ Node.js, MongoDB]

How to use Mongoose?Participant.find({ name: 'Geek' }, 'skills',function (err, result) { if (err) return console.error(err); console.log('Geeks skills:'); console.log(result); });=> Geeks skills: [ { _id: 5375f79aaa515144156ee3eb, skills: [ 'Node.js', 'MongoDB' ] } ]

Participant.find({ name: 'Geek' }, 'skills',function (err, result) {

Searches Objects with the Name 'Geek' and returns the Value for the Key

'skills'

How to use Mongoose?Participant.find({ name: 'Geek' }, 'skills',function (err, result) { if (err) return console.error(err); console.log('Geeks skills:'); console.log(result); });=> Geeks skills: [ { _id: 5375f79aaa515144156ee3eb, skills: [ 'Node.js', 'MongoDB' ] } ]

What are indexes and why do i need them?indexes are similar to a table of contents in a bookit keeps you from having to read the whole book to get an answer on a questioninstead you can find the right page by checkin the indexmore technically said you speed up the query by allowing it to search a smaller subset of data

MongolabDemotime!

How to make Indexes?db.collection("participants").ensureIndex( {name: 1 }, function(err) { if (err) throw err; else console.log('done writing indexes'); });

db.participants.ensureIndex( {name: 1 })

How to make Indexes?

db.collection("participants").ensureIndex( {name: 1 }, function(err) { if (err) throw err; else console.log('done writing indexes'); });

db.participants.ensureIndex( {name: 1 })

Get a Collection

Command for making Indexes

Name of the Key that has to be indexed

1 = Ascending

2 = Descending

Questions?

Exercise Datadb.collection('querys').insert({name: "a", number: 1}) db.collection('querys').insert({name: "a", number: 2}) db.collection('querys').insert({name: "a", number: 3}) db.collection('querys').insert({name: "b", number: 1}) db.collection('querys').insert({name: "b", number: 2})db.collection('querys').insert({name: "b", number: 3})db.collection('querys').insert({name: "c", number: 1})db.collection('querys').insert({name: "c", number: 2})db.collection('querys').insert({name: "c", number: 3, bool: false})

ExerciseWrite a Node.js application that connects to : mongodb://usr:node123@ds045089.mongolab.com:45089/workshopwrite functions that return items matching the following conditions1. name=a2. name=a, number=33. name=a or number=34. number is smaller than 25. all items that have a field called bool6. name is not b , number is biger than 2

A possible solutionfunction get(query) { db.collection('querys').find(query).toArray(function (err, result) { if (err) throw err; console.log('Query = ' + JSON.stringify(query)); console.log(result); });}

Resultquery ={name:'a'};

[ { _id: 537623665e7e2f181746dbd3, name: 'a', number: 2 }, { _id: 537623665e7e2f181746dbd2, name: 'a', number: 1 }, { _id: 537623665e7e2f181746dbd4, name: 'a', number: 3 } ]

ResultQuery = {"$and":[{" name":"a"},{"number":3}]} [ { _id: 537623665e7e2f181746dbd4, name: 'a', number: 3 } ]

ResultQuery = {"$or":[{"name":"a"},{"number":3}]} [ { _id: 537623665e7e2f181746dbd3, name: 'a', number: 2 }, { _id: 537623665e7e2f181746dbda, name: 'c', number: 3, bool: false }, { _id: 537623665e7e2f181746dbd2, name: 'a', number: 1 }, { _id: 537623665e7e2f181746dbd4, name: 'a', number: 3 }, { _id: 537623665e7e2f181746dbd7, name: 'b', number: 3 } ]

ResultQuery = {"number":{"$lt":2}} [ { _id: 537623665e7e2f181746dbd5, name: 'b', number: 1 }, { _id: 537623665e7e2f181746dbd8, name: 'c', number: 1 }, { _id: 537623665e7e2f181746dbd2, name: 'a', number: 1 } ]

ResultQuery = {"bool":{"$exists":true}} [ { _id: 537623665e7e2f181746dbda, name: 'c', number: 3, bool: false } ]

ResultQuery = {"$and":[{"name":{"$ne":"b"}},{"number":{"$gt":2}}]}

[ { _id: 537623665e7e2f181746dbda, name: 'c', number: 3, bool: false }, { _id: 537623665e7e2f181746dbd4, name: 'a', number: 3 } ]

node.js workshop- node.js databases

Software

Node.js primer

node.js workshop- JavaScript Basics

Node.js Explained

Static Analysis of Event-Driven Node.js JavaScript ... · to buggy Node.js programs from the StackOverﬂow website and to programs from the Node.js documentation [5] and the Node.js

Mastering Node.js

Node.js & socket.io

QCPHP - Node.js

Hire Node.js Developers | Node.js Development Company

Node.js Einführung - fossgis.de · Node.js Einführung | Manuel Hart Seite 5 1. Node.js Grundlagen Lizenz Node.js ist Open Source und unter der MIT-Lizenz (Massachusetts Institute

Developing Node.js apps using IBM Bluemix DevOps Services ...bluelabs.mybluemix.net/files/wks102/NodeJS-workshop-lab2.pdf · Developing Node.js apps using IBM Bluemix DevOps Services

Node.js Socket.IO

Node.js with Sql Server - csuohio.edueecs.csuohio.edu/.../WebApplicationExampleNodeJSSQLServerMongoDB.pdf · Node.js with Sql Server · Install Node.js runtime and npm package manager

Offshore node.js-development- Hire node.js Developers- Outsource Node.JS Development India

XML + Databases = ? (DIMACS Workshop, 3/2000)

Node.js Jaram Winter Workshop 2014

First Year English Workshop: Library Research Instruction -- Databases

What is Node.js used for: The 2015 Node.js Overview Report

Node.js I Getting Started - glenbrumbaugh.files.wordpress.com · Node.js –Node.js Run-time Architectural Concepts Node.js is designed for Single Threading Main Event listeners are

Node.js Workshopassets.en.oreilly.com/1/event/61/Learning Node_js Presentation 1.pdf · Node.js Workshop. Overview ... nginx thin tornado node_buffer. 3. It's easy to extend 'Modules

Dagstuhl Workshop on Finite Model Theory, Databases, and