40

Partner Webcast – Solving the Internet of Things Scalability Challenge with Oracle Data Management Solutions

Embed Size (px)

Citation preview

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Solving the IoT Scalability Challenge with Oracle Data Management Solutions Using Oracle NoSQL Database, Berkeley DB & Database Mobile Server

2

Michael Brey Director Development, Oracle

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Safe Harbor Statement

The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

3

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Agenda

The IoT Scalability Challenge

Use Cases & Solution Architecture

Oracle NoSQL Database

Database Mobile Server

Demonstration

Summary & QA

4

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

IoT Drivers

1. The four V’s of Big Data

– More Data, More Queries, Low Latency Operations (SLAs) Driving Business Innovation

2. Cost of Operations.

– Cost effective horizontally scalable simple operations on simple data, Requires less HW, Lower license costs than traditional RDBMS databases Lower TCO

3. Time to Market

– Developer-centric Data Management, Data Variety, Rapid Evolution Shorter Time to Market

– Scalable, reliable, secure solutions that adapt to evolving business requirements A Platform for Today and the Future

5

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

IoT Business

• IDC predicts that the total number of “Connectable Things” will exceed 200 Billion by 2020.

• Gartner estimates the total economic value-add from the Internet of Things across industries will reach US$1.9 trillion worldwide in 2020.

• Today 11 percent of all data is machine-generated. IDC estimates that by 2020, the number will rise to 40 percent, with somewhere between 20 and 50 billion devices fueling that growth.

• You need to acquire and manage the data, integrate and secure the data, and finally analyze and act on the data.

6

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Agenda

The IoT Scalability Challenge

Use Cases & Solution Architecture

Oracle NoSQL Database

Database Mobile Server

Demonstration

Summary & QA

7

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Use Case: Fleet Data Management

8

Objectives

Solution

Benefits

Thousands to millions of vehicles

Multi-purpose data collection

Reliable, secure data capture

Intermittent network connectivity

Berkeley DB in the vehicle to store data

locally

Database Mobile Server for syncing data

Oracle NoSQL Database for scalable data

storage and analysis

Cost effective, scalable storage

Secure, scalable and reliable data sync

Handles connected/disconnected modes

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Use Case: 2-Tier Sensor Data Capture

9

Objectives

Solution

Benefits

Millions of devices

Simple, scalable data relay

Scalable, secure data capture

Low latency storage and query

Simple, internet capable devices

Database Mobile Server for syncing data

Oracle NoSQL Database for scalable data

storage and analysis

Cost effective, scalable storage

Secure, scalable, reliable data capture

Flexible, evolvable architecture

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Use Case: 3-Tier Sensor Data Capture

10

Objectives

Solution

Benefits

Millions of devices

Intelligent data channel

Scalable, secure data capture

Intermittent network connectivity

Low latency storage and query

Simple, internet capable devices

Berkeley DB in the gateway

Database Mobile Server for syncing data

Oracle NoSQL Database for scalable data

storage and analysis

Cost effective, scalable storage

Secure, scalable, reliable data capture

Smart, extensible middle-tier

Flexible, evolvable architecture

Handles connected/disconnected modes

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

DMS Sync Client

User Application

High Level Solution Architecture Oracle NoSQL Database & Database Mobile Server queue-based publication

11

Storage Nodes Datacenter A

Application

NoSQL DB Driver

Application

Client

App Server - WLS

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Agenda

The IoT Scalability Challenge

Use Cases & Solution Architecture

Oracle NoSQL Database

Database Mobile Server

Demonstration

Summary & QA

12

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Web-Scale Personalization & Xaction Processing • Direct-to-Consumer web services

• Real-time transaction capture

• High volume, Low latency

• Retail, Telco, Financial Svcs, Insurance

Time Series & Sensor Data Mgmt • Efficient, scalable data persistence

• Requires analytics and visualization

• Scalability, Cost management

• Utilities, Oil & Gas, Manufacturing, Financial Svcs

Real Time Event Processing • Scalable container for rules and history

• Provides context to interpret events

• Low latency, Cost trade-offs

• Credit Card Svcs, Content Recommend Engines, Telco

Aggregation & Consolidation • Disparate data sources, integrated data

• Customer Service, 360 View

• Business Innovation from legacy systems

• Insurance, Banking, Telco, Healthcare, Entertainment

Common NoSQL Use Cases

13

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Finance

• Large credit card network provider

• Fraud rule and history management

• 6,500 ops/sec, 85% update on read

Manufacturing

• Large airline manufacturer

• Developing next generation planes

• 750K key inserts/sec, 6TB/hour

Telecoms

• Large mobile telecom operator

• Mobile personalized advertizing

• 24,000 ops/sec, 100% update on read

Customer Loyalty

• Operationalize analytics to NoSQL Customer Portal

• Optimized operational load balancing

• 20M+ customers in multiple countries

Oracle NoSQL Database customer success…

……many more

14

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

What is Oracle NoSQL Database

15

101100101001001001101010101011100101010100100101

Reliable Flexible Fast Simple

advanced Key-Value NoSQL database designed as cost effective, high performance solution for simple operations on collections of simple data with built in high

availability and elastic scale-out.

less is more

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Oracle NoSQL Database NoSQL for Developers and IT

16

Setup, Admin, API & Integration

Built-in HA, Predictable Performance

Parallel Access & Scale-out

Simple:

Fast:

Flexible:

Reliable:

Flexible schema & Agile development

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

• Common NoSQL Features

– Elastic

– BASE Operations

– Tables / JSON / Binary

– Online management

• Differentiators

– ACID transactions

– Online rolling upgrades

– Streaming large object support

– Oracle technology integrated

– Engineered Systems and Commodity HW

Oracle NoSQL Database Overview

17

Application

Storage Nodes Datacenter B

Storage Nodes Datacenter A

Application

NoSQL DB Driver

Application

NoSQL DB Driver

Application – Data Center Support

– Secondary Indexes

– Secure Access

– Flexible schema

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

• Query NoSQL data from Oracle Database and Hive

• Access NoSQL data from Hadoop and Spark for DW and analytics

• Share data with Oracle Coherence for extensible in-memory cache grid

• Persist history & event streams for processing with Oracle Event Processing

• Store & query RDF data using Oracle RDF for NoSQL

• Replicate changes in Oracle Database to NoSQL DB using Oracle Golden Gate

• Monitor your NoSQL cluster using Oracle Enterprise Manager

18

Integrated out of the box

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Agenda

The IoT Scalability Challenge

Use Cases & Solution Architecture

Oracle NoSQL Database

Database Mobile Server

Demonstration

Summary & QA

19

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

“Oracle DMS has made it possible to move one of our internal applications into the mobile arena. We were able to integrate online with offline activity in a user friendly manner. Our target is to service over 10,000 internal customers with this application”

Brian T. Schultz, VP HR Information Technology

“We are deeply invested in Oracle technology for all our database needs and Web applications. Oracle Database Mobile Server helped us extend our apps to our volunteers without having to worry about transaction management, security or other data-related issues in quick time.”

Anand Adkoli, Architect

"Our mFinity platform uses Oracle Database Mobile Server for its synchronization needs. The platform is now built upon the infrastructure of the Oracle Public Cloud, and relies on Oracle Database Services. With the new features in DMS 12c, along with Oracle cloud capability it is opening up new and larger IoT deployments for us.”

Daniel Pahng, mFrontiers, President

"OpenPharma is used every day by almost 1000 people across 30 networks, both in the field and at head offices. Oracle's Mobile Server engine allows OpenPharma to integrate management of all data streams between users and centralized bases. The new Mobile Server version will make it possible to extend the solution for all Nomadvantage clients equipped with the OpenPharma mobile CRM.“

Fabrice Billiotel, Lead DBA

nomadvantage

20

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

• DMS Purpose

– Scalable data synchronization between local client data store (BDB/JavaDB/SQLite) and Oracle RDBMS, Oracle NoSQL

– Mobile client device management

– Mobile client application management and provisioning

• Main Categories of Mobile Environments

– Mostly Connected

– Occasionally Connected

– Mostly Disconnected (no external data dependency

22

• Typical Use Cases

– Connecting data generating devices

– Remote embedded diagnostic units

– Polling data collection

– Mobile Sales Force

– Mobile Field Service

– Police/Ambulance units

– Distributed mobile retail stations

The Landscape Enterprise-grade, scalable, secure mobile application platform

• Server Side – Mostly 64-bit and some

32-bit

– Windows (7, 8, 2008, 2003)

– Linux (plus many distros)

– Solaris (SPARC and X86)

– AIX

– HPUX

• Client Side – iOS

– Android

– Windows Mobile

– Windows (Win32)

– Linux

– Blackberry

Database Mobile Server Platform Support Multi-platform support

23

Database Mobile Server Architecture

24

DMS Metadata (Oracle RDBMS)

Oracle NoSQL

Oracle RDBMS

Oracle NoSQL

HTTP

JDBC Connection

Pool

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

• BDB

– AES encryption built in

– SQL 92 compliant

– Row level locking

– High Concurrency

– Scalable to GB

– Native sequences

– Streaming BLOBS

– Full Oracle support

• SQLite

– Open source

– SQL 92 compliant

– Useful for small dbs

– Embedded in Android

– Single database file

– Limited performance knobs

– Strongest with read intensive workloads

25

• Java DB

– Oracle distribution of Apache Derby

– Included in JDKs from 1.5

– Full featured

– 3MB footprint

– Written completely in Java

– Runs inside a JVM

– Can run as embedded or client/server

The Clients Chose one based on your needs

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Mobile Server key differentiators – Scalability

• Additional Mobile Servers can be deployed in a server farm to handle increased client synchronization load.

– Security end to end • On-the-wire data and application network communication can be encrypted, authentication,

User/Role based access, database (server and client)

– Reliability • Mature Oracle product with more than 15 years in the market.

• Interrupted synchronization sessions resume where they left off.

– Customizability • Tailor to your unique environment.

• Supports multiple popular application development frameworks: Cordova, MAF, Titanium, mFinity, Xcode, Java, etc.

26

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

– Scalable Architecture

• Clients upload to server and download from the server using In and Out Queues

• CPU intensive operations can be queued and executed when the system is available

– Transport Independence

• Any TCP/IP enabled carrier network can be used for synchronization.

– Bi and Uni-directional Synchronization

• Upload and download of data during Synchronization.

• Synchronization can be customized to allow only upload.

– Security

– Asynchronous Architecture

• Avoid locking the base tables

– Data Sub-setting

• DMS supports highly granular (column-level and row-level) selection of base table data.

• Dynamic data range based on logical record set qualification

– Conflict/Error Detection and Resolution

• DMS provides built-in conflict resolution capabilities via the Server Wins/Client Wins rules.

• Conflict resolution can be customized by developer.

• Mobile Server administrator can further manage conflicts.

– Multi-Language/Multi-Platform Support

Key Features

27

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Sync Features

– Synchronization Styles • Automatic Synchronization allows DMS to invoke synchronization in the background that is

trigger/event based.

• Manual Synchronization allows user or application to control synchronization timing.

– Schema Evolution • Application schema evolution can be supported by publishing new versions of client-side database

and matching application binaries. A large European customer, using DMS for several years, frequently updates their schema without disruption of service.

Synchronize data simultaneously within minutes from 4000 sensor devices using a 4-core middle tier machine that is feeding a database on a 4-core machine.

28

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Device Management Manage and control clients

– Device Management Client is automatically installed with Mobile Client.

– Administrator can perform device management through Mobile Manager • Retrieve and view individual device properties

• Set device properties

• Send device commands (e.g. retrieve log, install application, etc)

• Creating new device commands (using an easy scripting language)

In a major city, manage/deploy application updates to 1000 devices used in administering parking tickets on a standard 4 core system

29

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Mobile Server Summary Data Synchronization for Developers and IT

30

Centralized Device, User & Application Management

Encryptable & Re-startable

Scale up & Scale-out

Simple:

Fast:

Flexible:

Secure & Reliable:

Configurable & Customizable

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Agenda

The IoT Scalability Challenge

Use Cases & Solution Architecture

Oracle NoSQL Database

Database Mobile Server

Demonstration

Summary & QA

31

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

NoSQL As a Mobile and IoT Data Repository Enabling mobile, embedded, and IoT devices to connect to a central NoSQL repository for cloud or on-premise data analytics

32

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Agenda

The IoT Scalability Challenge

Use Cases & Solution Architecture

Oracle NoSQL Database

Database Mobile Server

Demonstration

Summary & QA

33

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Oracle Database Mobile Server & NoSQL Database Summary

34

Scale up & Scale out

Reliable, Secure, Simple Management

Parallel Processing

Scalable:

Fast:

Developer Friendly:

IT Friendly :

Configurable, Customizable, Open

Lower Cost of Operations

Faster Time to Market

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

• http://oracle.com/technetwork/database/database-technologies/database-mobile-server/

• http://blogs.oracle.com/mobile_and_embedded/

• http://community.oracle.com/community/database/ oracle-database-options/database_mobile_server

Additional Resources

35

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Q&A

36

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

Q&A

37

Michael Brey Director Development, Oracle ISV Migration Center email: [email protected]

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |

• Oracle.com Partner Hub oracle.com/partners/goto/hub-ecemea

• Migration Center Team Blog blogs.oracle.com/imc

feeds.feedburner.com/oracleIMC

• Partner Webcast Recordings youtube.com/OracleIMCteam

• Partner Webcast Presentations slideshare.net/Oracle_IMC_team

[email protected]

Oracle Partner Hub ISV Migration Center • twitter.com/OracleIMC

• plus.google.com/+OracleIMC

• facebook.com/OracleIMC

• linkedin.com/groups/Oracle-Partner-Hub-Migration-Center-4535240

Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 39