1-Machine Learning in Oracle - ITOUG2017/12/01 · – Oracle Machine Learning (on Oracle...

05/02/2018

www.oralytics.com t : @brendantierney e : brendan.tierney@oralytics.com

Machine Learning in oracle....

Brendan Tierney

§ Data Warehousing since 1997§ Data Mining since 1998§ Analytics since 1993

05/02/2018

Topics § Who is doing Machine Learning?

§ What is Machine Learning?

§ Machine Learning in Oracle– GUI– SQL & PL/SQL– Oracle Machine Learning (on Oracle Autonomous Data Warehouse Cloud Service)– Automated Machine Learning => Machine Learning for Dummies– R

Who is ?

Doing Machine Learning

Oracle

SAS/SPSS

RapidMiner

Python

Something else?

Not doing ML now?but would like to be or Very Soon

05/02/2018

Data Mining / Predictive Analytics / Machine Learning§ Data Mining is the non-trivial extraction of previously unknown and

potentially useful information from (large collections of) data

Real Predictive AnalysisWe want to find hidden patterns in the data

Using a automatic Statistical and Machine Learning

It does not tell us some magic answer(s)

It only gives us more data (or information) which needs to be assessed tosee if it is useful

Data Mining is about explaining the past

predict the future.

05/02/2018

Your data isn’t as big as you think!

Transactional DataHistorical data

Assembled & Integrated data

Data Integration

Predictions & InsightsMake Prediction

Sensor data, Text, unstructured data, transactional data,

spatial data, etc.

Additional relevant data and “engineered

features”

Historical or Current Data to be “scored” for predictions

Build Predictive Model

05/02/2018

His paper was published in the Journal of the American Statistical Association, 1976Book Empirical Model-Building and Response Surfaces, 1987

A model is a simplification or approximation of reality and hence will not reflect all of reality.

Traditional Approach

05/02/2018

Database Centric Approach

Transactional DataHistorical data

Assembled & Integrated data

Data Integration

Predictions & InsightsMake Prediction

Sensor data, Text, unstructured data, transactional data,

spatial data, etc.

Additional relevant data and “engineered

features”

Historical or Current Data to be “scored” for predictions

Build Predictive Model

Move the Algorithms to the Data(In-Database Data Mining)

instead of

Move the Data to the Algorithms(Out off Databases Data Mining)

05/02/2018

Scalable

Highly Secure

No Data MovementReal Time

ProductionDeployment

Faster

Comprehensive Advanced Analytics Platform

05/02/2018

Comprehensive Advanced Analytics Platform

Statistical Functions in Oracle

All of these are

FREEwith the Database

These are often forgotten about

05/02/2018

You can run all the example code if you

have the ODM Demo Schema

createdCode Demo

05/02/2018

Oracle Data Mining§ PL/SQL Package

§ DBMS_DATA_MINING

§ DBMS_DATA_MINING_TRANSFORM

§ DBMS_PREDICTIVE_ANALYTICS

§ SQL Functions– PREDICTION

– PREDICTION_PROBABILITY

– PREDICTION_BOUNDS

– PREDICTION_COST

– PREDICTION_DETAILS

– PREDICTION_SET

– CLUSTER_ID

– CLUSTER_DETAILS

– CLUSTER_DISTANCE

– CLUSTER_PROBABILITY

– CLUSTER_SET

– FEATURE_ID

– FEATURE_DETAILS

– FEATURE_SET

– FEATURE_VALUE

§ 12c – Predictive Queries§ aka Dynamic Queries

§ Transitive dynamic Data Mining models

§ Can scale to many 100+ models all in one statement

05/02/2018

Code Demo

05/02/2018

EU GDPRs - Right to Explanation

§ Article 22 - Automated individual decision-making, including profiling § Article 21 - Right to object§ Article 13 – Information to be provided where personal data are collected from the

data subject § Article 14 - Information to be provided where personal data have not been obtained

from the data subject § Article 15 - Right of access by the data subject § Article 17 - Right to erasure (‘right to be forgotten’)§ Article 18 - Right to restriction of processing

Article 13

SELECT cust_id, age, pred_age, age-pred_age age_diff, pred_det

FROM (SELECT cust_id, age, pred_age, pred_det,RANK() OVER (ORDER BY ABS(age-pred_age) DESC) rnkFROM (SELECT cust_id, age,

PREDICTION(FOR age USING *) OVER () pred_age,PREDICTION_DETAILS(FOR age ABS USING *) OVER () pred_detFROM mining_data_apply_v))

WHERE rnk <= 5;

This example dynamically identifies customers whose age is not typical for the data.

The query returns the attributes that predict or detract from a typical age.

05/02/2018

Companies are building products that bridge the gap between the Data Scientist and the End-User

§ Machines doing Machine Learning

§ Automated Machine Learning

§ Autonomous Machine Learning

§ Check out Predictive Queries 12c

05/02/2018

select cust_id, affinity_card, PREDICTION( FOR to_char(affinity_card) USING *) OVER () pred_affinity_card

from mining_data_build_v;

PQ to predict the AFFINITY_CARD value.

Using all the dataUSING *

select cust_id, affinity_card, PREDICTION( FOR to_char(affinity_card) USING *) OVER () pred_affinity_card, PREDICTION_PROBABILITY( FOR to_char(affinity_card) USING *) OVER () pred_prob

from mining_data_build_v; We can use other Prediction functions.

05/02/2018

select cust_id, affinity_card, PREDICTION( FOR to_char(affinity_card) USING *) OVER () pred_affinity_card

from mining_data_build_v;

With PQs we can dynamically create new DM models based on an Attribute(s)

select cust_id, affinity_card, PREDICTION( FOR to_char(affinity_card) USING *) OVER

(PARTITION BY "COUNTRY_NAME") pred_affinity_cardfrom mining_data_build_v;

A new DM Model will be created for each Country (19)

With PQs we can dynamically create new DM models based on an Attribute(s)

05/02/2018

What about Regression type problems?select customer_id,

ltv,PREDICTION( FOR ltv USING *) OVER ( ) pred_ltv

from insur_cust_ltv_sample;

Use PQs to predict the LTV of customers

ltv,PREDICTION( FOR ltv USING *) OVER ( ) pred_ltv (ltv-PREDICTION( FOR ltv USING *) OVER ( )) ltv_diff

Use PQs to predict the LTV of customers

Use PQs to identify and target Customers

05/02/2018

ltv,PREDICTION( FOR ltv USING *) OVER (PARTITION BY STATE) pred_ltv (ltv-PREDICTION( FOR ltv USING *) OVER (PARTITION BY STATE)) ltv_diff

Use PQs to predict the LTV of customers, based on Location

ltv,PREDICTION( FOR ltv USING *) OVER (PARTITION BY STATE, SEX) pred_ltv (ltv-PREDICTION( FOR ltv USING *) OVER (PARTITION BY STATE, SEX)) ltv_diff

Use PQs to predict the LTV of customers, based on Location & Sex

We get slight different Predicted value for LTV.

You would expect this as you are using more detail to build the PQs

#States x #Sex

=19 x 2 = 38 PQ models

No Extra coding

All Dynamic

05/02/2018

Oracle Machine Learning

§ Collaborative Notebooks for data scientists

– Packaged with Autonomous Data Warehouse Cloud (V1)

– Easy access to shared notebooks,

templates, permissions, scheduler, etc.

– SQL ML algorithms API (V1)

– Supports deployment of ML analytics

05/02/2018

Database Cloud

High Performance Package

Database CloudExtreme Performance Package

Big Data Cloud Service Data Warehouse Cloud

brendan.tierney@oralytics.com

@brendantierney

www.oralytics.com

ie.linkedin.com/in/brendantierney

05/02/2018

Word Cloud of the Oracle Advanced Analytics web-pages

http://www.oralytics.com/2015/01/creating-word-cloud-of-oracle-oaa.html

3 Membership Tiers• Oracle ACE Director• Oracle ACE• Oracle ACE Associate

bit.ly/OracleACEProgram

500+ Technical Experts Helping Peers Globally

Connect:

Nominate yourself or someone you know: acenomination.oracle.com

@oracleace

Facebook.com/oracleaces

oracle-ace_ww@oracle.com

05/02/2018

http://www.cafepress.com/oralytics

1-Machine Learning in Oracle - ITOUG2017/12/01 · – Oracle Machine Learning (on Oracle...

Documents

OOW19 Oracle Machine Learning Overview and Roadmap · 2020-03-30 · Using Oracle Machine Learning to achieve business goals Increase Cash Loans by 15% within 18 Months of Deployment

THE ART OF INTELLIGENCE A PRACTICAL INTRODUCTION MACHINE ... · INTELLIGENCE – A PRACTICAL INTRODUCTION MACHINE LEARNING FOR ORACLE PROFESSIONALS Lucas Jellema (CTO AMIS & Oracle

Oracle OpenWorld Asia 2019 1 2 - Oracle Blogs · MACHINE LEARNING • B2B • AIRPORTS OTA • HOTELS airbuyinc.com Dathena enables data identification, compliance and protection

Data Mining to Real-time Processing - TIBCO Community · Introduction to Machine Learning. ... Complex Event Processing Machine Learning Big Data ... Oracle RDBMS Avro Parquet

Oracle Machine Learning · 2020. 6. 16. · machine-learning algorithms to its database of customers’ past behaviors, Donatos was able to retain 45% of these at-risk custom‐ ers,

Demystifying Machine Learning - Oracle · 2021. 2. 1. · In this situation machine learning gives you much more insight into your customers and, perhaps most importantly, it can

Oracle Exadata Database Machine - Backup & Recovery Sizing: … · Oracle Maximum Availability Architecture Oracle Exadata Database Machine: Backup & Recovery Sizing - Tape Backups

Oracle Public Cloud Machine · Oracle® Public Cloud Machine Using Oracle Big Data Cloud Machine Release 17.1.2 E85986-01 April 2017 Documentation that describes how to use Oracle

Machine Learning: Machine Learning:

62418 Big Data Analytics and Machine Learning for real ... · Introduction to Machine Learning 2. ... Complex Event Processing Machine Learning Big Data. ... Oracle, Data Warehouse,

Oracle Academy Cloud Program...for low code Web application development, SQL Developer Web for working with Oracle Autonomous Databases, SQL Notebooks for Machine Learning, Oracle

Combining Graph and Machine Learning Technologies … · Combining Graph and Machine Learning Technology using R Hassan Chafi Mark Hornick Oracle Labs Oracle Advanced Analytics February

Oracle® Exadata Database Machine System Overview...1 Introduction to Oracle Exadata Database Machine and Oracle Exadata Storage Expansion Rack 1.1 Oracle Exadata Database Machine

User's Guide Oracle® Machine Learning for R · 1.4.2.1 About Oracle Machine Learning for R Data Types and Classes 1-8 1.4.2.2 About the ore.frame Class 1-9 1.4.2.3 Support for R

Installation and Administration Guide · 2020. 6. 29. · Changes in this Guide for Release 1.5.1 x 1 Overview of Oracle Machine Learning for R Installation 1.1 Oracle Machine Learning

ORACLE EXADATA DATABASE MACHINE X8-2 · ORACLE DATA SHEET ORACLE EXADATA DATABASE MACHINE X8-2 connects all servers and storage The Oracle Exadata Database Machine is engineered to

Move the Algorithms, Not the Data€¦ · This document provides an overview of features and enhancements included in Oracle Machine Learning. ... machine learning capabilities to

Oracle Machine Learning: Scaling R and Python for the ......Title Oracle Machine Learning: Scaling R and Python for the Enterprise Author Marcos Arancibia Created Date 3/30/2020 10:37:19

Machine Learning and Azure Machine Learning

Introduction to Machine Learning in Oracle Analytics Cloudvlamiscdn.com/papers2018/Machine_Learning_in_OAC... · Multiple Oracle ACEs, consultants average 15+ years (blog, papers,