39
Kecerdasan Bisnis Terapan Descriptive Analytics II Business Intelligence and Data Warehousing Husni Lab. Riset JTIF UTM Sumber awal: http://mail.tku.edu.tw/myday/teaching/1071/BI/1071BI05_Business_Intelligence.pptx

Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Embed Size (px)

Citation preview

Page 1: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Kecerdasan Bisnis Terapan

Descriptive Analytics II

Business Intelligence and Data

Warehousing

HusniLab. Riset JTIF UTM

Sumber awal: http://mail.tku.edu.tw/myday/teaching/1071/BI/1071BI05_Business_Intelligence.pptx

Page 2: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Business Intelligence (BI)

2

Introduction to BI and Data Science

Descriptive Analytics

Predictive Analytics

Prescriptive Analytics

1

3

5

4

Big Data Analytics

2

6 Future Trends

Page 3: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Descriptive Analytics II: Business Intelligence

and Data Warehousing

3

Page 4: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Outline

• Descriptive Analytics II

• Business Intelligence

• Data Warehousing

• Data Integration and the Extraction, Transformation, and Load (ETL) Processes

• Business Performance Management (BPM)

• Performance Measurement

– Balanced Scorecards

– Six Sigma

4

Page 5: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

5

Relationship between Business Analytics and BI, and BI and Data Warehousing

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 6: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

A List of Events That Led to Data Warehousing Development

6Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 7: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Characteristics of Data Warehousing

• Subject oriented

– Data are organized by detailed subject, such as sales, products, or customers, containing only information relevant for decision support.

• Integrated

– Integration is closely related to subject orientation.

• Time variant (time series)

– A warehouse maintains historical data.

• Nonvolatile

– After data are entered into a data warehouse, users cannot change or update the data.

7Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 8: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Data-Driven Decision Making—Business Benefits of the

Data Warehouse

8Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 9: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

A Data Warehouse Framework and Views

9Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 10: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Architecture of a Three-Tier Data Warehouse

10Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 11: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Architecture of a Two-Tier Data Warehouse

11Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 12: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Architecture of Web-Based Data Warehousing

12Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 13: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

a. Independent data marts.

b. Data mart bus architecture

c. Hub-and-spoke architecture

d. Centralized data warehouse

e. Federated data warehouse

13

5 Alternative Data Warehouse Architectures

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 14: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

5 Alternative Data Warehouse Architectures

14Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 15: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

15Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

5 Alternative Data Warehouse Architectures

Page 16: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

16Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

5 Alternative Data Warehouse Architectures

Page 17: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Average Assessment Scores for the Success of the DW Architectures

17Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 18: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

The ETL Process

18Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 19: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

19Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Sample List of Data Warehousing Vendors

Page 20: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Sample List of Data Warehousing Vendors

20Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 21: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Contrasts between the DM and EDW Development Approaches

21Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 22: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Essential Differences between Inmon’s and Kimball’s Approaches

22Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 23: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Representation of Data in Data Warehouse

(1) Star Schema (2) Snowflake Schema

23Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 24: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

A Comparison between OLTP and OLAP

24Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 25: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Slicing Operations on a Simple Three-Dimensional Data Cube

25Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 26: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Business Performance Management (BPM) Closed-Loop BPM Cycle

26Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 27: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

1. Strategize

– Where do we want to go?

2. Plan

– How do we get there?

3. Monitor/Analyze

– How are we doing?

4. Act and Adjust

– What do we need to do differently?

27

Business Performance Management (BPM) Closed-Loop BPM Cycle

Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 28: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Four Perspectives in Balanced Scorecard Methodology

28Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 29: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Comparison of the Balanced Scorecard and Six Sigma

29Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 30: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Six SigmaThe DMAIC Performance Model

• Define

• Measure

• Analyze

• Improve

• Control

30Source: Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson

Page 31: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

The Joy of Stats: 200 Countries, 200 Years, 4 Minutes

31

https://www.youtube.com/watch?v=jbkSRLYSojo

Page 32: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Python Data Science Handbook in Google Colab

32https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

Page 33: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

33

Table of Contents

Preface

1. IPython: Beyond Normal Python

•Help and Documentation in IPython

•Keyboard Shortcuts in the IPython Shell

•IPython Magic Commands

•Input and Output History

•IPython and Shell Commands

•Errors and Debugging

•Profiling and Timing Code

•More IPython Resources

Python Data Science Handbook in Google Colab

https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

Page 34: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

34

2. Introduction to NumPy

•Understanding Data Types in Python

•The Basics of NumPy Arrays

•Computation on NumPy Arrays: Universal Functions

•Aggregations: Min, Max, and Everything In Between

•Computation on Arrays: Broadcasting

•Comparisons, Masks, and Boolean Logic

•Fancy Indexing

•Sorting Arrays

•Structured Data: NumPy's Structured Arrays

Python Data Science Handbook in Google Colab

https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

Page 35: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

35

3. Data Manipulation with Pandas

•Introducing Pandas Objects

•Data Indexing and Selection

•Operating on Data in Pandas

•Handling Missing Data

•Hierarchical Indexing

•Combining Datasets: Concat and Append

•Combining Datasets: Merge and Join

•Aggregation and Grouping

•Pivot Tables

•Vectorized String Operations

•Working with Time Series

•High-Performance Pandas: eval() and query()

•Further Resources

Python Data Science Handbook in Google Colab

https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

Page 36: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

36

4. Visualization with Matplotlib

•Simple Line Plots

•Simple Scatter Plots

•Visualizing Errors

•Density and Contour Plots

•Histograms, Binnings, and Density

•Customizing Plot Legends

•Customizing Colorbars

•Multiple Subplots

•Text and Annotation

•Customizing Ticks

•Customizing Matplotlib: Configurations and Stylesheets

•Three-Dimensional Plotting in Matplotlib

•Geographic Data with Basemap

•Visualization with Seaborn

•Further Resources

Python Data Science Handbook in Google Colab

https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

Page 37: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

37

5. Machine Learning

•What Is Machine Learning?

•Introducing Scikit-Learn

•Hyperparameters and Model Validation

•Feature Engineering

•In Depth: Naive Bayes Classification

•In Depth: Linear Regression

•In-Depth: Support Vector Machines

•In-Depth: Decision Trees and Random Forests

•In Depth: Principal Component Analysis

•In-Depth: Manifold Learning

•In Depth: k-Means Clustering

•In Depth: Gaussian Mixture Models

•In-Depth: Kernel Density Estimation

•Application: A Face Detection Pipeline

•Further Machine Learning Resources

Python Data Science Handbook in Google Colab

https://colab.research.google.com/github/jakevdp/PythonDataScienceHandbook/blob/master/notebooks/Index.ipynb

Page 38: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

Summary

• Descriptive Analytics II

• Business Intelligence

• Data Warehousing

• Data Integration and the Extraction, Transformation, and Load (ETL) Processes

• Business Performance Management (BPM)

• Performance Measurement

– Balanced Scorecards

– Six Sigma

38

Page 39: Business Intelligence and Data Warehousing · Business Intelligence (BI) 2 Introduction to BI and Data Science Descriptive Analytics Predictive Analytics Prescriptive Analytics 1

References

• Ramesh Sharda, Dursun Delen, and Efraim Turban (2017), Business Intelligence, Analytics, and Data Science: A Managerial Perspective, 4th Edition, Pearson.

• Jake VanderPlas (2016), Python Data Science Handbook: Essential Tools for Working with Data, O'Reilly Media.

39