16
BUSINESS INTELLIGENCE LABORATORY Business Intelligence Architectures Business Informatics Degree

BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

  • Upload
    others

  • View
    21

  • Download
    1

Embed Size (px)

Citation preview

Page 1: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

BUSINESS INTELLIGENCE LABORATORY

Business Intelligence Architectures

Business Informatics Degree

Page 2: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

BI Architecture

Business Intelligence Lab

2

6 lessons – data access

4 lessons – data quality & ETL

5 lessons – data mining

6 lessons – OLAP and reporting

1 lessons – analytic SQL

Page 3: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Data sources

¨  Multiple operational data sources ¤ Across departments of the organization, and external

sources ¤  Type and formats

n  Relational, multidimensional, time-seriers, spatial, text, multimedia, ..

¤  Issues n  Standards for representations, codes, formats of text files

n  Standards for querying relational data sources n  Basic programs for data manipulation

¨  We will study: ¤  Java access to text files ¤  Java access to RDBMS

Business Intelligence Lab

3

Page 4: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Extract, Transform and Load

ETL (extract transform and load) is the process of extracting, transforming and loading data from heterogeneous sources in a data base/warehouse. ¤  Typically supported by (visual) tools

¨  We will study: ¤  SQL Server 2016 Integration Services

4

Business Intelligence Lab

Page 5: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Extract, Transform and Load

Incremental and real-time ETL ¤  Complex Event Processing (CEP)

5

Business Intelligence Lab

Page 6: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Data warehouse

“A data warehouse is a subject-oriented, integrated, time-variant, and nonvolatile collection of data in support of management’s decision-making process.”

W.H. Inmon

¨  Data warehousing: the process of building and using a datawarehouse

6

Business Intelligence Lab

Page 7: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Data warehouse servers

¨  Relational DBMS (RDBMS) ¤  With specialized index and optmizations

n  star-join query, bitmap index, partitioning, materialized views

¤  We will study: n  SQL Server 2016 with analytic SQL

¨  MapReduce engine ¤  Big data challenge

n  Architect (low-cost) data platform

¤  Covered by 599AA «Big Data Analytics»

Business Intelligence

7

Page 8: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Which DBMS for DW? 8

Gartner Magic Quadrant – February 2016

Page 9: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

BI Architecture

Business Intelligence Lab

9

6 lessons – data access

4 lessons – data quality & ETL

4 lessons – data mining

5 lessons – OLAP and reporting

1 lessons – analytic SQL

Page 10: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Mid-tier servers

¨  OnLine Analytical Processing (OLAP) ¤  Provides a multidimensional view of data warehouses

¤  Pre-compute aggregates n  in ad-hoc structures (multidimensional OLAP - MOLAP)

n  in relational DB (relational OLAP - ROLAP)

n  in-memory OLAP

¨  We will study: ¤  SQL Server 2016 Analysis Services and MDX Query Language

10

Page 11: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Mid-tier servers

¨  Reporting Servers ¤  Enable definition, efficient execution, and rendering of reports

¤  Data is retrieved from datawarehouse or OLAP servers

¨  We will study: ¤  SQL Server 2016 Reporting Services

11

Page 12: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Mid-tier servers

¨  Data/web/text mining servers ¤  Extract descriptive & predictive models from structured/graph/textual data

¨  We will study: ¤  WEKA: a data mining software in Java

12

0 0.2 0.4 0.6 0.8 10

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

x

y

y < 0.33?

: 0 : 3

: 4 : 0

y < 0.47?

: 4 : 0

: 0 : 4

x < 0.43?

Yes

Yes

No

No Yes No

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 10

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

x

y

Page 13: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Mid-tier servers

¨  Enterprise Search Engine ¤  Crawl, index and search by keywords over different types of data

¤  Covered by 289AA «Information Retrieval»

13

Page 14: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

BI Architecture

Business Intelligence Lab

14

6 lessons – data access

4 lessons – data quality & ETL

4 lessons – data mining

5 lessons – OLAP and reporting

1 lessons – analytic SQL

Page 15: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Front-end applications

¨  Applications through which users perform BI tasks ¤  Spreadsheets

n  for navigating multidimensional data

n  We will study: Excel

¤  Enterprise portals n  for accessing reports and dashboards

n  for searching through query

¤  GUI n  for accessing mining models

n  for exploratory data analysis

n  for ad-hoc queries

¤  Vertical packaged applications for CRM, Supply-Chain, Finance, Opinion mining …

¤  More specialized tools for building storytellings to produce understandable stories to presents information to the users. n  Covered by 602AA «Visual Analytics»

Business Intelligence Lab

15

Page 16: BUSINESS INTELLIGENCE LABORATORY Business Intelligence ...didawiki.cli.di.unipi.it/.../fetch.php/mds/lbi/lbi.02.bi_architectures.pdf · BI Architecture Business Intelligence Lab 2

Front-end applications

Business Intelligence

16