ISTI 2014 conference non traditional bi

THE MAKING OF ANON TRADITIONAL

BUSINESS INTELLIGENCE SUITE

Andrea Alberici, Tea Tavanxhiu

Studio Synthesis Srl

Data Smiths

Business Process Analysts

CRM consultants

IT - Legal consultants

Data Scientist? It’s a mindset, not a name

DATA SMITH

For me being a scientist is a mindset, not a qualification. It’s the mental attitude and aptitude to take on and solve problems through a process of hypothesis and experimentation. […]

What matters is the desire for knowledge and understanding, even better if you’re of the mindset that you want to share it with everyone afterwards

Paul Banoub - Vizninja

DATA SMITH

CREATE TOOLS

Red line: Business

needs

Revenues

N. companie

s

Standard software(consumerization)

Big System Integrators

Filling the gaps

Blue line: N. of companies

SETTING THE STAGE

DATA SMITH

For me being a scientist is a mindset, not a qualification. It’s the mental attitude and aptitude to take on and solve problems through a process of hypothesis and experimentation. […]

What matters is the desire for knowledge and understanding, even better if you’re of the mindset that you want to share it with everyone afterwards

Paul Banoub - Vizninja

New trends in BI

Tableau Software, 2014http://www.slideshare.net/TableauSoftware/top-ten-bi-trends-for-2014

New trends in BI

Big data finally goes to the sky

Predictive analytics, once the realm of advanced and specialized systems, will move into the mainstream

Agile business intelligence extends its lead

The end of data scientists

Cloud business intelligence goes mainstream

Embedded business intelligence begins to emerge in an attempt to put analytics in the path of everyday business activities

Storytelling becomes a priority

Mobile business intelligence becomes the primary experience for leading-edge organizations

Organizations begin to analyze social data in earnest

NoSQL is the new Hadoop

What we «realized» on our experience

Agile business intelligence extends its lead. Self-service analytics becomes the norm at fast-moving companies. Business people begin to expect flexibility and usability from their dashboards. And the monolithic infrastructure stack finally crumbles in favor of solutions that can work with new data sources

The end of data scientists. Data science moves from the specialist to the everyman. Familiarity with data analysis becomes part of the skill set of ordinary business

users, not experts with “analyst” in their titles.

Embedded business intelligence in the path of everyday business activities, begins to emerge in an attempt to put analytics in them. Analytics start to live inside of transactional systems. Scenarios like customer relationship management will lead the way with analytics providing support for the many small decisions salespeople make in a day.

Storytelling becomes a priority as people realize that a dashboard deluge without context is not helpful. Stories become a way to communicate ideas and insights using data. They also help people gain meaning from an overwhelming mass of big and disparate data

BI ARCHITECTURE

TRADITIONAL BI

ETL

DWH

REPORTING

HIGH COSTS – MONOLITHIC INFRASTRUCTURE

PROBLEMS OF TRADITIONAL BI

Applying a new perspective• The Metadata Layer is the application

itself• An innovative approach to ETL• Agile BI using a flat table• Queries in the hands of business

users• Embedded presentation layer• Reporting in the hands of business

users

ANOTHER APPROACH

The chosen application is a CRM System in its origins: coreBOS (fork of vtigerCRM, Sugar CRM)

WHY?

FLEXIBLE BY NATURE

METADATA LAYER

The transformations are mainly done at application level

HOW?

EASY (FLAT) IMPORTMASSIVE ACTIONS ON ENTITIESTRIGGERS FOR FINE GRANULARITY

LOOK MA, NO ETL!

We normalize data on single flat views (or we use OLTP Data directly)

HOW?

NEW TECHNOLOGIES (specifically columnar databases)

(BIG) FLAT TABLES vs STAR SCHEMA

NO SQL IN A SQL DATABASE (!)

HOW?

FILTERS AND QUERY BUILDERS EMBEDDED IN THE APPLICATION

QUERIES IN THE HANDS OF BUSINESS USERS

The Presentation Layer LIVE in the application itself

It was born to satisfy the need for CRM Operative analytics

PRESENTATION LAYER – EMBEDDED BI

In turn, also the Adhoc reporting is part of the Presentation Layer

HOW?

We created a portal that «lives» upon queries created by users in order to create self service data analysis tools

REPORT CREATION IN THE HANDS OF BUSINESS USERS

ARCHITECTURE

NON TRADITIONAL BI

Evolutivo Analytics: the family

• CoreBOS (Linux, Php, Apache, MySQL)• Jquery – Kendo UI – dhtmlx• Node.js – REST webservices• TokuDB, InfiniDB• Memcached, APC• Respond CMS• toolbox.evolutivo.it

TOOLS THAT MAKE IT HAPPEN

Metadata- ive Modularity- Master-detail structure

NO-ETL Approach- Import wizard- Entity management framework:

Data cleaning Massive editingMassive Actions

Technical Side - columnar database

- Materialized Views

- continuous data change

- custom script reports

Presentation LayervtApps

report/listviews

Drill down

query builder interni e on-demand- Query Builder

- Persistent Views

AD HOC Reporting- Materialized View Creator

- Vtapp Creator

- BI Server (Toolbox Companion)

- Vtapp Form Creator

- Mail report engine

@aalberici

www.evolutivo.itevolutivoteam.blogspot.com

andrea@evolutivo.it

THANK YOU