51
Speedminer DWH and BPM www.speedminer.com by Thomas How www.hesper.com.my

Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

  • Upload
    vudieu

  • View
    217

  • Download
    4

Embed Size (px)

Citation preview

Page 1: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speedminer DWH and BPMwww.speedminer.com

by Thomas How

www.hesper.com.my

Page 2: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Evolution of Information Analysis

1960-1975 The Era of Efficiency1975-1980 The Era of Effectiveness1980-1995 The Era of Competitiveness1995-2003 The Era of E-Business

Page 3: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Era of EFFICIENCY(1960-1975)

Primarily transaction processing systems(Management Information Systems)Productivity gainsCost savings, headcount reductionExpanded processing capabilityCost/benefit analysis, Return on InvestmentQuery Based Report typified by the simple question such as "what were the sales of orange juice in January 1995 for the Boston area?".

Page 4: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Era of EFFECTIVENESS (1975-1980)

Improved managerial and organizational effectivenessDepartmental and distributed data processing (DDP)Client-server systemsEnd-user computingInformation Centres and the growth of PCsProvided model based Decision support systems(DSS) and group support systemsSensitivity analysis and optimization modelsExecutive information systemsAdvent of “Management Support Systems”

Page 5: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Era of COMPETITIVENESS(1980-1995)

Systems that reengineer business process (web based systems, workflow mgmt, data mining and warehousing)Information Systems for competitive advantageStrategic and market orientationChanging the way of doing businessOrganizational Transformation“Strategic Information Systems”Data Warehouse

Page 6: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Era of E-BUSINESS(1995-2003)

Fast information exchangeAccountability – Performance MeasureUse of Metrics to measure how successful is the implementation of Corporate Strategic Objectives Fast respond to changing conditions in business1996:Business IntelligenceUse of Information System to measure and manage performance (Business Performance Management)Business Activity Monitoring - "provides real-time access to critical business performance indicators to improve the speed and effectiveness of business operations."

Balanced Scorecard & Six Sigma

Page 7: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Problem with Traditional Reporting

InconsistencyLack of IntegrationNo Drill Down CapabilityNot TimelyRequire High Technical SkillLimited Option for ChartingForecasting and Analysis is almost Impossible

Page 8: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

What is Data WarehouseData Warehouse is a system designed to consolidate information from various sources and platform to create a centralized multi-dimensional storage, and to provide tools to perform flexible, effective and efficient analysis.Speedminer Data Warehouse empower business decision-makers to gain timely access to corporate information

Page 9: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Stages of Data Warehouse

Page 10: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in Healthcare

Quality Care - Provide feedback to physicians regarding outcomes and the cost involve. (Outcome analysis)Track Cost - Detect inappropriate and duplicate testsCut Cost - Detect slow moving and near expiry stockCustomer Service - Analysis on patient waiting timeResearch & Risk Analysis.Performance Analysis - Cost/Bill/LOS analysis by Department, Doctor etc. National Health Financing Scheme – Cost and revenue analysis on Diagnosis and Procedures.Control Outbreak of Deceases – Chief Complain, Diagnosis analysis by geographical area.

Page 11: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in Banking & Finance

Risk managementFraud detectionEvaluating business concentration and risk exposure leading to modified credit policies and loan loss reservesNon performing loan analysis Spending patterns analysis in credit card marketingTracking investment managersAbility to select better marketing partners Provide feedback to bankers regarding customer relationships and profitability Combine with proprietary data to determine purchase patterns to develop marketing programs Build innovative and successful product

Page 12: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in Manufacturing

Demand planning and Sales ForecastPlant capacity managementInventory turnover management/analysis Work force scheduling and Routes optimization Workforce planning and optimizationAllows quicker identification of product lines that are no longer required or profitable Better visibility into product and customer profit marginsAnalysis of product pricing to establish discounts and marginsAbility to project how well a new product can do

Page 13: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in Marketing

Tracking how promotion and one-time buys are doing, using trend analysisTracking item’s contribution to margin for its category.Allows for slow-selling lines and items to be dropped from the stores, while giving more shelf space for better selling products and items.Better understanding of customers and their buying patterns, to drive promotion.Ask “what if” marketing questions and get fast response.Meeting sales and marketing objectives.Develop better (marketing) strategy

Page 14: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in Government

Police Dept – Analysis on crime rate, accident report rate etc. by area, contingent, branch.Tax Dept – Auditing tax records for patterns/anomalies to uncover company and individual fraud cases. City Council – Analysis of Tax by industry across years.Immigration – Analysis on tourist by country of origin, Length of Stay, and destination etc.Social Security Org. – Analysis of contribution by Industry Code, Employer, Area Code etc. Airport Mgt – Comparison of income by different service type (Landing fee, Gate charges, Electricity, Water and other utility charges)Analysis on effectiveness of services and policy.

Page 15: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in Trade (Government)

Identify major trade partners and the balance of trade with those countryIdentify our major export and major import by Product (SITC) and by Country. Analysis on Port of Lading and the mode of transportationIdentify the trend of demandIdentify the business opportunity with other country and cross selling of our product to overseas market Identify the need for local production to reduce import

Page 16: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Application of DWH in General

Forecasting and Time AnalysisCost and Profitability AnalysisResource Management Outcomes and Trend Analysis Financial and Quality Analysis Error and Problems DetectionMulti Dimensional AnalysisBest Practices DiscoveryEarly Warnings Alert

Page 17: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

About Hesper Formed in 1997, specialize in Data Warehouse and Business Performance Management , database, healthcare and internet security system.Flagship product: Speedminer Data Warehouse and Business Performance Management.Staff Strength : Hesper Group (100+)

Page 18: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speedminer DWH & BPMEarly implementation experience:

Specialty LaboratorySmith Kline Beechem (TopCat) Inphynet Group (EMSA)

Started in 1994 in California, USCurrent version 5.2 (December 2003)

Page 19: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Components of Speedminer

Page 20: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed ETLLoads data from structured and unstructured databases, cleanse it with rules specified, and upload into Speedminerrepository – Speed OLAPAble to capture metadata from many popular DBMS Supports creation of Surrogate key and Foreign key Facilitates incremental update for Real Time Data Warehouse Scheduled task to perform on hourly/daily/weekly/monthly basis

Page 21: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed ETL - ConnectivityConnects to all popular RDBMS, unstructured data source like MS Excel, flat files, delimited text files and other common data file formats Broadest connectivity to proprietary ERP applications (e.g. SAP, PeopleSoft, Oracle, Siebel, JD Edwards, Manugistics, BAAN etc.), databases and mainframes via the Ensemble EAI component custom connectivity can be build for old legacy applications

Page 22: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed ETL - CleansingCorrect problems like missing information, out-of-range values and integrity error The only DWH with a complete post ETL cleansing Transformation & Standardization: Transform data from abbreviated code to full description. Multiple different values can be mapped to a single standardized value.Ranges Grouping: Group value by numeric/date/time range.Replacement for Null value or empty fields.Integrity Error: Key Replacement when original key is pointing to non-existing record.Support customized scripting code for complex rules.

Page 23: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed OLAPNo Cube! No pre-computed aggregatesData storing in compressed bitmap ensure highest performance with less storageEasy to setup Star Schema, Snowflake & many-to-many data relationshipScalable - support true multi-tiers architecture & distributed architecture Support import, export and bidirectional connection via ODBC, JDBC, XML and Web Services Support penta-bytes of dataHigh security down to record levelSupport dynamic dimension & measure

Page 24: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed AnalyserSupport Ad-hoc query, instantchart & report to PDF, MS Excel, HTML, MS Word etc.Multi-Dimensional, Trend, Time Series, Outcome Analysis Grant Total and other statistical analysis/calculationRanking, Grouping, Sorting or analysis outcomesPublic & Temporary Measure & ComputationSupport Drill Down, Drill Across & Drill Through any dimensions on data and chart.ForecastingCross selling analysisSupport Top/Bottom n records Exception highlightingWildcard search

Page 25: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed ReporterMulti-Object: can contain charts, and cross tabs, as well as non-BI components such as images, logos Flexible Output Choice of Screen, PDF, MS Excel, MS Word, Text file and Web Page (HTML).Support pictures as Header or background in the reportCan create Section to group data under headers with bookmark of dynamic linkEasier: Cross tabs, charts and drill through listing can be export to report with just a click Easy Distribution via WebSupport predefined template

Page 26: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed DashboardSupport pie, bar & many 2-D and 3-D chart types, color-coded drillable cross tabs and maps, frame, images & pictures, gauge meters, date picker, list box, text box etc.Advance 3-D charts able to rotate (any angle), zoom (enlarge any section), move (re-position to anywhere), scale (resize), save to file or clipboard.User able to customize the positioning, size and display format of the data.Interactive Filters to narrow the focus of the analysis Able to create filter and action button to attach any components Hyperlink to Web Sites and windows documents KPI Monitoring

Page 27: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Lowest sales from Argentina & ItalyUS shown in pie charts as largest market in 2 consecutive yearsCanada dropped in market share in 1998Click on chart to drill down or drill through to examine the cause of such business trend

Page 28: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed Dashboard – Exception Highlight & 3-D Chart

Page 29: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed ListingQuick & easy design of simplest to complex reportProvides a library of many calculations, statistical functions, & allow custom build functions.Data Browser facilitates traverse between reports.Supports the incorporation of KPI with parameter passing in the transaction listing

Page 30: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed FormUse Speed Dashboard to create custom look and feel layout to facilitate Speed Listing Intuitively incorporate several sub-reports within a main report. Each sub-report can further have nested items.Store picture, date/time, text where standard software or legacy system not able to extend the database to capture additional information needed.Extend customer database to build simple CRMAdvance Post ETL cleansing for data overwrite without changing original data, thus enable variance report of changes.

Page 31: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speed PresenterMS PowerPoint like presentation toolsIntuitive Interface: A series of dashboard created using same familiar, intuitive interface (Speed Dashboard) as presentation slides.Interactive: Allows criteria filtering on slides to narrow down the analysis scope. Statistics show can be drill down to more detail level, and transactional listing supports traverse to linked reports.Dynamic: Analysis outcome on the presentation slides always refresh with the statistics or details of most updated information.

Page 32: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Easy search of data

Easy to create search form for listing of any data. Above are listing of Customer Master with the interactive filter at the top and browsing option to all Basic Card or Supplementary card hold

Page 33: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

KPI in Transaction Listing

KPI can be incorporated easily into listing. Data Browse link listing by Key

Page 34: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Range Group, Exeption Highlight

Speedminer facilitate Exception Highlight to bring to your attention the area of business with exception performance or failure

Page 35: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Flexible Reporting

Category name can be customized easily, total/average and many other statistical functions and calculation can be done easily

Page 36: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

3D Chart

3D charts with option to rotate in any angle or perspective of view, zooming, re-positioning, save to file or clipboard & many more options

Page 37: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Comparison

Simply select a year and see the comparison of business performance of the year selected and the year before

Page 38: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Forecasting

Advance forecasting method like Trend Adjusted Exponential Smoothing can be added to analysis by just drag & drop

Page 39: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Statement of Account

Example of statement of account allow one or multiple card program, MCC and Transaction Type filtering, and show outstanding by customer

Page 40: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Flexible Layout

Custom layout listing can be created even to support pictures and comments

Page 41: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Competitor DWH - ProblemsExpensive – most tools from overseas are pricey Technologies (e.g. CUBE) used are too complicated especially for complex database architecture. If it can wrong, it will. Many has its own scalability limitations – e.g. Each CUBE can support a limited number of records. Lack of high skill local implementation team.Slow in performance on Drill Down result for huge dataset.No support of dynamic dimensions and aggregates

Page 42: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

New Generation DWH -Speedminer

Cube-lessReal-TimeCompressed Bitmap for speed processingTrue Multi-Dimensional StorageScalability - True Multi-Tiers ArchitectureComplete Business Intelligence with Data Warehouse & Business Performance ManagementDynamic AggregatesNo pre-computed aggregation

Page 43: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Benefits of Data WarehouseStudies have consistently shown a huge return on investment from data warehouse implementations. The figures generally range from 300% to 650%.Business is changing faster than ever, and competition is more brutal than ever. Business decisions require consistent accurate information. The old approach of asking IS to design a report just won’t cut it anymore. With hardware prices falling, there has never been a better time to create some autonomy for the business user. Users need direct access to corporate information to get the facts to make business decisions, and data warehouse is the most cost-effective way to provide that access

Page 44: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Successful DWH:Objectives Business Objective

Analysis – Access to specific high-value information on a timely basis.Reporting – Makes the restructured data available to users via user-friendlier query and reporting tools.

Technical ObjectivePerformance – Gets the data off of the transaction system for analysis.Integration – Restructures and integrates the data so that it is easier to use for reporting and analysis.

Page 45: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Successful DWH:Risks Business: Content

Does the solution answer the right questions?Does the solution have enough data?

Business: User AcceptanceIs it too complex for the average user?Is the data timely enough?

Technical: PerformanceIs the performance of the user queries satisfactory?Can data be loaded to the data warehouse within the allotted timeframe?

Technical: IntegrationHow do we combine information from multiple systems?

Page 46: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Successful DWH:Enterprise Strategy

Assess technical landscapeIdentify business driversDefine analytical processes to be supportedIdentify major facts, dimensions and attributesMap and gap to data sourcesAssess current architecture and toolsRecommend subject area phasing and tool selectionHow do you control the risks?

Page 47: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Customizable look & feel

Page 48: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Speedminer supports more chart types

Page 49: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Reference Sites Selayang Hospital (The 1st Paperless Hospital in Malaysia)Fuzhou General Hospital (China) Bridges Worldwide (United Kingdom)Gleneagles Medical Centre (Malaysia)Crystal Integrated Sdn. Bhd.(Malaysia) Sultan Bin Abdul Aziz Humanitarian City (The Largest Rehabilitation Centre in Arab Sardi ) Optegra Sdn. Bhd. (Malaysia)I-WAP Sdn. Bhd. (Malaysia)Darul Ehsan Medical Centre (Malaysia)And many more……

Page 50: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

We help you to Control & Manage Risk

Page 51: Speedminer DWH and BPM - · PDF filez1995-2003 The Era of E-Business. Era of EFFICIENCY ... zQuery Based Report typified by the simple question such ... zTax Dept – Auditing tax

Thank You

15-3A, Jalan SS23/15, Taman S.E.A, 47400 Petaling Jaya, Selangor, Malaysia Tel : 603-7880 9910 Fax : 603-7880 9920 www.hesper.com.my