Case Study: Data Governance Implementation in Data Lake, in a S&P 500 Firm

Below are the capabilities leveraged for implementing Governance around an Enterprise Data Lake

Outcomes from Data Governance Implementation in Data Lake: 1. Data Governance Operating Model for Data Lake

2. Use of Axon for defining the logical model for the implementation of data lakes

12+ systems (Using UI and Bulk load process)

52+ Datasets (Using UI, bulk load or API from EDC)

2000+ data attributes (Using UI, bulk load or API from EDC)

30+ work-flows 25+ projects

2000+ glossary terms

2000+ Glossary relationships with Data attributes

20+ processes

10+ change requests

40+ Data Quality rules

Configuring roles as needed

Inbound relationships and Outbound relationships

Update DQ scores

Process maps

Data Ownership through work-flows Platform & Storage Governance

3. Use of EDC for scanning the physical model of data lakes

10+ relational databases

10+ Oracle databases

20+ S3 buckets (CSV, JSON, Avro, Parquet file formats)

Redshift resource scan

2000+ Glossary terms relationships with Technical columns

Capabilities Sub-capabilities Tools

Data Quality Suite Data Profiling, Rules Development; Rules Management; DQ Scoring - Measurement Point; DQ Escalation; Issue Resolution; Issue Statistics & Scoring

Informatica Data Quality

DG Workflow Suite Orchestration; Auto Triggers; Manual Trigger; Portal Collaboration Informatica Axon

Integration Suite ETL; Self Service Data Preparation; Workflow Scheduling Informatica PowerCenter or Informatica Big Data

Management

Data Governance & Metadata Suite

Glossary; CDE Management; Data Asset Model; Data Assets Inventory; Correlation Data Management to CDE; Cataloging; Connectivity; Metadata Cross Check; Auto Update Metadata; Metadata Error Management; Extensibility; Discovery; Taxonomy; Activity Audit Log; Data Lineage; Process Inventory; Policy Management

Informatica EIC + Axon

If you have a need, please feel to reach out to us - contactus@dattamza.com