Creating and Implementing Metadata Strategy

  • Upload
    ar9vega

  • View
    219

  • Download
    0

Embed Size (px)

Citation preview

  • 7/30/2019 Creating and Implementing Metadata Strategy

    1/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    Turning Data into

    Knowledge: Creating andImplementing a Metadata

    Strategy

    Anne Marie Smith

    http://www.annemariesmith.com

    http://www.alabamayankeesystems.com

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 2

    Agenda

    Introduction

    Metadata Overview

    Principles of Metadata Management

    Metadata Strategy

    Key Roles in Metadata Management

    Metadata Quality Important Aspects of Metadata

    Conclusion

  • 7/30/2019 Creating and Implementing Metadata Strategy

    2/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 3

    Anne Marie Smith

    Background BA and MBA Management Information Systems (La Salle

    University)

    PhD, Management Information Systems (NorthCentralUniversity)

    Consultant in data management, metadata, data warehousing,requirements analysis, systems re-engineering

    Certified Project Management Professional (PMP)

    Certified Data Management Professional (www.iccp.org)

    Author of over 40 publications and papers

    Instructor on varied information systems management topics

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 4

    Definition of "Metadata"

    Metadata: "data about data"Collection of information about the data stored in anapplication or database

    Examples: Data element definition Data element business name

    Data element systems abbreviation Data type and data size Data element source location

    Dictionary

  • 7/30/2019 Creating and Implementing Metadata Strategy

    3/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 5

    Data Orientation Movement

    Traditional systems development focused onprocesses, not data as foundation

    Data orientation is a major cultural shiftchange in methods used to design and deliversystems

    change in perception, access and assetmanagement of data and information

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 6

    Data is a sharable resourceEffective use and reuse of data requires anenterprise view of essential concepts, entities andattributes for cross-application and cross-departmental functionality

    Enterprise view MUST be generated at the top of

    an organization, with active commitment andsupport for efforts

    Enterprise View of Data

  • 7/30/2019 Creating and Implementing Metadata Strategy

    4/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 7

    Goals of Metadata Strategy

    Provide business orientation as foundation forsharing data assets across entire organization

    Offer recognition of value of data and its componentsDevelop map for managing expanding informationrequirements

    Highlight importance of central data administrationAddress data quality, data integrity, data reuseMeasurement of value of information

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 8

    Strategic Plan for Information

    Evaluate and choose a systems methodologyCustomize methodology for data orientation andbusiness focus

    Develop and implement metadata strategyIntegrate new methodology in systems developmentand maintenance

  • 7/30/2019 Creating and Implementing Metadata Strategy

    5/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 9

    Data Administration Objectives

    Build a framework for accurately capturing, sharing,distributing, securing and leveraging a company's dataresources, including creating and refining data modelsand establishing and maintaining an enterprise datarepository

    Strategically plan for a company's future informationrequirements

    Support data self-reliance and efficient use of data in

    business practices

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 10

    Principles of MetadataManagement

    Establish a metadata strategy / policy

    Create or adopt a metadata standards set

    Establish and maintain data / metadatastewardship role and function

    Establish and maintain collection of relevantmetadata

    Publish relevant metadata Maintain metadata standards set

    Maintain metadata content in all systems

  • 7/30/2019 Creating and Implementing Metadata Strategy

    6/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 11

    Keys to Metadata

    Management Develop metadata strategy before embarking on

    evaluating, purchasing and installing complexmanagement products

    Products / tools are necessary for effectivemanagement of metadata

    Senior management commitment to metadatamanagement is required - cost and time issues

    Explanation of WHY metadata is needed and thepurpose of each type of metadata

    Policies to ensure acronyms and abbreviations are

    interoperable Procedures to ensure policies are implemented

    correctly

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 12

    Enterprise MetadataStrategy

    Offer recognition of value of data and its metadata(corporate assets)

    Establish information requirements and instill datamanagement / metadata management practices intoorganization

    Address data quality, data reuse, data integrity issuesfor legacy applications and new development

    Promote enterprise use of data management tools andtechniques

    Highlight importance of central data administration

    Measurement of value of information

  • 7/30/2019 Creating and Implementing Metadata Strategy

    7/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 13

    Metadata Challenge

    Broad: some metadata for every productionapplication and structure

    Deep: detailed metadata for criticalproduction applications and structures

    Decision points: What groups have pain? Why does painexist?

    What processes can be leveraged for maintenance?

    What metadata is readily available and will be useful?

    Who owns metadata in an organization?

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 14

    Metadata StrategyComponents

    Metadata Responsibility and UsageMetadata ElementsMetadata SourcesMetadata QualityMetadata Storage and ProductsMetadata Standards and Procedures

    Metadata TrainingMetadata Measurement

  • 7/30/2019 Creating and Implementing Metadata Strategy

    8/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 15

    Kinds of Metadata

    Direct: Byproduct of original source information

    systems that create, maintain and dispensedata

    Indirect: Created after direct metadata derived from

    system artifacts, uses of system, analysisand decision-making

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 16

    Metadata Committee

    Data AdministrationData AnalystsRepository Administrator

    Database AdministrationData StewardsRotating Application Development programmers

  • 7/30/2019 Creating and Implementing Metadata Strategy

    9/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 17

    Metadata Responsibilities

    Data Stewardship: responsible for consistencyand integrity of data objects under their control;usually from functional business units

    Data Custodians: responsible for syntacticalvalue of data; usually from Data Administrationand/or Database Administration

    Jointly establish standards and procedures for proper use,

    quality control and integration (stewardship team)

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 18

    Key Metadata ManagementTasks

    Establish data owners, custodians and users

    Formalize data stewardship committee

    Define corporate data and process standards

    Define edit philosophy and user educationphilosophy

    Centralize information object identificationand control processes and impactassessment

  • 7/30/2019 Creating and Implementing Metadata Strategy

    10/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 19

    Key Metadata Management

    Tasks Define basic enterprise information through

    an enterprise data model

    Develop application data and processmodels based on enterprise model - defineapplication information

    Oversee application development andimplement change control procedures

    Define data and metadata accessprocesses and choose appropriate tools

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 20

    Metadata Responsibility andUse

    Data Ownership syntactical value of data

    Data Stewardship consistency and integrityof metadata

    Establish standards andprocedures

    Proper use, qualitycontrol andmeasurement

    Integration with

    methodology andbusiness

  • 7/30/2019 Creating and Implementing Metadata Strategy

    11/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 21

    Metadata Elements and

    Sources

    Business definitions and business namesSystems definitions and systems namesCASE models and element relationshipsData element sources and targets (programs, files,databases, etc...)

    Methods for consolidating Metadata from multiplesources

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 22

    Quality: Imperative!

    Low-quality metadata creates: Replicated dictionaries / repositories /

    metadata storage

    Inconsistent metadata

    Competing sources of metadata truth

    High quality metadata creates:

    Confident, cross-organizational development Consistent understanding of the values of the

    data resources

    Metadata knowledgeacross the organization

  • 7/30/2019 Creating and Implementing Metadata Strategy

    12/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 23

    Metadata Quality - 1

    Data Accuracy: how well data values represent theactual business requirements

    Data Completeness: how well available data meetscurrent and future business information demands

    Data Currency: how timely are data valuesData ConsistencyData Integrity: conformation of source data values tothose allowed by business rules (data characteristics,default values, referential integrity constraints, derived

    data values)Data Source and Target

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 24

    Metadata Quality - 2

    Data Version: which data values best represent theactual state at a point in time

    Data Translation: how data values were convertedbetween variations of the same data characteristics (forformat and value variations)

    Data Integration: steps to reduce data redundancy anddata variability (e.g., 10 versus 7 positions; data code

    translation)Data SummarizationData Recasting: primary key changes, content andmeaning changes, missing periods of data

  • 7/30/2019 Creating and Implementing Metadata Strategy

    13/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 25

    Metadata Standards

    Established by Metadata CommitteeNaming standards

    Abbreviations (systems and business)Class wordsCode valuesBusiness names and definitions

    CASE modeling standardsEntity and element creation/modification proceduresStorage and accessibility of standards and

    procedures

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 26

    Choosing or Creating aStandard

    What schema should an organization use

    for metadata (i.e. how do we structuremetadata)?

    Use a standard schema (good forinteroperability) or develop one (mayprovide better support for local needs)

    Choice may require significant compromise combination approach may be acceptable

  • 7/30/2019 Creating and Implementing Metadata Strategy

    14/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 27

    Metadata Storage and

    Products

    Central versus distributed storageActive versus passive storagePhysical requirements of storage facilityMetadata products, capabilities and integration

    RepositoryCASE dictionaryWarehouse managerQuery tool data dictionary

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 28

    Metadata Training

    SystemsData AdministrationDatabase AdministrationApplication Development and maintenance

    programmingExecutive

    BusinessPrimary users (e.g., data stewards)Secondary usersExecutive

  • 7/30/2019 Creating and Implementing Metadata Strategy

    15/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 29

    Metadata Measurement

    Measure use and effectiveness of metadataMeasure success of quality control programMeasure acceptance and success of stewardshipIntegration of metadata strategy into systemsmethodology and business practices

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 30

    Cultural Change Required

    Data orientation and a focus on metadata requirea conscious cultural change from individuallydeveloped applications to a unified acceptanceand usage of data as the foundation of informationand knowledge

    Change is unsettling to all creatures - expectationsand reactions must be anticipated, addressed and

    resolvedTo be effective, cultural change must be managedin a spirit of co-operation and mutual accountability

  • 7/30/2019 Creating and Implementing Metadata Strategy

    16/17

    Metadata Management Best Practices 1/12/200

    (C) Alabama Yankee Systems, LLC

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 31

    Conclusions

    Metadata Strategy can assist in achievement of dataand information / intelligence goals

    Metadata Strategy should be part of acomprehensive customized systems methodologyand developed in conjunction with the businesscommunity

    Establishment and implementation of metrics and apermanent committee for implementation arefundamental to the success of a Metadata Strategy

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 32

    Questions and

    Answers

  • 7/30/2019 Creating and Implementing Metadata Strategy

    17/17

    Metadata Management Best Practices 1/12/200

    1/12/2006 (C) 2005 -2006 Alabama Yankee Systems, LLC 33

    Metadata Reference

    Sources http://dublincore.org/

    http://metadata-standards.org

    http://www.ukoln.ac.uk/metadata/

    http://www.ulb.ac.be/ceese/meta/meta.html