Embed Size (px)
Citation preview
Energy Industry Profile An Update from the
Metadata Work Group
May 1, 2012
PUG Conference 2012
Houston, Texas
Metadata Work Group
Outline
• Metadata Initiative Background / EIP Overview
• 2012 Release of EIP V1.0
• EIP Roadmap
• Energistics Geoportal Demonstration
• Esri Software Customizations to Support EIP V1.0
2
Background: Business Driver & Goal State
Business Driver • 40% of staff time devoted to finding, retrieving, and verifying information, while
data volume is growing at 60-80%/yr and need for integrating distributed,
diverse resources is increasing
Goal State: Realize metadata standards and guidelines which enable stakeholders in the
energy industry (“the community”) to effectively and efficiently discover,
evaluate, and retrieve structured and unstructured information resources.
Support both proprietary data management needs, and exchange of data
between and within organizations.
Leverage existing open standards to encourage adoption within the
community and integration into the business, and exploit existing
organizational resources needed for governance and long-term
maintenance.
3
Background: Scope Facets
1. Application usage:
Discovery, evaluation and retrieval of information resources distributed across
the community
2. User community:
Anyone cataloging, searching, evaluating or accessing information with value
to members of the energy industry:
Energy companies & consortia
Data & Information providers
Software vendors
Government agencies & Academia
3. Resource types:
Initial focus on structured and unstructured information resources which have
associated spatial coordinates:
Geospatial data sets & web services
Mapping, Interpretation & Modeling project data sets
Physical resources with associated location
4
EIP-compliant
Catalog
External
Metadata
Catalog
Externally Harvested (Commercial,Gov’t,
& Academic)
Partner &
Subscription
Delivered
Structured
resources
Unstructured
resources
Application
Managed
Internally
Harvested
Background: Vision for Industry Metadata Exchange & Use
5
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
Legend
: Metadata exchange
via EIP standard
________
________
________
________
________
_____
Initiative Participants
AAPG
Apache
Boise State Univ.
Carbon Lifecycle Technology
ConocoPhillips
DCP Midstream
Deloitte Services LP
Devon Energy
ETL Solutions
Exprodat
ExxonMobil1
First American Spatial Solutions
Flare Solutions
Fugro Robertson
Geoscience Australia
Geosoft
Ies Brazil Consulting & Services1
IHS Energy
Maersk Oil1
New Century Software
North West Geomatics
Oracle1
ORNL
P2 Energy Solutions
PEMEX
PennWell
PetroWEB
Pioneer Natural Resources1
PPDM1
Priemere Consulting Group
SAS Global Oil & Gas
Schlumberger1
Shell1
Univ. of Auckland, NZ
Virginia Dept of MM&E
Wood Mackenzie
Dave Danko, ESRI
Lisa Derenthal, Gimmal
Alan Doniger, ACD Consulting Solutions1
Scott Hills, Chevron1
Hari Koduru, Energistics
Steve Richard, USGIN, AZ Geol Survey1
Steering Team Active Participants (SMEs)
1 Energistics member; Bold: Contributed initial EIP requirements,
Feedback about v1.0 Release Candidate
Asset/Data Management SIG
Metadata Work Group
Energistics
6
Key External Engagements
USGIN Project • Joint project of U.S. Geological Survey and all 51 U.S. State Geological Surveys
• Steve Richard (AZ State Geol. Survey) on Work Group Steering Team, contributing
significant technical input
ISO/TC 211, 19115 Revision Project • Energistics granted Class A Liaison status to ISO TC 211
• Metadata Work Group on ISO 19115 Revision Project Team & Editing Committee
• Contributed several enhancements to ISO/DIS 19115-1 important to the Energy
Industry Metadata Initiative vision
ISO/TC 211, 19115-1 XML Encoding Project • Energistics submitted New Work Item Proposal for XML encoding of ISO 19115-1
• Invited Dr. Ted Habermann (NOAA) to fill Team Lead role
• Steve Richard representing Metadata Work Group on Project Team
NOAA/National Geophysical Data Center • Accepted key role in proposed EIP Prototype Project
7
EIP builds on established ISO 19115 standard
Our approach leverages existing
standards -
• ISO 19115 metadata standard for
geographic information –
internationally accepted
• Existing profiles:
– North American Profile (NAP)
– European INSPIRE guidelines
– ANZLIC - Australia, New Zealand
– USGIN profile – AASG/USGS
• Use same approach to deliver a
“Energy Industry Profile” built on
these
8
Overview of EIP Specification
9
Leverage existing standards • ISO 19115 (content model)
– and ISO 19139 (XML encoding)
• Existing profiles of ISO 19115 – ANZLIC Profile (Australia, New Zealand)
– European Union INSPIRE guidelines
– USGIN Profile
… to Deliver
• Energy Industry Profile of ISO/DIS 19115-1
and ISO 19115-2 v1.0
– ISO Conformance Level 1 Profile designed to
enable community interoperability
• 125 pp. Specification Document includes:
– Normative Specifications
– Implementation Guidelines
– Selected XML Encoding Examples
EIP Design Basis
Anticipating need for automated processing of large numbers
of metadata records, - and to simplify development, implementation, and maintenance of
supporting software –
EIP v1.0 • identifies Three Classes of
Information Resources, and
decomposes them into Five
Groups of Metadata Elements
• maps different combinations
of Metadata Element Groups
to MD_Scope codelist values,
and thus the metadata confign
- e.g., “dataset” value identifies a
Geolocated Digital Product
10
Key Metadata Packages
Portrayal
Catalogue
Constraint Content
Distribution
Citation &
Responsible
Party
Metadata
Extension
Reference
System
Extent
Units of
Measure
Spatial
Representation
Key packages
are highlighted
Application
Schema
Maintenance
Lines between packages are ‘uses’ dependencies
Metadata
Entity
Identification Data Quality
11
EIP Roadmap
PUG
EIP v1.0 Release Candidate Development
2010 2011
Community
Review
ISO/DIS 19115-1 Release
EIP v1.0
Updates: ESRI UC
EIP v1.0 Release Candidate
ISO 19115-1 Revision Drafts (WD0, WD1, CD, DIS)
AGU
Stakeholder Webinars
2012
ISO 19115-1 XML Encoding TS
Initial Workable XML Encoding
Pilots
EIP Prototype
EIP v1.1
OGC TC Mtg
12
EIP-compliant
Catalog
External
Metadata
Catalog
Externally Harvested (Commercial,Gov’t,
& Academic)
Partner &
Subscription
Delivered
Structured
resources
Unstructured
resources
Application
Managed
Internally
Harvested
Recap: Vision for Industry Metadata Exchange & Use
13
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
Legend
: Metadata exchange
via EIP standard
________
________
________
________
________
_____
EIP-compliant
Catalog
External
Metadata
Catalog
Externally Harvested (Commercial, Gov’t,
& Academic)
EIP Prototype Project
14
_________
_________
_________
_________
_________
______
_______
_______
_______
_______
_______
_____
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
_________
_________
_________
_________
_________
______
Search
Editing
Harvesting
Service Interface
Project Focus
EIP Prototype Project
Objectives • Implement an Energistics-managed, EIP-compliant Catalog &
Search System – Based on Esri Geoportal Server
• Establish a Network of 3-4 Systems Demonstrating Discovery of
Distributed Resources
Contributors – Energistics
– USGIN
– NOAA
– USGS
– Esri
– U. of Colorado/CIRES
15
EIP Prototype Project –
Deliverables
16
Minimum 1. EIP-compliant Geoportal installation
2. XSLTs for harvesting FGDC, ISO 19115:2003 metadata
3. Compliance validation utility (Schematron)
4. Vocabulary web service for code lists
5. EIP-compliant metadata editor
6. Documented changes needed to EIP v1.0
7. Community workshops and webinars
Optional (subject to Sponsor support) or Phase 2
• Outline of design for non-Geoportal implementations
• .NET assembly for developers
• Tutorial documentation
EIP Geoportal - Search Feature
Out of the box
features, no
customization
EIP Geoportal – Metadata Details View
EIP Geoportal – Metadata Details View (2)
• Task: update
presentation of full
metadata record
• Key content at the top
of the listing:
– Title
– Abstract
– Access constraints
– Distribution
EIP Geoportal - Setup Harvest
EIP Geoportal - Creating Records
• Create records
through UI
• Upload from
files (single
records)
• Harvest from
network
– WAF
– CSW
– ….
EIP Geoportal - Editor Configuration
• Can configure for
various metadata
profiles
• Task: Add EIP ISO
profile to list
– Dataset
– Service
– Physical resource
EIP Geoportal - Editor Features
• Tabs for metadata sections
• Automatically calculated
values
• Default values
• Pick lists
EIP Geoportal - Harvest from Variety of Sources
• Metadata has
to be in known
format
• EIP geoportal
will harvest
ISO19115 and
FGDC XML
Geoportal - Catalog Service (CSW)
• Geoportal windows we’ve been looking at are the
canned, out of the box interface
• Important function of catalog is the service
interface
– Allows queries from other clients using a variety of
protocols (openSearch, OGC CSW, ESRI REST)
– Responses in various formats (csw:record, EIP ISO,
atom…)
– Opportunity for others to build search interfaces
– Records in catalog may be harvested
Geoportal – Output Formats
• Other output formats available
via ESRI REST API
Geoportal - Atom Response in Web Browser
http://....org/geoportal/rest/find/document?searchText=Kentucky&f=atom
CSW request, XML response
Custom Search Client using CSW
Search from USGS National Map
EIP Prototype Contributors
• University of Colorado Role
– XSLT for FGDC to EIP ISO
– XSLT for ISO(2006) to EIP ISO
– Schematron rules for validation
• Esri Role
– ESRI Product Support for EIP
– Prototype Tasks
31
EIP Prototype Project –
Esri Custom Tools
• Esri Geoportal Server
– Identify, validate, and create EIP v1.0 metadata
• Implement U. of Colorado/CIRES Metadata Transform Capabilities
– Geoportal transforms ISO 19115/FGDC metadata to EIP v1.0
• Search Prototype Project catalogs from ArcMap
• Use ArcCatalog 10 to view, create, and export EIP v1.0 metadata
• Assist Energistics making tools publically available
32
EIP Prototype Project –
Community Workshops and Tech Transfer
• Geoportal Technology Transfer to Energistics
• First Energy Community Workshop
• Second Energy Community Workshop
• Follow-on Training Webcast
XML
33
EIP Prototype Project –
Online EIP v1.0 Geoportal Metadata Editor
34
EIP Prototype Prototype –
Transform existing metadata to EIP v1.0 & publish
Transform
• ISO/FGDC
• Becomes EIP v1.0
Validate
• Transformed metadata validated against EIP v1.0 rules
• Passes or Fails validation
Publish
• Valid, approved EIP 1.0 MD is published
• Invalid is saved as ‘Draft’
35
EIP Prototype Project –
Search Project Catalogs from ArcMap
36
Use ArcCatalog
to view, create,
& export EIP v1.0
metadata
37
