17
1 A N e t - C e n t r i c A F S A F / X C X A Transforming the Way the AF Manages Data Net Centric Data Strategy using Communities of Interest Amit K. Maitra 540-270-5694 SAF/XCXA February 14, 200

2005 02 14 C2 Isr Coi Brief Ak Maitra

Embed Size (px)

Citation preview

Page 1: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

1

A N

et-Cen

tric AF

SA

F/X

CX

A Transforming the Way the AF Manages Data

Net Centric Data Strategy

using Communities of Interest

Amit K. Maitra540-270-5694SAF/XCXA February 14, 200

Page 2: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

2

A N

et-Cen

tric AF

SA

F/X

CX

A

The Air Force Strategy To move from privately owned and stored data in disparate networks and within legacy systems/applications to an enterprise information environment where authorized known and authorized unanticipated users can access any information and can post their contributions for enterprise-wide access.

To Consumer-centric:• Data is visible, accessible and understandable• Shared data – supports planned and unplanned consumers• Shared meaning of the data enables understanding

Enabling Net-Centricity Data Strategy

Ubiquitous Global Network

MetadatMetadata a

CatalogCatalogss

Enterprise Enterprise & &

Community Community ServicesServices

ApplicatioApplication Services n Services (e.g., Web)(e.g., Web)

Shared Shared Data Data

SpaceSpace

Metadata Metadata RegistriesRegistries

Security Security Services Services (e.g., (e.g.,

PKI, SAML)PKI, SAML)

Producer

DeveloperFrom Producer-centric:• Multiple calls to find data • Private data – only supports planned consumers• Data translation needed for understanding when pulled from multiple sources

Consumer

Producer and

Developer

System 1 Data

System 2 Data

System N Data

Consumer

...

Page 3: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

3

A N

et-Cen

tric AF

SA

F/X

CX

A

Barriers to Identifying, Accessing and Understanding DataDefining The Data Problem

End-User Consumer End-User Producer

B A R R I E R B A R R I E R B A R R I E R B A R R I E R

“What data exists?““How do I access the data?”“How do I know this data is what I need?”“How can I tell someone what data I need?”

“How do I share my data with others?” “How do I describe my data so others can understand it?”

Organization “A” Organization “B” Organization “C”

User is unaware this data exists

User knows this data existsbut cannot access it because of organizational and/or technical barriers

?User knows data exists and can access it but may not know how to make use of it due to lack of under- standing of what data represents

Data Strategy Approach:

DiscoveryMetadata

Data Strategy Approach:

Web Enabling, Web-service Enabling

Data Strategy Approach:

Communities of Interest,Metadata Registry

Page 4: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

4

A N

et-Cen

tric AF

SA

F/X

CX

A

DoD Discovery Catalogs

DoD Metadata Registry

DoD Service Registry

Data ProducerData Consumer

“Shared Space”

Publishing and Subscribing of Data & ServicesSupporting Both Known and Unanticipated Authorized Users

Unanticipated Authorized User of System A Data

Query Catalogs and Registry

System X

“Pull” Structural and Semantic Metadata

“Pull” Data

PublishStructural and Semantic

MetadataPublish Data and

Services

Pu

bli

sh

Dis

co

ve

ry M

eta

da

ta

System BData exchanged across engineered, well-defined

interfaces

Known User of System A Data

System A

All Data Assets are Tagged with DoD

Discovery Metadata Specification (DDMS)

Metadata

Leverages

Service Oriented Architecture

Page 5: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

5

A N

et-Cen

tric AF

SA

F/X

CX

A

Data Sharing Responsibilities

Key Goal of DoD Directive 8320.2

Scope of Enterprise Role Scope of COI Role

Make data visible

Contextual Data

* Develop, maintain DoD Discovery Metadata Specification (DDMS) to facilitate DoD-wide search

* Direct development of Enterprise search capability

* Tag data holdings with DDMS* Extend for COI specific search

criteria

Make data accessible

Sharing Data

* Maintain repository of acceptable commercial standards for web-based services

* Direct development of federated service registry for web-services

* Implement access services* Register access services in

federated service registry

Make data understandable

Structural & Semantic Data Descriptions

* Direct development of federated metadata registry for semantic and structural metadata

* Develop vocabularies, taxonomies for data exchange

* Register these agreements in federated DoD metadata Registry

Air Force sees this as an AF transformational priority !

Air Force Information & Data management Strategy Policy, May 2004

DoD 8320.2 Directive, Data Sharing in a Net Centric Department of Defense

DoD 8320.2 Directive codifies DoD Net-Centric Data Strategy (DoD CIO)

Data Strategy Implementation Guide is under development (DoD CIO)

Page 6: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

6

A N

et-Cen

tric AF

SA

F/X

CX

A

Community of Interest (COI) Approach

• Define data sharing shortfall as a problem statement• Define COI-specific vocabularies and taxonomies

– Vocabularies to improve data exchange within COI and among COIs

– Taxonomies to improve precision discovery• Make their data assets visible and accessible

– Visible via service registry (WSDL), metadata registry (XSD), and data catalogs (DDMS)

– Accessible via web services and common mime types• Register semantic and structural metadata to the DoD

Metadata Registry (http://metadata.dod.mil)– XML Gallery for XML schemas, stylesheets, domain sets, samples– Taxonomy Gallery for discovery taxonomies (OWL syntax)

• Pilots, Exercises, Integration with Programs of Record– Data asset discovery and understanding– Data asset posting to shared spaces

http://www.defenselink.mil/nii/org/cio/doc/COI_FAQ.doc

Page 7: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

7

A N

et-Cen

tric AF

SA

F/X

CX

A

Activities for COIs to Implement

Key Activities1. Identify/establish COI2. Identify membership and governance (e.g.

Mission Areas, Domains) and key stakeholders (e.g. Programs, Operators)

3. Identify/prioritize/select key COI capabilities and data assets to expose to Enterprise

4. Register into DoD COI Directory (https://gesportal.dod.mil/sites/coidirectory)

5. Define and register COI structural metadata (e.g. taxonomy, vocabulary, data models, schema)

6. Define discovery metadata and process (extend the DDMS)

7. Tag data assets and post to searchable catalogs (e.g. Domain metadata catalog and service registry)

8. Register COI services (supports separation of data from applications)

9. Operate and sustain COI services (e.g. web services) for selected COI capabilities (leverage NCES CES)

COI Overview

Page 8: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

8

A N

et-Cen

tric AF

SA

F/X

CX

A

Sample COI Organization Chart

Steering Committee Forum (FO)

(Chair or Co-Chair)

Data Management Working Group

(Military Service Co-Lead)

WGs

FOR DISCUSSION PURPOSES ONLY

AdditionalGroups

as needed

Infrastructure Working Group(Military Service

Co-Lead

Executive Board (FO/GO) Chair or Co-Chair

Pilot Demonstration Working Group

(Military Service Co-Lead)

•Task: write web service to pub/sub the data

• Web Services

• Leverage Net Centric Enterprise Service (NCES) services (discovery, security)

•Task: Develop common data vocabulary for a given report

• Bottoms up data user defined

• Supports top down governance

•Task: Develop a repeatable process to demonstrate pub/sub web service

• Risk reduction for inclusion by Programs of Record

2 or 3 star level

1 star level

with 0-6/GS-15 membership

Page 9: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

9

A N

et-Cen

tric AF

SA

F/X

CX

A

Page 10: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

10

A N

et-Cen

tric AF

SA

F/X

CX

A

Way Ahead

• ISR COI– Purpose and Scope– Goals

• ISR COI Charter• Domain Name • Common Core Taxonomies

– Feature Level Metadata– Quality– Levels of Metadata– Symbology Metadata

• Producers / Contributors – DoD MWG– Fed Geospatial MWG

Helpful Resource:

Norman C. AndersenMetadata Standards Officer, NCGISNational Geospatial-Intelligence AgencyMail Stop P-10612310 Sunrise Valley DriveReston, VA 20191Phone: 703-814-4565Fax: [email protected]

Page 11: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

11

A N

et-Cen

tric AF

SA

F/X

CX

A

References to DoD COI Forum

----- Original Message -----

From: Bryan J. Aucoin

To: Brand Niemann ; [drm-team]

Cc: Marianne Floyd-Y- ; Stephen Selwyn

Sent: Wednesday, January 18, 2006 6:18 PM

Subject: Re: [drm-team] TIME SENSITIVE: DoD COI Forum, Thursday, January 19th, at MITRE (also remote access)Just an FYI, Brand.

The IC EA CoP is not an intended as open forum.  Many of our presenters brief with the implicit understanding that the documents will not be released outside of the Community without prior permission.  Most agencies within the Community have policy around this sort of "unofficial release".  Please coordinate these request through Marianne.

Brand Niemann wrote:See http://colab.cim3.net/file/work/SICoP/DoDCoI/  for presentation files and see Reminder below. BrandP.S. I am still working on getting the files for the January 12th IC EA CoP Meeting. REMINDER:  The next COI Forum is:   Date :       January 19, 2006, Time :       08:00 Registration, Duration : 08:30 - 12:30 Forum Location : MITRE 1                      Auditorium             7525 Colshire Drive             McLean, VA  22102-7508 NOTE, THIS IS A CHANGE:   Please park in either the West Parking or East Parking lot, as indicated on the map, and enter through the Conference Center entrance, also indicated on the map. Directions:  http://www.mitre.org/about/locations/pdf/mitre1_map.pdf   Dial in capability:  The local Virginia number is 703-983-1550. A toll free number is 866-648-7367. For any participants calling in from Bedford, MA, the local number is 781-271-6338. The caller will be asked for a meeting ID number, which is "2665". There will be several other prompts that should be self-explanatory to get connected. Please initiate your call at 0810, to ensure that the phone conference is set and solid before the session begins at 0830.   If you require assistance, please contact Harry Wickes at 703-983-2665 (office), 202-352-7101 (mobile) or E-mail [email protected] Agenda8 Registration8:30 Opening & Introductions8:40 C2 Space Situation Awareness (SSA) COI9:25 Role of Net-Centricity in Space C2 Weapon System10:10 Network Break10:40 Where is Your Welcome Sign11:10 COI Lessons Learned11:40 COI Gallery & DoD Metadata registry12:25 Announcements12:30 Closing/Remarks_________________________________________________________________

Message Archives:

http://cosine.cim3.net/forum/drm-team/

Shared Files: http://cosine.cim3.net/file/work/DRM/

Community Portal: http://cosine.cim3.net/

To Post: mailto:[email protected]

Community Wiki: http://cosine.cim3.net/wiki/

Page 12: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

12

A N

et-Cen

tric AF

SA

F/X

CX

A

Reference Links

The DoD Net-Centric Data Strategy http://www.defenselink.mil/nii/org/cio/doc/Net-Centric-Data-Strategy-2003-05-

092.pdf

Data Sharing in a Net-Centric DoD, DODD 8320.2 http://www.dtic.mil/whs/directives/corres/html/83202.htm

DoD Discovery Metadata Specification (DDMS)http://metadata.DoD.mil/

DDMS Schema informationhttp://diides.ncr.disa.mil/mdreg/user/DDMS.cfm

COI Directoryhttps://gesportal.dod.mil/sites/coidirectory

Page 13: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

13

A N

et-Cen

tric AF

SA

F/X

CX

A

Template for the ISR COI Charter

Charter for the Intelligence, Surveillance, and Reconnaissance (ISR)

Under the

………

1. PURPOSE

1.1Charter. The purpose of this charter is to establish the Intelligence, Surveillance, and Reconnaissance (ISR) as a community of interest under the …...

1.2ISR COI .

2. SCOPE

3. MISSION

4. REFERENCES

5. ORGANIZATION

7. PROCEDURES

Approval Authority:

Signature

……

Page 14: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

14

A N

et-Cen

tric AF

SA

F/X

CX

A

References to Upcoming Taxonomy Training

From:Talcott Marilyn Civ SAF/XCXPJSent:Mon 2/13/2006 1:39 PMT

Our next Taxonomy Training Session will be held on 1 and 2 March at the Sumaria facility in O'Fallon Illinois (1728 Corporate Crossing, Suite # 1).  Cost for the training session will be $420.00.  This is a slight increase from the previous session due to the change in location.  If you or your designed reps are interested in attending this class please provide the following info:

Name:

Organization:

Phone Number:

Email Address:

Purpose for Attending:  (short explanation of why you desire to attend and/or require this training) Please email your info to Mr Matt Brady at: [email protected]   by COB 21 February.  The class is limited to 16 attendees--we will notify selected attendees by COB 22 February.

For your planning purposes--We intend to offer a Taxonomy Training Session At Wright Patterson AFB on 14 and 15 March.

Thanks Marilyn A. Talcott, GS-14, DAF

Federal Govt & DoD Liaison Officer SAF/XCXPJ (703) 696-6278

Page 15: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

15

A N

et-Cen

tric AF

SA

F/X

CX

A

Vocabulary Style Guide - Resources

• The C2 SSA COI Steering Committee Chair (Gen Shackelford) approved/signed the first installement of the C2 SSA Vocabulary.  The signed memo and vocabulary products can be found via this URL:

• https://afkm.wpafb.af.mil/ASPs/docman/DOCMain.asp?Tab=0&FolderID=OO-OT-SP-03-2-5&Filter=OO-OT-SP-03

• or manually

• /Data Management Working Group/C2 SSA Vocabulary   (This path contains the C2 SSA Vocabulary Guide and the C2 SSA COI Memo)

• /Data Management Working Group/C2 SSA Vocabulary/C2 SSA Model   (This path contains the XML schemas and sample XML instance documents)

• If you encounter problems finding the vocabulary products please don't hesitate to call and I will help you.

• Thank You

• Mark Pleimann (719) 572-8244

• Click the following URL to reply to the message/view previous messages: https://afkm.wpafb.af.mil/ASPs/MailList/MailView.asp?Filter=OO-OT-SP-03&MsgIndex=4694

• or via the AF Portal: https://rso.my.af.mil/afknprod/ASPs/MailList/MailView.asp?Filter=OO-OT-SP-03&MsgIndex=4694

Page 16: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

16

A N

et-Cen

tric AF

SA

F/X

CX

A

Vocabulary Style Guide – Current Work Underway

• Ladies and Gentlemen,

• HQ AFSPC/A5 respectfully requests your coordination on the Vocabulary Guide and Data Schema Extensions for the Command and Control (C2) Space Situation Awareness (SSA) Community Of Interest (COI).

•1.      PURPOSE:  To conduct a review and coordinate the C2 SSA COI Vocabulary Guide and Data Schema Extensions prior to COI Chair approval, and registration into the DoD Metadata Registry for general use by authorized DoD system owners and users.

• 2.      BACKGROUND:  OSD/NII has sponsored the creation of this COI, chaired by AFSPC/CV, as a venue for programs of record to vet their net-centric requirements, and facilitate the discoverability, availability, and accessibility of C2 SSA data and information.

• 3.      DISCUSSION:  This Vocabulary Guide at Tab 2 and data schema extensions at Tabs 3-6 signifies the first step at standardizing Defense Satellite Communications System (DSCS) link availability data, and Global Positioning System (GPS) Navigational Accuracy Alert Services required to monitor, assess, plan, and execute the operational and tactical commander's intent in a net-centric environment.  Several eXtensible Markup Language (XML) samples are attached at Tabs 7-9, demonstrating how the data schema extensions can be used. 

• Our goal is to have coordination due by 17 Feb 06, and schedule a subsequent comments resolution meeting during the week of 20 Feb 06 to address any concerns or critical comments.  We intend to have AFSPC/CV sign the advocacy letter at Tab 1, formalizing the approval of the Vocabulary Guide and data schema extensions prior to registration into the DoD Metadata Registry.

• 4.      VIEWS OF OTHERS:  None.

• 5.      RECOMMENDATION:  Request coordination and response NLT 17 Feb 06.

// Major Foster, A5 Executive Officer

•    On behalf of //

• MARK D. SHACKELFORD                             9 Tabs:

• Maj Gen, USAF                                           1) C2SSA  Process Memo

• Director of Plans & Requirements                        2) C2 SSA Vocabulary Guide 1-17-06

•                                                         3) C2ssa_schema

•                                                         4) C2ssa_utilities

•                                                         5) C2ssa_dscs_extension

•                                                         6) C2ssa_gps_extension

•                                                         7) sample_c2ssa_dscs_big_report

•                                                         8) sample_c2ssa_gps

•                                                         9) sample_c2ssa_sat_status

•<<Tab 1 - C2SSA process memo.doc>> <<Tab 6 - C2ssa_gps_extension.xsd>> <<Tab 7 - sample_c2ssa_dscs_big_report.xml>> <<Tab 8 - sample_c2ssa_gps.xml>> <<Tab 9 - sample_c2ssa_sat_status.xml>> <<Tab 3 - C2ssa_schema.xsd>> <<Tab 4 - C2ssa_utilities.xsd>> <<Tab 2 - C2 SSA Vocabulary Guide 1-17-06.doc>> <<Tab 5 - C2ssa_dscs_extension.xsd>> <<SSS - C2 SSA COI Vocab & Schema Coord.xfdl>>

Page 17: 2005 02 14 C2 Isr Coi Brief   Ak Maitra

17

A N

et-Cen

tric AF

SA

F/X

CX

A

Thank You