33
<Insert Picture Here> National ational Information nformation Exchange xchange Model odel NIEM and Rules David Webber – Public Sector NIEM Team, November 2011 NIEM NIEM Test Model Data Deploy Requirements Build Exchange Generate Dictionary XML Exchange Development Model odel

NIEM Overview Rule Ml November 2011

Embed Size (px)

DESCRIPTION

Selection of slides presented on NIEM and Rules at RuleML 2011, Florida.

Citation preview

Page 1: NIEM Overview Rule Ml November 2011

<Insert Picture Here>

NNationalational

IInformationnformation

EExchangexchange

MModelodel

NIEM and Rules

David Webber – Public Sector NIEM Team, November 2011

NIEMNIEMTest Model

Data

Deploy Requirements

Build

Exchange

Generate

Dictionary

XML Exchange Development

MModelodel

Page 2: NIEM Overview Rule Ml November 2011

The following is not intended to outline Oracle general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be

DisclaimerDisclaimer NoticeNotice

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

relied upon in making purchasing decisions.

The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

Slide 2

Page 3: NIEM Overview Rule Ml November 2011

Topic AreasTopic Areas

•• NIEM NIEM –– IntroductionIntroduction

•• Dictionaries and Exchange developmentDictionaries and Exchange development

• Simplifying and accelerating effective exchanges

• Alignment of vocabularies and information components

• Toward a better NIEM – canonical component management

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

•• NIEM and RulesNIEM and Rules

• Short term

• Medium term

• Long term

Page 4: NIEM Overview Rule Ml November 2011

Officially Officially -- What is NIEM?What is NIEM?

Components of NIEM

• Joint DOJ / DHS / HHS program created to promote standardization of information exchange for cross jurisdictional information sharing.

• Provides the tools for enabling interoperability at the data layer within and acrosssystems supporting information sharing, while preserving investments in current technology and optimizing new technology development.

• Going International – Canada, Mexico, EU

Common Language(Data Model Lifecycle)

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Built and governed by the business users at Federal, State, Local, Tribal and Private Sectors

Repeatable, Reusable Process(Exchange Specification Lifecycle)

Page 5: NIEM Overview Rule Ml November 2011

NIEM Governing StructureNIEM Governing Structure

� NIEM’s governing structure is comprised of Federal, State, Local, Tribal and private organizations

� NIEM is managed at an executive level by the Department of Homeland Security (DHS), Department of Justice (DOJ), and Department of Health and Human Services (HHS)

Executive Steering Council

ESCESCESCESC

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Executive Director

Deputy Director

NIEM PMONIEM PMONIEM PMONIEM PMO

NIEM Technical

Architecture Committee

NTACNTACNTACNTAC

NIEM Business

Architecture Committee

NBACNBACNBACNBAC

NIEM Communications &

Outreach Committee

NC&OCNC&OCNC&OCNC&OC

Page 6: NIEM Overview Rule Ml November 2011

Who steers NIEM currently?Who steers NIEM currently?

Founders and Voting Members

• Dept of Justice

• Dept of Homeland Security

• Dept of Health and Human Services

Ex-Officio Members

• Global Justice Information

Sharing Initiative

• Office of Management and Budget

• Program Manager, Information

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Program Manager, Information

Sharing Environment (ISE)

• NASCIO

Partners

• Terrorist Screening Center

• Dept of Defense / Dept of Navy

• Dept of State, Consular Affairs (invited)

Page 7: NIEM Overview Rule Ml November 2011

NIEM Strategic Next StepsNIEM Strategic Next Steps

Increasing NIEM international adoption (Canadian and Mexican cross-border initiatives)

Broadening NIEM state & local implementations (including support through new Homeland Security grants specifications)

Developing enabling standards for NIEM and the Information Sharing Environment (Object Management Group and OASIS engagement)

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

(Object Management Group and OASIS engagement)

Institutionalizing a common privacy & security framework

On-boarding new and strengthening existing NIEM Domains

Expanding governance to support other Federal, State, Local and International agencies

Page 8: NIEM Overview Rule Ml November 2011

The Information Sharing EnvironmentThe Information Sharing Environment

Maximum value of information sharing occurs when:

Right workers share

Right information with

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Right recipients to use at

Right time

Page 9: NIEM Overview Rule Ml November 2011

Information Sharing Stack and RulesInformation Sharing Stack and Rules

Privacy and Policy Automation

Identity and Access

Management

Routing / Process Flow

Business Process,

Enrichment,

Routing Rules

Privacy and Policy

Automation Rules

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Flow

Standardized Metadata

Common Vocabulary

Validation

Rules

Routing Rules

Identity,

Access Control,

Classifications

Rules

Page 10: NIEM Overview Rule Ml November 2011

The NIEM FrameworkThe NIEM Framework

NIEM connects communities of people who share a common need to exchange information in order to advance their missions, and provides a foundation for seamless information exchange between federal, state, local, and tribal agencies. Much more than a data model, NIEM offers an active user community as well as a technical and support framework.

Support FrameworkTechnical FrameworkCommunity

Formal Governance ProcessesFormal Governance Processes Data ModelData ModelTools for Development

and DiscoveryTools for Development

and Discovery

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Formal Governance ProcessesFormal Governance Processes

Online RepositoriesOnline Repositories

Mission-Oriented DomainsMission-Oriented Domains

Self-Managing Domain Stewards

Self-Managing Domain Stewards

Data ModelData Model

XML Design RulesXML Design Rules

Development MethodologyDevelopment Methodology

Predefined Deliverables (IEPD)

Predefined Deliverables (IEPD)

and Discoveryand Discovery

Established Training Program

Established Training Program

Implementation SupportImplementation Support

Help Desk & Knowledge Center

Help Desk & Knowledge Center

Page 11: NIEM Overview Rule Ml November 2011

The NIEM Data ModelThe NIEM Data Model

NIEM’s data model is a set of common, controlled, and

approved XML data structures and definitions vetted through

the Federal, State, Local, Tribal and Private Sectors.

Data elements are organized into core and domain-specific components

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Core components are used by multiple domains and can be described by structure, semantics, and

definition universally

Domain-specific components are

continually updated by subject matter experts that are actual NIEM

participants and industry experts for their particular

domain

NIEM Naming and Design Rules (NDR) specify how each of

these components are defined and utilized

Page 12: NIEM Overview Rule Ml November 2011

Available XML DictionariesAvailable XML Dictionaries

•• NIEM 2.1 dictionariesNIEM 2.1 dictionaries• CBRN dictionary• Emergency dictionary• Family dictionary• Immigration dictionary• Infrastructure dictionary

Available from download site

direct link:

http://sourceforge.net/projects/camprocessor/files

+ includes spreadsheets and sample models

Note: Those marked in bold are model style dictionaries with recursive components.

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Intelligence dictionary• Justice dictionary• Maritime dictionary• Screening dictionary• Trade dictionary• Immigration blueprint• NIEM core dictionary

XML XML XML XML XML XML

Page 13: NIEM Overview Rule Ml November 2011

Understanding the moving partsUnderstanding the moving parts

•• NIEM NIEM

• Information exchanges – transactional

• Business process orientated

• Common schema / dictionary definitions

•• LEXS / GRALEXS / GRA

• Open communications infrastructure

Oracle NIEM resources site: Oracle NIEM resources site:

http://www.oracle.com/goto/niem

LEXS community site: LEXS community site:

http://www.LEXSdev.org

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Open communications infrastructure

• Patterns for message exchanges

•• IEPDs / SDLCIEPDs / SDLC

• IEPD – Information Exchange Package Documentation

• Formal deliverables and documentation needed in support of SDLC (Software Development Life Cycle) processes

http://www.LEXSdev.org

NIEM community site: NIEM community site:

http://www.NIEM.gov• LEXS – Logical Entity eXchange System

• GRA – Global Reference Architecture

Page 14: NIEM Overview Rule Ml November 2011

Reality Reality –– NIEM is still improving…NIEM is still improving…

• Collections of complex XML Schema

• Attempt to marry modelling techniques and XSD Schema syntax

• Verbose components

• Embedded context in names

• Currently facing significant scaling challenges

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Inconsistencies

• Too much manual management

• Slow lifecycles

• Dictionary technology incubating

• Enhanced code lists mechanism incubating

• UML profile is evolving initiative with OMG

Page 15: NIEM Overview Rule Ml November 2011

Development LifecycleDevelopment Lifecycle

Plan the project, establish the process, and identify information exchange business requirements

Selected information exchange is further elaborated to understand and document the business context and data requirements

Associate local objects with types and elements in NIEM. This process is called mapping an exchange content model to NIEM

Scenario Planning

Analyze Requirements

Map & Model

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Create a set of exchange-specific NIEM conformant XML schemas that implement the data model created for the exchange

Prepare and package all related files for this IEPD into a single self‐contained, self-documented, portable archive file

Publish IEPD for search, discovery, and reuse

Build & Validate

Assemble & Document

Publish & Implement

* IEPD – Information Exchange Package Documentation

Page 16: NIEM Overview Rule Ml November 2011

Exchange Delivery LifecycleExchange Delivery Lifecycle

MonitorMonitor

DesignDesign

AuthorAuthor

TestTest

Component Dictionary

Exchange

Templates

XML Samples

Template

Updates

Drag and Drop Designer

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

DeployDeploy

Validated

Templates

XSD Schema

XMI / UML Models

Production

Log Results

Documentation

Page 17: NIEM Overview Rule Ml November 2011

IEPD Components & RequirementsIEPD Components & Requirements

<Exchange_Schema/>

<Extension_Schema/>

<Subset_Schema/>

IEPD IEM

IEPD MPD

NIEM Core NIEM Core Schema(s)Schema(s)

Domain Domain Schema(s)Schema(s)

Main Document

Catalog

Change Log

Sample XML Instance

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

In order to be NIEM-conformant, the IEPD must adhere to:

1. NIEM Conformance Document

2. NIEM Naming and Design Rules (NDR) v1.3

3. NIEM Model Package Description (MPD) Specification v1.0

Page 18: NIEM Overview Rule Ml November 2011

Toward Top Down Exchange AssemblyToward Top Down Exchange Assembly

Canonical XML Components Dictionary1

Component Associations and Couplings2

Exchange Templates and Rules3

Navigation Navigation and Query and Query ToolsTools

Domains Reuse LibraryDomains Reuse Library

Components

XMLXML

User Inserts

Relationship Lookups

Dictionary Collections

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

W3C Schema and Model Representations4

Delivery Control, Messaging, Security5

Implementation Artifacts and Examples6

Automatic Rendering ToolsAutomatic Rendering Tools

Deployment Environments and MiddlewareDeployment Environments and Middleware

TemplateCatalog

Testing Workbench, Rules Engine, Data Samples, Integration ETL

SchemaXML

Models Components

Page 19: NIEM Overview Rule Ml November 2011

Developing domain dictionaries (EIEM)Developing domain dictionaries (EIEM)

• Allows domains to manage their components libraries

• Provides consistency for project development teams

• Sets of NIEM consistent XML exchange components

• Aligned to enterprise data stores

• Optimized for reuse and interoperability

• Save time and effort across the enterprise

• Perennial question for developers – when should I use NIEM

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Perennial question for developers – when should I use NIEM components, and when our own local ones?

• Are there components already available for that purpose?

• Provide formal mechanisms and procedures to share components and collaborate across SDLC process

• Provide external parties consistent data views

*EIEM – Enterprise Information Exchange ModelOpportunities for rules/agents

Page 20: NIEM Overview Rule Ml November 2011

EIEM/BIECEIEM/BIEC

• Business Information Exchange

Components (BIEC)

• NIEM-conforming XML schema data

component definition that meets a

particular recurring business

requirement for an enterprise

• Enterprise Information Exchange

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Enterprise Information Exchange

Model (EIEM)

• NIEM-conforming schemas that define

data components to be reused in

IEPDs developed by an enterprise;

collection of enterprise BIECs

organized into a subset and one or

more extension schemas

Page 21: NIEM Overview Rule Ml November 2011

Vendor Enabled InnovationVendor Enabled Innovation

Controlled

Open

Hybrid

Controlled Model

Architecture

Tools Repository &

Collaboration Environment

Interfaces &

Specifications

Open Tools

ProprietaryTools

Development

NIEM Governance

Vendors

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Open Tools CollaborativeDevelopment

NIEM Users

NIEM Tools Strategy Vision

Community practitioners have relevant, adoptable, and adaptable tools that will improve the

efficiency and effectiveness of NIEM lifecycle processes

Page 22: NIEM Overview Rule Ml November 2011

CAM toolkit and CAMV validation engineCAM toolkit and CAMV validation engine

• Open source solutions – designed to support XML

and industry vocabularies and components for

information exchanges

• Implementing the OASIS Content Assembly

Mechanism (CAM) public standard

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Mechanism (CAM) public standard

• CAMV validation framework and test suite tools

• Development sponsored by Oracle CAM Editor resources site: CAM Editor resources site:

http://www.cameditor.org

Page 23: NIEM Overview Rule Ml November 2011

CAM editor capabilities overviewCAM editor capabilities overview

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Page 24: NIEM Overview Rule Ml November 2011

NIEM and RulesNIEM and Rules

•• NIEM and RulesNIEM and Rules

• Short term

• Immediate short term needs revolve around

specific application areas and provide the

potential for quick wins where rule and agent

technology can be applied directly to information

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

technology can be applied directly to information

exchange data points and uses

• Medium term

• Long term

Page 25: NIEM Overview Rule Ml November 2011

Rule and Context MetadataRule and Context Metadata

• Actions.

• Properties of the access rules and environment.

• Conditions.

– Subject.

– Resource.

– Policy.

• Obligations.

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

– Policy.

Page 26: NIEM Overview Rule Ml November 2011

Content Metadata in NIEMContent Metadata in NIEM

NIEM

• Association

• Data Quality

NIEM

Extensions

• Business Purpose

• Data Type Category

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• Data Quality

• Source

• Data Type Category

• Data Classification

Page 27: NIEM Overview Rule Ml November 2011

Policy Authoring LanguagePolicy Authoring Language

• A mechanism to specify policy rules

in unambiguous terms.

• XML Access Control Markup

Language

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Language (XACML).

• Machine-readable.

• Supports federated and dynamic policies.

Page 28: NIEM Overview Rule Ml November 2011

Florida Sunshine Law 119.07Florida Sunshine Law 119.07

Policy Statement

“Inspection and copying of records;

photographing public records; fees;

exemptions.—

(1)(a) Every person who has custody of a

public record shall permit the record to be

Policy Matrix Analysis

Attributes

Subject

Attributes

Organization:

[Government: State, Local, Executive]

Authorization: [Custodian]

Role: [Public Record Custodian]

Record Type: [Public Record],

Record Use: [Official Business],

Record Role: [Non Exempted]

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

public record shall permit the record to be

inspected and copied by any person desiring

to do so, at any reasonable time, under

reasonable conditions, and under

supervision by the custodian of the public

records.”

Resource

Attributes

Record Role: [Non Exempted]

Approved/Reviewed by Custodian:

Request can be Fulfilled

Request falls within Allotted “Reasonably”

policy.

Actions Transmit, Access, Share

Conditions

Resource Conditions Assertions:

Reasonable time frame (True)

Reasonable Conditions (True),

Under supervision by custodian of public

records (true)

Rule Rule Target = Resource: Public Record

Implementation Guidance and Use Cases

28

Page 29: NIEM Overview Rule Ml November 2011

Policy XACML Policy Rule Statement

Florida

Statutes

A [Subject: Authorization: Custodian]

in [Subject: Organization: Government: State, Local,

Executive]

with [Subject: Organizational Role: Person having custody for

Public Record]

must perform [Action: Transmit, Access, Share]

on [Resource: Public Record]

Florida Sunshine Law 119.07Florida Sunshine Law 119.07

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

Statutes

Section 119.07

(1)(a)

for [Purpose(s): All]

if [Resource: Conditions: Reasonable time frame: Yes,

Reasonable Conditions: Yes,

Under supervision by custodian of public records: Yes]

if [Condition: Rule Target: Resource,

Record Type: Public Record]

and with [Obligations: None].

Effect = PERMIT.

Page 30: NIEM Overview Rule Ml November 2011

NIEM and RulesNIEM and Rules

•• NIEM and RulesNIEM and Rules

• Short term

• Medium term

• In the medium term we can envision adoption of

specific rule and semantic capabilities that

address more complex challenges and

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

address more complex challenges and

information analysis. This may involve

extensions to the existing NIEM information

model to enable new capabilities

• Long term

Page 31: NIEM Overview Rule Ml November 2011

NIEM and RulesNIEM and Rules

•• NIEM and RulesNIEM and Rules

• Short term

• Medium term

• Long term

• Rule technologies can offer advantages for NIEM

with regard to business accuracy, costs and

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

with regard to business accuracy, costs and

timeliness of analysis and consistency of

application of functional processes

• Fundamental challenges in information

processing and reasoning and interpretation

• Healthcare diagnosis, citizen services

Page 32: NIEM Overview Rule Ml November 2011

AcknowledgementsAcknowledgements

• With contributions from RuleML NIEM Panelists:

• Justin Stekervetz – NIEM PMO

• Vijay Mehra – ISE - Standards Portfolio Lead

• James E. Cabral Jr. – IJIS/OASIS and MTGM LLC

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

• James E. Cabral Jr. – IJIS/OASIS and MTGM LLC

Page 33: NIEM Overview Rule Ml November 2011

Q & A

Copyright ©2011, Oracle. All rights reserved. Oracle Draft Materials – Limited Circulation

http://www.niem.gov