21
Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards and Technology

Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Embed Size (px)

DESCRIPTION

Manufacturing Systems Integration Division Who We Are US/DoC/NIST/MEL/MSID US Department of Commerce National Institute of Standards and Technology Manufacturing Engineering Laboratory Manufacturing Systems Integration Division (MSID)

Citation preview

Page 1: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Development Process and Testing Tools for Content Standards

Simon FrechetteNational Institute of Standards and Technology

Page 2: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Outline

• Who We Are• Process For Developing Content Standards:

The Model Development Life Cycle (MDLC)• Overview of NIST XML-Related Testing

Tools

Page 3: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Who We AreUS/DoC/NIST/MEL/MSID

• US Department of Commerce• National Institute of Standards and

Technology• Manufacturing Engineering Laboratory• Manufacturing Systems Integration

Division (MSID)

Page 4: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

ManufacturingB2B

Integration

ManufacturingMetrology

Interoperability(Inspection)

ProcessPlant

ConstructionInformationIntegration

IntegratedCircuit

Design and Manufacturing

ComponentValidation

Semantic Web R&D

“Generic” Testing Infrastructure and Tool Development(e.g., XML, ebXML, schema quality, test case generation)

Legacy MigrationThrough

Semantic Mapping

Automotive InventoryVisibility

CAD/CAMIntegration

SimulationSystem

Integration

NIST Interoperability Testbed

Page 5: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Some Specific Problems in Model Development

• Unbounded specification growth• Semantically duplicate terms, components, and

documents are created• Poor documentation reduces reuse• Classic interoperability problems are revisited• Large-scale harmonization (using a

common/canonical model) is hard to achieve

Page 6: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Content Standards are Bridges

• Design the bridge• Test the design • Build the foundation• Assemble the structure• Test the bridge• Many components are

generic• Many standards are used

Building Process:

Page 7: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Model Development Life Cycle

A guideline for building industrial strength data exchange bridges, that provides

• Detailed analysis of the development process for content standards

• Architecture for implementing that process• Outline of requirements for tools• Roadmap to the standards landscape

Page 8: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Model Development Life Cycle

Page 9: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Decomposition of the Model Development Life Cycle Existing Schemas & Classification Scheme

A2

Model Validation

A3

Model Piloting

A4

ModelRegistration

A1

Model Discovery

A5

Model Integration

Specification Tools

RuleBased

Engines

Specification

Design Rules

Specification Reference

Data

Implementation Data

BusinessRules

ImplementationContext

Guidelines

Schematron XSLTEngine

AnnotationTools

Test Suites

ImplementationDocumentation

ExternalOntologies

ClassificationAssistant

SemanticSimilarityMeasure

SemanticAlignmentAlgorithm

ExternalOntologies

Registry &Repository

QualifiedSchemas

DataExchange

Requirements

BusinessForms

ChangeRequests

Link Annotations

Change Requests

TableOf

Terms

Existing Schemas

Registry Entry

ClassificationScheme

NewSpecifications

Semantic AwareLookup Assistant

Requirement Gaps

Discovered Schema

Spreadsheet

AnnotationTools

Schema Semantics

ExistingData

Page 10: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Model Validation

A2.1

SchemaQualification

A2.2

Data CoverageAnalysis

A2.3

SchemaCompatibility

Analysis

NamingGuidlines

DesignRules

RuleBasedEngine

NamingAssistant

Table of Terms

XML InstanceEditing Tool

XMLValidation

Tools

XML InstanceReference Data

XML Schema

ExistingData

BusinessForms

DataExchange

Requirements

Qualified Schemas

XML SchemaSpecification

XMLValidation

Tools

Spreadsheet

Change Requests

Revised XML Instance Reference Data

Revised Qualified Schemas

Requirement Gaps

Qualified Schema

Page 11: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Overview of some NIST XML-Related Testing Tools

• XML Schema Validation Tool• XML Instance Validation Tool• Quality of Design Tool• Content Validation and Testing System• XML Schema Naming Assister• Schematron Editor Tool• Classification Assistant (Research)• Semantic-Aware Lookup Assistant (Research)• Semantic Alignment Tool (Research)

Page 12: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

XML Schema Validation Tool

• Objective: Ensure that schemas are compatible with a selected set of parsers

• Core Functionality: Validate one or more schemas or schema extensions with multiple selected parsers and schema files stored in a repository

• Status: Prototype available at http://www.nist.gov/msid/validation

Page 13: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Page 14: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

XML Instance Validation Tool

• Objective: Ensure that schemas are compatible with a selected set of parsers, a set of sample data, a previous set of sample data (when the schemas have gone through changes)

• Core Functionality: Automatically validate one or more instance files against associated schemas with multiple selected parsers (in batch mode)

• Status: Prototype is available at http://www.nist.gov/msid/validation

Page 15: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Quality of Design (QOD) Tool

• Objective: Ensure that XML schemas conform to a selected set of design practices, e.g., use of common and valid terms, NDR conformance, use of the XML Schema structures that enhance reusability, maintainability, clarity, and interoperability

• Core Functionality: A flexible environment for specifying and executing best practice rules against the schemas

• Status: Beta – Available upon request. Contact Serm Kulvatunyou: [email protected]

Page 16: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Page 17: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Content Validation and Testing System(CVTS)

• Objective: Capture, codify, and execute business rules that are not captured in the XML Schema.

• Core Functionality: Store, publish, and execute business rules for checking instance data for conformance with those rules.

• Status: on-line at http://syseng.nist.gov/b2bTestbed/projects/semanticChecking

Page 18: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

XML Schema Naming Assister

• Objective: Ensure that type, element, and attribute names used in schemas are consistent within the schema and conform to ISO 11179 Naming Convention

• Core Functionality: Decompose names into Object Class, Property, and Representation Term tokens, validate them using a table of terms, and suggest alternate names

• Status: Prototype. Available at http://www.nist.gov/msid/Naming_Assister.html

Page 19: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Schematron Editor Tool

• Objective: Assist a user in creating Schematron Rules

• Core Functionality: Create Schematron with little or no knowledge of XPATH/XSLT syntax through expression wizards that allow drag-n-drop elements from an imported XML schema business document

• Status: Prototype – available on Sourceforge site http://www.sf.net/projects/cs-wizard

Page 20: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Summary

• MDLC is a recipe for building robust data exchange specifications

• It drives development of tools and capabilities– Examples include Validation Service and

Quality of Design tools• Maximizes reuse of tools to serve a diverse

collection of customers

Page 21: Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards

Manufacturing Systems Integration Division

Contacts

• Simon Frechette – [email protected]• KC Morris – [email protected] • Serm Kulvatunyou – [email protected]• Josh Lubell – [email protected]• Puja Goyal – [email protected]

Publications

• Morris, KC , Kulvatunyou, Boonserm, Frechette, Simon , Lubell, Joshua , Goyal, P. , XML Schema Validation Process for CORE.GOV, NISTIR 7187, (2004)