Standards Based Fusion: Driving Interoperability for Improved …usgif.org/system/uploads/1246/original/OGC_ETS_best... · 2010-05-26 · observations and/or objects Provide sensor

Standards Based Fusion:Driving Interoperability for

Improved Situational Awareness and Decision Making

Mark [email protected]

+1 301 840-1361

Copyright © 2010, Open Geospatial Consortium

mailto:[email protected]�

Helping the World to CommunicateGeographically

Source: http://www.oddee.com/item_96559.aspx

© 2010 Open Geospatial Consortium, Inc..

OGC’s Fundamental Goal -- Interoperability

• You know when you don’t have it:– Custom Integration

– High lifecycle costs

– Difficult to rapidly mobilize new capabilities

– Duplication of effort

– Missed opportunities for improved decision making

Presenter

Presentation Notes

http://www.oddee.com/item_96559.aspx�




OGC Web Services Standards

Rapid discovery, access, fusion and application of location information for:

•Critical Infrastructure•Emergency Management•Weather Forecasting / Warning•Climate Change•Defense and Intelligence•Local Government Services•Routing / Logistics•And many more applications…



The Common Operational Picture


Web Map Service (WMS) Web Feature Service (WFS)Web Coverage Service (WCS)Catalogue (CSW)Geography Markup Language (GML) KMLOthers…

Core OGC Web Services Standards:


Rapidly Discover, Access, Task, Fuse and Apply Sensor Assets

Sensor Web Enablement

Network Services

OGC Sensor Web Enablement Standards

•Discover sensors and sensor networks•Access sensor observations•Apply in location and time context•Task sensors•Receive alerts and notifications •Rapidly mobilize new / additional sensor assets

Vast set of users and applicationsConstellations of heterogeneous sensors

Enterprise ServicesWeather

ChemicalDetectors

BiologicalDetectors

Sea State

Surveillance

Airborne

Satellite

SensorML Sensor Planning Service Sensor Observation ServiceObservations & Measurements Sensor Alert Service Transducer Markup Language

Catalogue

Presenter

Presentation Notes

In 2007, OGC released a complimentary suite of open standards – Sensor Web Enablement. Collectively these standards enable the rapid discovery, access to and tasking of sensors – both fixed and mobile, and support the fusion of sensor information in a location and time context. OGC SWE Standards are being used in a variety of communities of use from MASINT to ocean monitoring / tsunami warning networks, to the control of NASA / ESA satellites and UAV’s. A complimentary set of stanards have been advanced to work in conjunction with SWE enabled sensor assets to support alerts and notifications of sensor information of interest. SWE standards are designed to make it easier to access, manage and apply feeds from a range of diverse sensor assets in significantly less time and effort than through custom integration. OGC work is now ongoing to advance open standards to make it easier to automate the processing of sensor data “on the fly” for change detection, georegistration, and to make it easier to introduce and leverage new sensor assets withing existing systems and enterprises. Again, many of the OGC Sensor Web Enablement standards have been defined as mandatory or emerging in the Army Geospatial Enterprise Standards Profile.

Helping the World to CommunicateGeographicallyCopyright © 2010, Open Geospatial Consortium

Sensor Web Enablement Community Applications

Ocean Observation

Earth Observation / Satellite OperationsNASA, ESA

Presenter

Presentation Notes

Although the OGC Sensor Web Enablement standards framework was approved by the Consortium membership only recently, SWE standards are already being implemented in several communities of interest. The Oceans monitoring / science community is using SWE standards to ease access to and sharing of buoy information, critical for ocean navigation, tsunami warnings etc. The defense and intelligence community is leveraging SWE standards to improve the ability of various sensors to interoperate.


Open Standards-based Sensor Architecture


http://www.sany-ip.eu/

http://www.sany-ip.eu/�




Open Standards-based Sensor Architecture


SensorML

ObservationsAnd Measurements

SensorPlanning Service

SensorObservation Service

Web ProcessingService

Web MapService

CatalogueServices

KML

Helping the World to CommunicateGeographicallyCopyright © 2009, Open Geospatial Consortium, Inc.

3D Urban Models – OGC CityGML

• Urban Planning• Emergency Mgt / Response• Transportation / Logistics• Retail Site analysis• Sustainable / Green Communities• City Services Management• Noise abatement• Many other uses…

Source: Thomas Kolbe. TU Berlin

Atlanta, GASource: GTA Geoinformatik GmbH


OGC Web Processing Service


WPSGetCapabilities ExecuteDescribeProcess

Algorithms Repository…

…Algorithm 1

Data Handler Repository…

…Data Handler A

Communication over the web using HTTP

WPS-client

Web Processing Service


Standards-based Multi-source Fusion for Actionable Situational Awareness

OGC Web Services Phase 4 Testbed (2006)

Web based integration of geospatial data from multiple distributed sources

Fusion of Building Information Models and other engineered information

Standards-based Decision Support Services available to support Actionable Situational Awareness

Discovery, tasking, access and integration of sensor feeds - fixed and mobile sensors

Presenter

Presentation Notes

____________________________________ The OGC’s Interoperability Program is an essential part of OGC's process to develop and promote the use of OpenGIS® Specifications. In the late 1990’s, OGC the Consortium created the Interoperability Program as an environment for rapid development, testing and prototyping of new standards. This program created a fast paced environment for members to 1) draft potential new standards to address urgent interoperability issues, and apply and demonstrate these draft standards with their technologies in the context of real world user scenarios. Over 30 interoperability initiatives have been successfully completed since 1999, helping to improve the quality and timeliness of OGC standards for use in the global community. Many of OGC’s Web Services Standards were originally developed or were matured through work accomplished in OGC Interoperability Initiatives. Initiatives have directly addressed requirements from many different user communities: Defense and Intelligence, Emergency Management / Response, Oceans Science, Homeland Security, Climate Science, Location Based Services, and others.


Approved OGC Implementation StandardsFreely available at www.opengeospatial.org

• Encodings– Geography Markup Language (GML)– Styled Layer Descriptor (SLD)– Transducer Markup Language (TML)– Sensor Model Language (SensorML)– CityGML– Web Map Context (WMC)– Observations & Measurements (O&M)– Filter Encoding– KML – Symbology Encoding– GML in JPEG 2000– Geographic Objects– GeoXACML

• Web Services Common

• Open Location Services

• Catalogue Services

– Catalogue Service

• Processing Services– Open Location Services (OpenLS)– Coordinate Transformation Service– Sensor Planning Service (SPS)– Web Processing Service (WPS)

• Portrayal Services– Web Map Service

• Data Services– Grid Coverage Service– Simple Features (4)– Web Coverage Service – Web Feature Service

http://www.opengeospatial.org/�

Helping the World to CommunicateGeographicallyCopyright © 2010, Open Geospatial Consortium, Inc.

OGC Alliance Partnerships A Critical Resource for Advancing Standards

… and otherswww.opengeospatial.org/ogc/alliancepartners

Presenter

Presentation Notes

Geospatial interoperability is our mission and our expertise. OGC has alliances with other major standards and professional organizations to assure that geospatial interoperability is consistently addressed across the broader IT community. There is a growing body of internet standards that employ OGC standards (such as OGC Geography Markup Language) to consistently define and address “location” across the internet and wireless.

http://www.opengeospatial.org/ogc/alliancepartners�

A Current Focus Area:

Standards-based Fusion for Improved Decision Making

Copyright © 2010, Open Geospatial Consortium17


• OGC Fusion Standards Study, Phase 1– Sponsored by NGA Innovision– Request for Information (RFI) Issued Summer 2009– Results / Recommendations produced in time to influence OGC

Web Services Phase 7 Testbed (now underway)

• Decision Fusion Standards Study, Phase 2 Underway– Focuses on Decision Fusion (Multi-INT)– Request For Information issued, responses due by 11 June 2010

Fusion Standards Study



• Working definition of Fusion:

“Process of combining data and information to improve detection, identification, and characterization of entities”

• Categories of Fusion– Sensor Fusion– Object/Feature Fusion– Decision Fusion

• “To-Be” fusion environment based on open standards

Fusion Standards Study - Scope

© 2009 Open Geospatial Consortium19


Categories of Fusion



Sensor Fusion


Sensor Observations

Fusion Processes

Objects geometries and signatures

Identify objects using

Identify objects through fusion of observations and/or objects

Provide sensor measurements for fusion processing

Provide recognized objects for use in fusion rule sets

Fusion processes might involve strictly sensor observations, strictly objects, or a combination of observations and objects

Discover and task assets for additional information

Alerts, reports, and archive Alerts, reports, and archive

Alerts, reports, and archive


• Harmonization of the process of precise geolocation

• Online community sanctioned definitions for sensor terms

• Discovery and access of dynamic sensors

• Characterizing and propagating uncertainty of measurements

• Increasing use of geometric and electromagnetic signatures

• Fusion of video from airborne and ground based platforms

• Recognition and characterization of observed objects/features and events

Sensor Fusion Recommendations


Presenter

Presentation Notes

These points are important for sharing and combining data from multiple sources, submitting task requests through common interfaces, and readily support fusion processes.


• Define a conceptual model of feature lifecycle – beyond conflation.

• Standardize metadata for provenance and uncertainty.

• Develop common data models supporting feature fusion.

• Define a portfolio of feature fusion services.

• Develop schema and encodings to support sharing of Track Features

Object/Feature Fusion Recommendations



Feature Lifecycle


Source: Northrop Grumman


Feature Fusion workflow example



• Develop an information model with decisions as a first class object

• Define interfaces and functionality for decision fusion engine component type

• Uncertainty propagation for a “hard fusion” topic

• “See and Talk” collaboration with common view

• Coordination through social networks

• Political Geography as a step to all information types

• Dynamic routing based on location

• Issue separate study focused on decision fusion

Decision Fusion Recommendations



• Use of Open, Community IT Standards

• Semantics mediation of community vocabularies, taxonomies

• Workflow driven by semantics

• Grid and Cloud implementations for performance and access

Architecture and Infrastructure Recommendations



Fusion Standards Study Public Engineering ReportAvailable www.opengeospatial.org/standards/per

• Contents– Fusion Standards Study

Overview– Definition and

Categories of Fusion– Summary of

Recommendations• Sensor Fusion• Object/Feature Fusion• Decision Fusion• Architecture for Fusion


http://portal.opengeospatial.org/files/?artifact_id=36177

http://www.opengeospatial.org/standards/per�

http://portal.opengeospatial.org/files/?artifact_id=36177�




• Development of a use case based evaluation of integrating data and information from multiple intelligence sources. – MLS– Info exchange between analysts and in-the-field forces,– metadata tagging to include life-cycle from collection to update to fusion– Defense and HLS context

• Focus on standards– Review of existing standards regarding fusion; – Survey of standards and implementations with the focus on multi-INT

information sources.

• Consider Mass Market and Mashup Technologies• RFI available, responses due 11 June 2010

Fusion Standards Study, Part 2Decision Fusion


OGC Web Services Initiative, Phase 7 (OWS-7) Summary

David [email protected]

OGC Interoperability ProgramOWS-7 Initiative Lead

© 2010 Open Geospatial Consortium

Presenter

Presentation Notes



OWS-7 Testbed Threads

© 2009 Open Geospatial Consortium, Inc.34


• Threads– SFE (Sensor Fusion Enablement)

• Sensor tracking - Motion video change detection• CCSI toxic sensor interfaces

– FDF (Feature and Decision Fusion)• Data discovery, management and analysis of geo and non-standard information• Information sharing - GML schema automation• Feature & statistical analysis - Geosynchronization

– Aviation• Airfield Information XML - Notifications• Dispatch & flight operations - Weather Information Exchange Model (WXXM)

• Cross-cutting Themes– Event architecture, alerts, and notifications– Web Processing Services (WPS) best practices for profiling– Catalogue for all data sources, sensors, and application schemas

OWS-7 Themes & Threads

© 2010 Open Geospatial Consortium, Inc.35

Presenter

Presentation Notes

ADSD Authoritavie Data Source Directory Enhanced Context Document – using ATOM pub


• Schedule– Call for Sponsors: June 2009– RFQ/CFP issued: October 2009– Kickoff: January 2010– Demonstrations: June 2010

• Deliverables– 39 Components– 15 Engineering Reports and Change Requests

OWS-7 Testbed Statistics



• Haiti Earthquake Disaster– Rapid discovery and analysis of cultural and demographic data, in

combination with base map and damage information, to determine neighborhoods needing priority help

– Using CCSI sensors to detect radiological leaks around damaged hospital

– Geosynchronization of database updates

• Search for IEDs in Urban Environment– Sensor tracking and video capture for change detection, in search of

Improvised Explosive Devices (IEDs)– WPS for change detection in video feed, triggering alerts

• Aviation Response to Weather– Preflight diversion planning and airport status notification– Volcanic eruption and resulting diversions due to ash plume

OWS-7 Demonstration Scenarios

© 2010 Open Geospatial Consortium.37


• U.S. National Geospatial Intelligence Agency (NGA)• U.S. Dept of Defense - Joint Program Executive Office –

Chemical & Biological Defense (JPEO-CBD) • U.S. Federal Aviation Administration (FAA)• EUROCONTROL - The European Organization for the

Safety of Air Navigation• U.S. Army Geospatial Center (AGC)• U.S. Geological Survey (USGS)• U.S. National Aeronautics and Space Administration (NASA)• EADS Defence and Communications Systems (DCS)• BAE Systems• PCI Geomatics, Inc.• Lockheed Martin Corporation

OWS-7 Sponsors


Presenter

Presentation Notes

The issues and requirements for OWS-7 reflects the interests of the organizations listed here Together, these sponsors have invested $1.6 million in cost-sharing funds for OWS-7.


OWS-7 Participants• Alticode • Atmosphere • BIRI • Carbon Project • Compusult • Comsoft • con terra• CubeWerx • Envitia • ERDAS • ESRI • Feng Chia Univ, Taiwan• FortiusOne• Frequentis

• Galdos • George Mason Univ CSISS • iGSI • interactive instruments • Intergraph • lat-lon • LISAsoft • Luciad• Meteo France• Northrop Grumman• Planet9 • Snowflake • UAB-CREAF • Univ Bunderswehr• Univ Muenster IfGI

© 2010 Open Geospatial Consortium.39

Presenter

Presentation Notes

30 organizations responded to this initiative, providing over $4 million of additional contributions in terms of development effort, software, and hardware licenses. Every one of these organizations provided essential parts of the whole.


Sensor Web Enablement in OGC TestbedsStandardization of Chemical, Biological, Radiological, Nuclear

(CBRN) Sensors


From OGC Web Services Testbed Phases 6 and 7

Presenter

Presentation Notes

OGC is also working with organizations to show how OGC open standards can be used to “wrap” proprietary interfaces – resulting in the abilty to connect proprietary systems to open standards based capabilities. Here, OGC is working with the US Joint Program Executive Office for Chemical and Biological Defense to identify a methodology for connecting their proprietary Common Community Sensor Interface (CCSI) to a broader open standards based sensor infrastructure. By allowing CCSI to connect with SWE based sensor assets, significant time and money can be saved in deploying their CBRN systems.


Aeronautical Information Management (AIM)(OGC Web Services Phase 6 Testbed)

• Support vision for AeronauticalInformation Management

– Interconnected systems with many actorsand many users

– Need for real-time information used in flightplanning, navigation, rerouting, etc

– Right information at the right time at the rightplace to the right user

– End-to-end management of information

• Develop and test standards-basedservice-oriented architecture to supportthe provision of aeronautical informationdirectly to flight decks and ElectronicFlight Bags (EFB)

© 2010 Open Geospatial Consortium, Inc.

Presenter

Presentation Notes

For AIM, the objective was to provide relevant aeronautical and weather information directly to flight decks and Electronic Flight Bags via a standards-based service oriented architecture, that can support a vision of future Aeronautical information management where many users need access to the information for flight planning, navigation, and rerouting and where it’s critical that the right information is provided to the right user at the right time at the right place.


NNEW – NextGEN Network Enabled WeatherTAF – Terminal Aerodrome ForecastWXXM – Weather Info. Exchange ModelWFS – OGC Web Feature Service

OWS-6 Aeronautical Information Management Architecture

Presenter

Presentation Notes

The architecture involved the use of OGC Web Feature Service for AIXM (Aeronautical Information XML) data, a couple WFSs for weather data and an Event Service. The aviation client accessed those and integrated the information visually for maximum situational awareness.


OGC Web Services Event Architecture

• OGC Sensor Web Enablement Event Architecture developed as part of OWS-6

• Discussion:– Event Definitions– Roles and Interfaces– Application Schema– Event Enabling OGC Based

Architectures– Related Technologies


www.opengeospatial.org/standards/per

Presenter

Presentation Notes

“An event is anything that happens or is contemplated as happening at an instant or over an interval of time.“

http://www.opengeospatial.org/standards/per�


• Typhoons and earthquakes trigger landslides and flooding on a frequent basis

• OGC services used with an array of spatial data and sensors to provide situational awareness for forecasting, detecting, alerting and response to debris flow situations.

• Rapidly deployed network of debris flow sensors, and distributed services performing sensor data analysis and processing

Debris Flow Monitoring - Taiwan

© 2010 Open Geospatial Consortium

44

Presenter

Presentation Notes

The Geographic Information Systems Research Center at Feng Chia University in Taiwan implemented the WPS Grid profile service to investigate and demonstrate its use as a component of their Debris Flow emergency management system in Taiwan. Because of the mountainous terrain in Taiwan and the frequent and sometimes torrential rainfall events, landslides and flooding are a frequent threat. To aid in monitoring, prediction and alerting when such a rainfall event is possible, the Debris Flow system was developed. It consists of a network of sensors and distributed processing services. The video that follows demonstrates how the WPS-Grid profile service was integrated into this system as a first step in a broader plan to incorporate a variety of OGC standards and services.

Helping the World to CommunicateGeographically© 2009 Open Geospatial Consortium, Inc.

45


Taiwan Debris Flow - OGC System Framework

Rain gauge Observation System

Sensor SOS

GSMaPHourly image

WMS,WFS-T

WPS

GetFeatureInfo[Pixel value

from start to end]

JSONGetObservation JSON

simplejsonrpy2R Etc..

• Validation process• Least Square Fitting processClient

Execute[station,start,end,product]

JSON

GetObservation ADFC

Any Observation System

Sensor

GIS.FCU,Taiwan GEOGrid, AIST, Japan

Presenter

Presentation Notes

This slide shows an OGC system framework being used for Satellite and Field Integration. We have tested an interoperability connection to Rain Gauge SOS from GIS.FCU Taiwan. The GSMaP (Global Rainfall Map) which is a near real-time hourly rainfall map will be accessed via WMS connection from GEO Grid, AIST, Japan. The validation process will be done by WPS.


Debris Flow Monitoring and Forecast Sensor GRID

Grid


Geospatial Interoperability from sensing to decision support

SWE GPW GDS

OGC Web Services

SWE = Sensor Web EnablementGPW = Geo-Processing WorkflowGDS = Geospatial Decision-support Services

Measurements Observations Features Recommendations

48

Surveillance and Reconnaissance

Computer and Communication

Intelligence

Command and Control

Presenter

Presentation Notes

We implement OGC international standard into debris flow monitoring and forecasting Sensor GRID.

Helping the World to CommunicateGeographically© 2010 Open Geospatial Consortium

Thank You

• OGC Technical Committee Meeting– Week of 14 June 2010– Hosted by NOAA, Silver Spring MD– Sensor Web Enablement Domain WG

convenes Tuesday morning– www.opengeospatial.org/event/1006tcagenda

– Contact [email protected] for more information

http://www.opengeospatial.org/event/1006tcagenda�



• OGC Standards– http://www.opengeospatial.org/standards

• Sensor Web Enablement Summary / White Paper– http://www.opengeospatial.org/projects/groups/sensorweb

• OGC SWE Event Architecture Public Engineering Report– http://portal.opengeospatial.org/files/?artifact_id=33347

• Fusion Standards Study Public Engineering Report– http://portal.opengeospatial.org/files/?artifact_id=36177

• Decision Fusion Standards Study / Request for Information– http://www.opengeospatial.org/standards/requests/67

• Uncertainty Markup Language Public Discussion Paper– http://portal.opengeospatial.org/files/?artifact_id=33234

References


http://www.opengeospatial.org/standards�

http://www.opengeospatial.org/projects/groups/sensorweb�



http://www.opengeospatial.org/standards/requests/67�



• OWS-6 Common CBRN Sensor Interface (CCSI) – Sensor Web Enablement Public Engineering Report– http://portal.opengeospatial.org/files/?artifact_id=33355

• OWS-6 Secure Sensor Web Engineering Report– http://portal.opengeospatial.org/files/?artifact_id=34273

• OWS-6 SensorML Profile for Discovery Engineering Report– http://portal.opengeospatial.org/files/?artifact_id=33284

• OWS-6 SWE Information Model Engineering Report– http://portal.opengeospatial.org/files/?artifact_id=34118

References (2)






Documents

Standards Based Fusion: Driving Interoperability for Improved …usgif.org/system/uploads/1246/original/OGC_ETS_best... · 2010-05-26 · observations and/or objects Provide sensor