NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Working Group Karen Moe, NASA/ESTO Rob Raskin, NASA/JPL Earth Science Data Systems Working

NATIONAL AERONAUTICSAND SPACE ADMINISTRATION

Technology Infusion Working Group

Karen Moe, NASA/ESTO

Rob Raskin, NASA/JPL

Earth Science Data Systems Working Group Meeting

College Park, MD

November 14 - 16, 2006

NATIONAL AERONAUTICSAND SPACE ADMINISTRATIONESDS Tech Infusion Working Group

2

Agenda

• Mission & Scope• Activities & Accomplishments

– Process & Strategies– Web Services– Semantic Web– Capability Vision

• Breakout Session Agenda• Technology Showcase

– Web Services and Semantic Web Demonstrations


3

Tech Infusion Working Group

• Mission– Enable NASA’s Earth Science community to reach its research,

application, and education goals more quickly and cost effectively through widespread adoption of key emerging information technologies

• Scope– Information technologies that...

• Provide capabilities critical to the ESD mission & vision• Have been substantially developed (TRL6-9) but have not been widely

deployed• Cannot be obtained simply through reuse of mature subsystems or software • May be slow to be adopted because of the unique characteristics of Earth

science (e.g., high data volumes)

• Approach– Improve community understanding of the technology infusion process– Identify barriers and solutions to technology adoption– Use case studies to evaluate effectiveness of infusion processes– Identify and evaluate new and emerging technologies– Develop roadmaps for adoption of key technologies


4

TIWG 2006 Activities

• Maintained 3 active subgroups– Infusion Process and Strategies

• Subgroup lead: Steve Olding

– Web Services• Subgroup lead: Ken Keiser (UAH)

– Semantic Web• Subgroup leads: Rob Raskin (JPL) and Peter Fox (NCAR)

• Conducted weekly telecons– 1st Thursday: Full working group

– 2nd Thursday: Process and Strategies

– 3rd Thursday: Web Services

– 4th Thursday: Semantic Web

• Presented posters at January and July ESIP Federation meetings, Geoinformatics 2006, AGU Joint Assembly, and ESTC 2006

• Held TIWG breakout session at July ESIP Federation meeting


5

Subgroup Activities

• Process and Strategies– Completed infusion process document– Conducted infusion readiness case study (REACT)– Developed infusion readiness assessment

• Web Services– Reviewed OGC Web Coverage Service– Developed web services demonstrations in collaboration with ESIP

Federation Web Services Cluster– Presented web services demos at the July ESIP Federation meeting

• Semantic Web– Reviewed current maturity of semantic web technologies– Developed semantic web roadmap

• Capability Vision– Continued dissemination of the capability vision– Presented the vision at Geoinformatics 2006, AGU Joint Assembly,

ESTC 2006, and July ESIP Federation meetings


Technology InfusionProcess and Strategies Sub-Group


7

Technology Infusion Process Overview

• Summarizes 2005 findings• 3 perspectives on technology

infusion– The innovation development

process– The innovation-decision

process– TIWG infusion process

• Conclusion and Recommendations– Infusion Education– New Technology Awareness– Technical Support– Funding for Infusion– Technology Assessment

Process


8

Innovation Decision Process Model

Socioeconomic characteristics

Personality variablesCommunication behavior

AdoptionCharacteristics of the 'Decision-Making Unit'

Prior Conditions

Perceived Characteristics of

the Innovation

DecisionKnowledge Persuasion ConfirmationImplementation

Communication Channels

Relative advantageCompatibilityComplexityTrialabilityObservability

Previous practiceFelt needs / problemsInnovativenessNorms of the social systems

Rejection

Continued Adoption

Continued Rejection

Later Adoption

Discontinuance

Adapted from: Rogers (1995),”Diffusion of Innovations”

- the means by which a message gets from the source to the receiver-different channels may play different roles in creating awareness and persuading individuals to change their attitude towards the innovation


9

REACT Technology Infusion Case Study

• Rapid Environmental Assessment Composition Tools (REACT)

– Client application - part of the decision support tools being implemented by ACT under a cooperative agreement with NASA

– Provides network centric services (client-to-server and peer-to-peer) for reading, reprojecting, and subsetting geo-spatial satellite imagery

• Infusion case study– Conducted infusion readiness case study

using REACT as an example of a new technology preparing for infusion

– Evaluated infusion readiness using the infusion decision process model

• Developed a self-assessment questionnaire

– Questions designed to elicit preparedness of the technology for infusion

– Based on infusion decision process modelREACT Schedule and Key Deliverables

Year 1: Application Component – a) Req. Gathering, b) Install high end HW/SW to ingest/process/serve data, c) enhance current Fusion server & Decision Support Tool Technology.

Year 2: Application Component – a) Demonstrate widely available internet access to all data levels, b) develop initial Hazardous Algal Bloom product based on satellite/model data in GIS and other compatible formats, c) add new data streams (e.g. NPP VIIRS)

Year 3-5: Application Component – a) Expand to other application areas, geographic areas, and data sources, b) identify and customize architecture to provide additional decision support tools, assist in transition of application to operation.


10

Technology Infusion Readiness Assessment

• Questions– Target users and target user

characteristics• Identifying the prospective users.

– Innovation characteristics• Factors affecting prospective users’

perceptions of the technology.

– Financial• What are the financial implications of

adopting the technology for the prospective user?

– Productization• How much effort is required to take a

technology that is proven in the lab and turn it into a 'product'

– Communication channels• How will we communicate with the

different prospective users?

– Characteristics of the innovation decision

• How will the decision to adopt the innovation be made?


Technology InfusionWeb Services Sub-Group


12

Web Service Chaining Demo

• Goal:– Demonstrate collaborative service “chains” by connecting

together services from many ESIP Federation members

• Example Scenario: – Analyze an Air Quality event

• Demo Participants– GENESIS SciFlo Workflows – Brian Wilson– DataFed – Rudy Husar– BPELPower Workflows – Liping Di, Peisheng Zhao– WIPE/REACT engine – Eric Malaret– OpenDAP / ECHO – Peter Cornillion & Michael Burnett


13

Carbon Cycle

Web Service Chaining Demo

• Success Story– Developed as a collaboration between TIWG and ESIP

Federation Web Services Cluster• Activity organized using the Federation Wiki, WS Cluster telecons,

and TIWG telecons (participants are geographically dispersed)• Nine groups published callable services on the Wiki• Six groups participated in service choreography demos

– Demonstrated service chains for data query & access, visualization, image overlay, and simple data fusion

– Demonstrated interoperability between different types of services: OGC WMS/WCS, SOAP, OpenDAP

• A service chain can combine all three

– Identical Air Quality analysis chains executed by both BPELPower & SciFlo workflow engines

• Two different environments for authoring XML workflow documents]


14

Carbon Cycle

Geographically DistributedParticipants & Services

GENESIS SciFloGeoRegionQuery services

SciFlo workflow engine

DataFedWCS, Render, Aggregate

services

GMU LAITSWMS/WCS, Reprojection,

Reformatting services BPELPower workflow

WIPE from ACTQuery, coverage, mosaicsMSHELL analysis pipelinesUAH

WMS, HDFEOS SubsettingADaM Data Mining

SURA SCOOPSOAP Catalog & Inventory

services for ocean data

Join us at: http://wiki.esipfed.org/index.php/Available_Services


15

Carbon Cycle

Air Quality Scenario

AIRNOW.pmfineWCS

SURF_MET.tempWCS

Render SOAP

Render SOAP

Image

Image

MODIS Imagevia WMS

Overlay ImagesSOAP

FusedImage

Dataflow Combines

5 remote services:- OGC WCS calls (2)- OGC WMS call- SOAP services to

render & overlay

images

Executable by BPELPower

or SciFlo workflow engines


16

Carbon Cycle

Lessons Learned

• Challenges / Lessons Learned– Daunting semantic variation in service interfaces

• Many ways to describe a lat/lon bounding box, etc.

• We leveraged OGC WMS/WCS popularity by creating SOAP services with similar semantics

• Ultimately need standards, taxonomies, & semantic mediation

– Simple, modular XML standards (Microformats) are best• GML is too large & complex for easy use

– Simple, flat service interfaces are more reusable• Complex, deeply hierarchical XML input/output docs. are difficult to

generate correctly & extract information from

• Should hide complexity whenever possible

– Demonstrated service chains were simple, but a good start• More complex analysis & data fusion scenarios will be challenging


17

Carbon Cycle

Web Service Chaining

• On-Going Work– Add domain scenarios from all Federation Application Clusters

• Science Analysis• Real-Time Decision Support

– Publish & call more kinds of services• Subsetting, Aggregation, Geo-Transformations, Re-projection, Data

Fusion, Custom Analysis, Data Mining, Decision Support

– Develop & exploit standard XML Microformats• De facto geo-location standards from Google Earth, Microsoft

Virtual Earth, & GIS world; and science domain standards• Simple microformats agreed upon on-the-fly during collaborations

– Join the growing “Chain Gang”, please . . .• Publish your services on the Wiki (we will call them)• Develop or participate collaboration scenarios


18

Web Services Roadmap

• On-Going Work– Update Web Services Roadmap to reflect experience with the

demonstrations

Tec

hn

olo

gy

Geospatial services established

Open geospatial services proliferate

Production quality geospatial services

Geospatial service catalog established (WSDL,

UDDI)

Common geospatial schema adopted

(GML, ESML)

Standard workflow language infused

(BPEL)

Open geospatial ontology converges

(OWL)

Local processing + data exchange

Basic data tailoring services (data as

service)

Interoperable geospatial services(analysis as service)

Parameter-based product searches and

access

Inte

rop

erab

le

Info

rmat

ion

In

fras

tru

ctu

re

Ass

iste

d

Dis

cove

ry &

M

edia

tio

n

Metadata-driven data fusion (semantic service chaining)

Automatic service mediation

Semantic geospatial search &

access

Common service protocol, description

adopted (SOAP, WSDL)

Cap

abili

tyR

esu

lts

Improved Information

Sharing

Accelerated Research &

System Cost Savings

Increased Collaboration & Interdisciplinary

Science

Increased PI Participation in

Information Production

Increased Data Utilization

Open service protocols established

(HTTP, REST)

Current Near Term Mid Term Long Term

Intelligent Services

Unified security & identity management

(WS-Security, SAML)

Full geospatial logical searches and

access

Open data access established (OpenDAP,

OGC)

Dat

a M

essa

gin

gO

utp

ut

Ou

tco

me


Technology InfusionSemantic Web Sub-Group


20

Semantic Web Activities

• Reviewed current maturity of tools for the Semantic Web

– Ontology languages: RDF, OWL (OWL-Lite, OWL-DL, OWL-Full)

– Ontology editing and visualization: Protege, SWOOP, Medius, Cerebra Construct, SweDE

– Reasoners: Pellet, Racer, Cerebra Server, Medius Knowledge Brokering Suite.

– Knowledge Inference: Thetus– Web Services: OWL-S– Ontology storage: KOWARI,

Sesame– Search Tools: SWOOGLE– Ontologies: SWEET. Upper level

ontology for Earth system science.

• Updated Capability Vision to reflect semantic technologies

• Developed Semantic Web Roadmap– Technologies

– Capabilities

– Results


21

Tec

hn

olo

gy

Geospatial semantic services established

Geospatial semantic services proliferate

Scientific semantic assisted services

SWEET 3.0 with semantic callable interfaces via standard programming

languages

SWEET core 2.0 based on best practices decided from community

Scientific reasoning

Reasoners able to utilize SWEET 4.0

Local processing + data exchange

Basic data tailoring services (data as

service), verification/ validation

Interoperable geospatial services

(analysis as service), explanation

Common vocabulary based product search

and access

Inte

rop

erab

le

Info

rmat

ion

In

fras

tru

ctu

re

Ass

iste

d

Dis

cove

ry &

M

edia

tio

n

Metadata-driven data fusion (semantic

service chaining), trust

Semantic agent-based integration

Semantic agent-based

searches

Geospatial reasoning, OWL-

Time

Cap

ab

ilit

yR

esu

lts

Improved Information

Sharing

Increased Collaboration & Interdisciplinary Science

Acceleration of Knowledge Production

Revolutionizing how science is

done

RDF, OWL, OWL-S


Autonomous scientific inference

Numerical reasoning

Semantic geospatial search & inference, access

SWEET core 1.0 based on GCMD/CF

Vo

cab

ula

ryL

ang

uag

es/

Rea

son

ing

Ou

tpu

tO

utc

om

e

Semantic Web Roadmap


22

Semantic Web: Roadmap Details

SWEET Core 1.0

VSTO, MMI, others

Semantics Proof/Trust

Built into code logic and in the head of the user

Basic semantics (DL,

FOL)

Syntax Explanation/Rules

High degree of semantic

understanding

Intelligent message

routing (SOL)


SWEET core 2.0 + domain and math

plug-in

Standard workflow language (BPEL)

Intelligent algorithm

programming chaining

Competing catalog

schemas

Common semantic service catalog

established

Inference

Earth Science Standards

Workflow

Discovery

SWEET 3.0 + science applications plug-in

Semantic service

chaining, SWSL

XML, RDF OWL-DL, OWL-Full

WSML

Languages OWL-S, SWRL

Enhanced semantic search into search

engines

Automatic knowledge discovery and mining

GCMD, CF, ESML, GML, etc.

Semantic framework for Web Services,

WSMO

PML


Technology InfusionCapability Vision


24

Capability Vision Outreach

• Continue to raise awareness of the Capability Vision

• Improve online availability– PowerPoint and PDF versions– New Flash version created

• Rudy Husar and Erin Robinson

– NASA web sites• DSWG, ESTO, Tech Infusion


25

Capab

Capability Vision Posters

Geoinformatics 2006

AGU Joint Assembly

ESTC 2006

ESIP Federation summer

meeting


26

Extending the Vision

• Leverage the Capability Vision to stimulate interest within the Earth science community in new and emerging technologies

• Provide assessment of current state of technologies to support the top 10 capabilities

– Identify current research and available technologies

– Assess technology maturity

– Identify gaps and opportunities

• Verify alignment with similar technology vision activities (e.g. EOSDIS Evolution)

TIWG Capability Vision

EOSDIS

Evolution


Technology Infusion Breakout Sessions


28

Breakout Session Agenda

Review web services

demo – lesson learned,

recommendations etc.

Updating the roadmap

Review of the Semantic

Web roadmap.

Extending the capability

vision. Assessment of

technology maturity.

What are the hot new and

emerging technologies?

How do we identify and

monitor them?


29

Technology Showcase

• Technology demonstrations on Wednesday afternoon– 2:30 – 3:30 Web services chaining choreography update

• Brian Wilson, Rudy Husar, Liping Di, Eric Malaret

– 3:30 – 3:15 Web service based data mining• Deployment & orchestration of automated workflows at DAAC. Ken

Keiser & Chris Lynnes

– 4:00 – 5:00 Semantic Web• Ontology-supported knowledge discovery in geospatial semantic

web. Liping Di.

• NOESIS an ontology-based semantic search tool & resource aggregator. Rahul Ramachandran & Ken Keiser.

• Ontology collaboration web site. Peter Fox & Rob Raskin.

Documents

NATIONAL AERONAUTICS AND SPACE ADMINISTRATION Technology Infusion Working Group Karen Moe, NASA/ESTO Rob Raskin, NASA/JPL Earth Science Data Systems Working