22
Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Embed Size (px)

Citation preview

Page 1: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Gazelle Test Bed

Eric Poiseau

IHE Europe Technical Project Manager,

INRIA

Page 2: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Conformance / Interoperability Testing

2

Specifications/Standards

System A

Vendor A

System B

Vendor B

Conformance testing

Interoperability testing

Conformance testing

Page 3: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

VALIDATION TOOLS

Page 4: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Validation tool

• Goal– Verify that messages/documents are

conform with the specifications• Target

– Developers– Testers– Other tools like simulators

• Interface– GUI for users– Web services for tools

Validator

Value SetsInformation

Model

Page 5: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Existing validation tools

• HL7 CDA Structured Document • HL7v2, HL7v3• IHE XD* transactions• Sharing Value Set content• Workflow documents• ATNA audit messages• X509 certificates• SAML Assertions

Page 6: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

6

Gazelle Test Platform

EV

S F

ron

t E

nd

HL7v2/v3 Validator

Dicom Validator

CDA Validator

XD* Validator

XDW Validator1 - HTTP : Upload of document

Standalone Document/Message Validation

2 – WS Call

3 - Report

System under test

Page 7: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Validation Tool Example : CDA Document

• CDA Validation tool for IHE / epSOS / DMP– Link

Page 8: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

CDA Validation report

Page 9: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

SIMULATORS

Page 10: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Simulator Tools

• Goal– Test the interoperability of an application– Simulator is not a reference implementation– Simulator controlled to perform test cases

• Target– Developers – Testers

• Interface – GUI for humans to interact with the tool– Network socket for the protocol tested – Web service to call validation tool, – Dynamic access to coded value set

Page 11: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

11

Simulator Architecture

Gazelle Test Platform

Sim

ula

torConfigure

Interacts

Report

Informationexchange

Validator

Value Sets

Information modelSystem under Test

Page 12: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Example XDS.b Document Source

Page 13: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Existing Simulators

• XD* Suite of simulator– IHE and epSOS

• Order Management– Radiology, Laboratory, Cardiology, Eyecare

• Patient Management• Sharing Value Set• Security (TLS)• …

Page 14: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

TEST MANAGEMENT TOOL

Page 15: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Test Management Platform

• Registration of systems – What to test -> select test plan(s)

• Provide list of test to perform – Conformance testing (test to be executed

before meeting the actual test partners)• Simulators + validators

– Interoperability testing (test to be executed system to system)

Page 16: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

16

Interoperability Testing

ConfigureInteracts

Test Mgt

Tes

t Pla

n

Va

lue

Se

ts

TF

Mo

de

l

Gazelle Test Platform

ConfigureInteracts

System under Test System under Test

Get Test PlanFind Test PartnerLog EvidencesGet Test Report

Get Test PlanFind Test PartnerLog EvidencesGet Test Report

Monitor Checks EvidencesVerifies test performs as plannedGrades

Information exchange

Page 17: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

17

Interoperability + Conformance Testing

ConfigureInteracts

Informationexchange

Test Mgt

Tes

t Pla

n

Va

lue

Se

ts

TF

Mo

de

l

Gazelle Test Platform

ConfigureInteracts

Get Test PlanFind Test PartnerLog EvidencesGet Test Report

Get Test PlanFind Test PartnerLog EvidencesGet Test Report

Monitor Checks EvidencesVerifies test performs as plannedGrades

Proxy

Va

lida

tor

Va

lida

tor

Va

lida

tor

Va

lida

tor

Va

lida

tor

Informationexchange

System under Test System under Test

Page 18: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

EPSOS USE OF GAZELLE

Page 19: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

epSOS

• Use of existing gazelle tools• Configuration of gazelle tools• New gazelle tools

Page 20: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

epSOS

• Used by 17 EU States: – Through epSOS

• AT, CH, CZ, DK, EE, FI, FR, GR, HR, IT, PT, MT, SE, SI, SK, SP, TR

• > 11400 CDA validation request

Page 21: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

GAZELLE FIGURES

Page 22: Gazelle Test Bed Eric Poiseau IHE Europe Technical Project Manager, INRIA

Gazelle in Numbers

• 4 Running instances– USA, Europe, Japan, Korea

• 20 FTE invested• 300 simultaneous users• 500 vendors using it• 541 test cases• 1000 users• 15000 CDA validation • 16000 test instances verified