Visible Light Video Sequences Juergen Thiem, Jan Rorive Sony Business Emmanuel Cordonnier ETIAM...

Preview:

Citation preview

Visible Light Video SequencesVisible Light Video Sequences

Juergen Thiem, Jan RoriveSony Business

Emmanuel CordonnierETIAM

Juergen Thiem, Jan RoriveSony Business

Emmanuel CordonnierETIAM

ApplicationsApplications

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 2

DICOM from X-Ray to VLDICOM from X-Ray to VL

Radiology / Diagnosis Visible image / Therapy

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 3

Main Visible Light ModalitiesMain Visible Light Modalities

MicrosurgeryMicrosurgery

Rigid EndoscopyRigid Endoscopy

Flexible EndoscopyFlexible Endoscopy

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 4

The Current DemandThe Current Demand

• Presentation

• Publication

• Reporting

• Education

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 5

Surgery and Intra Body DiagnosisSurgery and Intra Body Diagnosis

PRE

POST

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 6

In Association with Other ImagesIn Association with Other Images

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 7

From Still Images to Video ClipsFrom Still Images to Video Clips

• Digital video sequences:– Replacing analogue tapes– For post operation reporting– Carefully selected clips

• Archiving on DVD or Server

• Without workflow disturbance

• Associated to report for referring physicians

• Minimizing the retrieval time

– Including sound (environment, comments)

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 8

Today’s VHS SituationToday’s VHS SituationSafe Area

Medical VHS

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 9

Digital Video EvolutionDigital Video EvolutionSafe Area

MPEG, DVD, VCD, DiVXMPEG, DVD, VCD, DiVX

DV

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 10

Emerging Proprietary SolutionsEmerging Proprietary SolutionsSafe Area

MPEG, DVD, VCD, DiVXMPEG, DVD, VCD, DiVX

MPEG

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 11

DICOM PropositionDICOM Proposition

DIC

OM

Netw

ork

Ethernet

DICOM CD

Safe Area

PACS

DICOM WorkstationsDICOM Workstations

HospitalInformation

System<- Worklist

Patientdata

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 12

WEB

RADIOLOGY PACS

ARCHIVE

Workload PACSWorkload PACS

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 13

The Video SignalThe Video Signal• PAL is the analogue TV transmission standard used in

Europe, and throughout many parts of the world. A uncompressed PAL TV (25 f/s) picture produces a massive 216 Mbit/sec bit stream

• The U.S. uses an analogue TV system called NTSC. This system provides less precise color information, and a different frame rate (30 f/s). An uncompressed NTSC signal requires slightly less transmission capacity at 168 Mbit/sec.

• Data rates becomes even higher when one realizes a High Definition TV (HDTV) picture requires a raw bandwidth exceeding 1 Gbit/sec (1000 Mbit/sec).

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 14

MPEG-2MPEG-2

• 1987 Discussion about compression of video• 1988 ISO/IEC Moving Picture Experts Group• 1992 MPEG-2 (TV) and MPEG-3 (HDTV) combined

• 1993 MPEG-2 Main profile defined, compatible with MPEG-1

• 1994 ISO 13818-1 MPEG-2 Systems Definition

• 1997 First interactive Digital Video Broadcast service using MPEG-2

• 1998 Digital Versatile Disk (DVD) using MPEG-2

• 2000 Definition of the DVB Multimedia Home Platform (MHP)

• 2002 Availability of real time MPEG-2 DVD R writers

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 15

Other MPEG standardsOther MPEG standards

• MPEG-1, a standard for storage and retrieval of moving pictures and audio on storage media

• MPEG-2, for digital video

• MPEG-4, for multimedia applications (~DivX)

• MPEG-7, content representation standard for information search

• MPEG-21 to define a multimedia framework

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 16

Why MPEG-2Why MPEG-2

• Open, established standard

• Compatibility to DVD and Networks

• Low cost technology base

• Family inter-operability & flexibility

• Scalable bit rates

• Industry Support…

• and STABLE ?

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 17

MPEG-2 DisseminationMPEG-2 Dissemination

Systems which now use MPEG-2 is extensive and continuously growing:– Digital TV (cable, satellite and terrestrial

broadcast)– Video on Demand– Digital Versatile Disc (DVD)– Personal Computing– Card Payment, test and measurement, etc.

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 18

MPEG-2 CompressionMPEG-2 Compression

• Video compression which is backwards compatible with MPEG-1

• Full-screen interlaced and/or progressive video (for TV and Computer displays)

• Enhanced audio coding (high quality, mono, stereo, and other audio features)

• Transport multiplexing (combining different MPEG streams in a single transmission stream)

• Other services (GUI, interaction, encryption, data transmission, etc)

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 19

MPEG-2 Group of Pictures (GOP)MPEG-2 Group of Pictures (GOP)

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 20

MPEG-2 provides a way to compress the digital video signal to a manageable bit rate.

MPEG-2 CompressionMPEG-2 Compression

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 21

MPEG-2 Levels & ProfilesMPEG-2 Levels & Profiles

• Profile = quality of the video

• Level = resolution of the video

• The basic system is known as Main Profile Main Level (MP@ML) which covers video compression to 1-15 Mbps.

High X XHigh-1440 X X XMain X X X XLow X XLevel/Profile Simple Main SNR Spatial High

High X XHigh-1440 X X XMain X X X XLow X XLevel/Profile Simple Main SNR Spatial High

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 22

MainProfile@MainLevelMainProfile@MainLevelProfile TableProfile Table Level TableLevel Table

CompatibilityCompatibility

720 x 576 x 25 fps (PAL CCIR 601)

352 x 576 x 25 fps (PAL Half-D1)

720 x 480 x 30 fps (NTSC CCIR 601)

352 x 480 x 30 fps (NTSC Half-D1)

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 23

MPEG-2 MP 4:2:0 Image formatMPEG-2 MP 4:2:0 Image format

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 24

DICOM WG13 MPEG2 Work ItemDICOM WG13 MPEG2 Work Item

• Several face to face meetings, mainly in Europe, and t-cons

• Supplement 42: MPEG2 Video Sequence Transfer Syntax

• Supplement 47: Visible Light Video Sequences

• Plan to finalize the supplements end 2003, for balloting early in 2004

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 25

DVD based media exchange profileDVD based media exchange profile

• The DVD writers (~350€) and DVD-R media (~2€) are really accessible

• CD is more and more accepted and used for image distribution and « portable archive »

• DICOM sup 80 will be balloted soon• WG13 proposes to:

– Use the sup 80 format with VL SOP + potential Key Object Selection for « key » sequences

– Add an informative annex suggesting how to create a « dual format » DVD containing the DICOM data and a Video DVD of the acquired / selected sequences for the distribution to the patient / referring physician

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 26

video

DVD

video

DVD

« Dual Format » DICOM / video DVD

« Dual Format » DICOM / video DVD

video

DVD

video

DVD

VIDEO-TSVIDEO-TS

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

directory titles,

overlays

directory titles,

overlays

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

MPEG2 sequenceMPEG2 sequence

DICOM

data

DICOMDIRDICOMDIR

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

Key Object

Selection

DICOM MPEG2 sequence

DICOM MPEG2 sequence

Thiem, Rorive & Cordonnier DICOM 20th Anniversary Conference / Video page 27

ConclusionConclusion

• The demand for digital video recording in Visible Light Imaging is emerging

• DICOM will contribute to harmonize the different products

• MPEG2 MP@ML is the best compromise

• Network transfer and DVD media exchange

• To be adopted in VL in a couple of months

• Could be applicable elsewhere (US…)

Recommended