Current activity - Asia Pacific Advanced Network6 Telemedicine System Joint Experiment using the MPEG4 Scalable Video CODEC Objectives: • Development of base technology of telemedicine

1

Current activity

Faculty of MedicineChulalongkorn University

King Chulalongkorn Memorial Hospital Thailand

22nd APAN Meeting Singapore 19th July 2006

Pornarong Chotiwan [email protected]

Chakaphan SookcharoenChidapha Adul-Tanagan

Computer Unit Faculty of Medicine

Chulalongkorn UniversityThailand

2

History

The Faculty of Medicine. Chulalongkorn Universityhas been founded in keeping with the wishes of H.M. King Anandhamahidol to see the University of Medical Sciences produce more doctors so as to provide betterhealth care for his people.

Acting on H.M. the King's wish, the govemment allocated a sum of money for expanding medical education. A second medical school was then established in King Chulalongkorn Memorial Hospital, the Thai Red Cross Society.

Inpursuance of a royal decree, the Faculty of Medicine was established April 22, 1947 and was officially opened on June 11, 1947

On October 1, 1967 the school was transferred to ChulalongkornUniversity and renamed as " Faculty of Medicine, ChulalongkornUniversity.

Research Projects utilizing JGN2 Asian Circuits

Panasonic, NTT Com, Asahikawa Medical College

JPExperiment of Telemedicine in Ophthalmology based 3D-HD and Broadband Network

2

Chulalongkorn Univ.TH

Singapore National Eye CenterSG

Chulalongkorn Univ.TH

NTT Com, NTT lab,Kyushu Univ., Univ. of Tokyo

JPTelemedicine System Joint Experiment using the MPEG4 Scalable Video CODEC

1

NECTEC,Thammasat Univ.(SIIT), Chulalongkorn Univ.

TH

NTT Com, IBM Japan,Mitaka-city,Osaka Univ., Univ. of Hyogo, Waseda Univ.

JPIPv6 Distance Learning Joint Experiment3

SG

Member Organizations

IDA,Catholic High School

Research Project

3

Structure of Cooperation

Chulalongkorn Univ. Kyushu Univ.

NTTCom(Thai) NTT-Lab / NTTCom*Prime Coordinator

Coordination

Thailand Japan

Support(Network Survey / System Integrate)

Joint Experiment

MICT/NECTEC Ministry Of Internal Affairs and Communication (MIC)

NICT

Telemedicine Joint Experiment Chulalongkorn Univ. (Thai) ／Kyushu Univ. (Japan)

4

The Review of Telemedicine Joint Experiment 2005

(Round 1) Nov.25, 2005 Basic Experiment (Teleconference)　　(Round 2) Dec.22, 2005 Training Box Tele-mentoring(Round 3) Jan 30-31, 2006 Robotic Tele-Surgery trial and

International Workshop

1. Established strong relationship between Chulalongkorn U. and Kyushu U.

2. Confirmed the effectiveness of Tele-mentoring3. Success of robotic Tele-surgery

The outcome....

*Challenges for the experiment this year-- The improvement of the video quality- Continuous discussion of the training program between the universities

Experiment Network

Japan

ThailandATM45Mbps

ThaiSARN

JGN2

UniNET

Kyushu University

Chulalongkorn University

5

1. Tele-mentoring using the “Training Box” for endoscopic surgery2. Tele-mentoring using the “VR-Simulator” for endoscopic surgery　　　　

(If possible)3. Endoscopic surgery training using cadaver

※We will try to take more time to discuss the training plans during the experiment period (e.g. tele-conference once a month).

The Plan for Telemedicine Joint Experiment 2006(Detail discussion on 28th July 06 by VCS)

Experiment Plans

“Training Box” training

“VR Simulator” training

Schedule (Draft)

★★▲ ★Meetings

　　▲Cadaver operation

　　　　▲　　▲　　▲VR Simulator

　　▲　　▲　　▲Training Box

Implementationof experimentalplatform

NovSep

　

JulyMay

2007

Apr

2006

　　　　

Evaluationand Reporting

Coordination withboth parties(Japan/Thailand)

MarFebJanDecOctAugJune

Site survey / System design

Installation/ Test

※Remarks: This joint experiment is planned to continue till 2007. However, the detailed plans of yearly experiment is decided at the beginning of each fiscal year by MIC.

Feedback

Delegation from Japan

Teleconf.#1

Teleconf.#2 Teleconf. as needed

6

Telemedicine System Joint Experiment using the MPEG4 Scalable Video CODEC

Objectives:• Development of base technology of telemedicine on broadband network• Demonstration of tele-instruction between Japan and Thailand• Technology to construct next-generation IP network based on IPv6

Technologies used in this experiment:• Sharing of medical images by utilizing MPEG4 scalable CODEC• Real-time operation performance via low latency MPEG-2 CODEC system• Bi-directional real time video communication

Demonstration of remote robotics surgery:• Jan 30, 2006• Maser-Slave type surgical robot developed by Univ. of Tokyo• Sature/Removal demonstration with Live-Tissue

　　Lecture RoomFlet’s Phone Flet’s Phone

ROBOTROBOT(Master)(Master)

ROBOTROBOT(Slave)(Slave)

Camera(backup)

MPEG4 Decoder

Whole imageOf class

Surgeon

EndoscopeCamera

EndoscopicImage

(for Surgeon)Endoscopic

Image(for participants)

MPEG2Encoder

MPEG4 Encoder

Back up（single channel）

alternative

Image ofOperation

Camera(operation)

EndoscopicImage

(backup)

MPEG2 Decoder

MPEG2Decoder

Camera(assistant)

RobotEndoscope

Camera

Image ofSlave Robot(for surgeon)

SwitcherMPEG2 LL Encoder

Image ofSlave Robot

(for participants)

MPEG2 LL Decoder

MPEG2Encoder

MPEG4 Enc/Dec

Chulalongkorn Univ. Kyushu Univ.

(voice)

ThaiRENJGN2

AsiaBB NW

6Mbps

MPEG4 Scalable(3 - 10Mbps)

6Mbps

6 - 4Mbps

6Mbps; 180ms delay4mbps; 140ms delay

< 1Mbps

0.5 - 1Mbps


7

Kyushu UniversityChulalongkorn University

ROBOT(Master)

ROBOT(Slave)

JGN2Asia Network



Chulalongkorn Univ.Kyushu Univ.

Image from Japan: environment

Image from Japan: Endoscope

Live-Tissue on operating table

Slave Robot

ParticipantsSurgeon

(Dr. Hashizume)

Master Robot45inch display or participants

8

Experiment of Distant MedicineUsing ROI

Chulalongkorn Univ. (Thai) ／Asahikawa Medical Univ. (Japan)

Experiment of Telemedicine in Ophthalmology based 3D-HD and Broadband Network

Objectives:• This experiment aims at evaluation of the network and services in

ophthalmologic telemedicine utilizing the technologies of 3D-HD and broadband network.

Outline of the experiment:• Evaluation of telemedicine by high-definition surgery image transmission.

Through the broadband network, high-definition surgery image (ophthalmology) will be transmitted from Japan to Singapore at real-time. At the same time, a conference will be set to evaluate theeffectiveness of the usage of the transmitted high-definition image.

• Evaluation of the interaction of ROI (Region of Interest) and 3D-HD over the telemedicine platform.By using the ROI platform, SD (normal size) images converted from HD

images is shared among the medical agencies between Thailand andJapan.

9


ThailandThailand

SingaporeSingaporeJapanJapan

NTSC

Joy stick

ROI Platform

3D-HDencode / distribute

server

Operation room

HD

HD

Conference image for Remote diagnostics

H.264IPVC

DLP Projector 3D-HD Player

Asahikawa Medical College

ROI Image

H.264IPVC

Conference image forRemote diagnostics

3D-HD Player

DLP Projector

DLP Projector 3D Screen

3D GlassH.264IPVC

Asia BroadbandAsia BroadbandNetworkNetwork

3D-HD camera systemfor surgery

APAP

SingARENAPAP

APAP

ThaiSarn　　　　/Uninet

APAP Access Point

3D-HD Link :1Link (50Mbps)IP-Video Conference

:1Link (2Mbps)ROI platform :1Link (6Mbps)

Asahikawa Medical College HospitalTelemedicine Center

3D-HD camera system for surgeryMicroscopic HD

camera head

ROI control PC

Singapore National Eye Center

Chulalongkorn University & HospitalDepartment of Ophthalmology

Joy stick

ROI Platform

ROI control PC

Conference image forRemote diagnostics


Experiment between Thailand and Japan:(1) Mar 1, 2006(2) Mar 2, 2006

ROI Image (left), Operation room (right)(Mar 1, 2006)

Venue inAsahikawa

Medical College(Mar 1, 2006)

Venue in Chulalongkorn

University(Mar 1, 2006)

10

11

Documents

Current activity - Asia Pacific Advanced Network6 Telemedicine System Joint Experiment using the MPEG4 Scalable Video CODEC Objectives: • Development of base technology of telemedicine