Virtual Slicer: Development of Interactive Visualizer for Tomographic MedicalImages based on Position and Orientation of Handheld Device

Sho Shimamura∗, Motoko Kanegae∗, Yuji Uema†, Masahiko Inami†, Tetsu Hayashida‡, Hideo Saito∗ and Maki Sugimoto∗∗Graduate School of Science and Technology, Keio University, Yokohama, Japan

Email: shimamura@hvrl.ics.keio.ac.jp†Graduate School of Media Design, Keio University, Yokohama, Japan

‡Department of Surgery, School of Medicine, Keio University, Shinanomachi, Japan

Abstract—This paper proposes an interface that helps under-standing the correspondence between the patient and medicalimages. In our proposed method, we have developed aninteractive visualizer for tomographic images based on therelative position and orientation of the handheld device andthe patient.

Keywords-tomographic image, medical image, handheld de-vice, image presentation technique, interface

I. INTRODUCTIONSurgeons determine the extent of resection by using to-

mographic images like MRI(Magnetic Resonance Imaging).However, understanding the relationship between the patientand tomographic images is difficult. And therefore, variousresearchers have developed presentation methods that is easyto understand the relationship.[1][2]

II. CONCEPTIn this paper, we propose an interactive visualizer for

medical images based on relative position and orientation ofthe handheld device and the patient. Our proposed methodattaches a liner laser pointer to the handheld device. Whenyou move the handheld device on to the patient, it displaysthe tomography image that corresponds to the sites that isirradiated with liner laser. (Fig. 1)

Figure 1. Concept Image

III. SYSTEM CONFIGURATIONThis system consists of a handheld device(iPad), reference

marker, 3D position tracking device(Optitrack) and a laptop

Figure 2. System Configuration

Figure 3. Virtual Slicer

PC that transmits state information of the tracker.(Fig. 2)Optical marker is attached to the handheld device. Then, thismarker and reference marker are tracked by the 3D positiontracking device. And the state information is sent by usingVRPN transmission.

IV. CONCLUSIONThis paper proposed an interactive visualizer for tomo-

graphic medical images based on the relationship of hand-held device and reference marker.

REFERENCES[1] L. Schwarz, A. Bigdelou, and N. Navab. Learning gestures

for customizable human-computer interaction in the operatingroom. Medical Image Computing and Computer-AssistedIntervention–MICCAI 2011, pages 129–136, 2011.

[2] H. Liao, T. Inomata, I. Sakuma, and T. Dohi. 3-d augmentedreality for mri-guided surgery using integral videography au-tostereoscopic image overlay. Biomedical Engineering, IEEETransactions on, 57(6):1476–1486, 2010.

2013 International Conference on Cyberworlds

978-1-4799-2245-1/13 $31.00 © 2013 IEEE

DOI 10.1109/CW.2013.55

383