46
-1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department of Radiation Oncology Massachusetts General Hospital 3D Slicer Training Compendium Tutorial Version 1.0, Jan 27, 2011

-1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

Embed Size (px)

Citation preview

Page 1: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-1-Massachusetts General Hospital National Alliance for Medical Image Computing

Using Plastimatch forLandmark-Based Registration

Nadya Shusharina

Department of Radiation Oncology

Massachusetts General Hospital

3D Slicer Training Compendium

Tutorial Version 1.0, Jan 27, 2011

Page 2: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-2-Massachusetts General Hospital National Alliance for Medical Image Computing

Learning Objective

This tutorial is a step-by-step guide, and includes:

1) Downloading the Plastimatch extension to 3D Slicer

2) Loading the sample images

3) Visualizing the example data

4) Creating fiducial lists

5) Running LANDWARP Landmark deformable registration

6) Advanced Registartion Options

The plastimatch web site is: http://plastimatch.org

Page 3: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-3-Massachusetts General Hospital National Alliance for Medical Image Computing

Prerequisites

This tutorial assumes that you have already downloaded the sample data. You can get the data from here:

http://forge.abcd.harvard.edu/gf/download/frsrelease/85/1596/synthetic_img.zip

Page 4: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-4-Massachusetts General Hospital National Alliance for Medical Image Computing

Part 1: Downloading the Plastimatch Extension

Page 5: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-5-Massachusetts General Hospital National Alliance for Medical Image Computing

(This part of the tutorial might not workcorrectly, pending the Slicer 3.6 release)

Page 6: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-6-Massachusetts General Hospital National Alliance for Medical Image Computing

Start up 3D Slicer

Choose “Extension Manager”from the “View” menu

Page 7: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-7-Massachusetts General Hospital National Alliance for Medical Image Computing

Click “Next”

Page 8: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-8-Massachusetts General Hospital National Alliance for Medical Image Computing

Find the plastimatch plugin,and click “Select”Then, click “Download and Install”

Page 9: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-9-Massachusetts General Hospital National Alliance for Medical Image Computing

The “Status” should become green

Click “Next”

Page 10: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-10-Massachusetts General Hospital National Alliance for Medical Image Computing

Restart 3D Slicer

Page 11: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-11-Massachusetts General Hospital National Alliance for Medical Image Computing

Part 2: Loading the example data

Page 12: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-12-Massachusetts General Hospital National Alliance for Medical Image Computing

Start up 3D Slicer

Page 13: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-13-Massachusetts General Hospital National Alliance for Medical Image Computing

Choose “Add data” from the menu

Page 14: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-14-Massachusetts General Hospital National Alliance for Medical Image Computing

Choose “Add files” in dialog box

Page 15: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-15-Massachusetts General Hospital National Alliance for Medical Image Computing

Select (highlight) example files:fix.mha and mov.mha

Then click “Open”

Page 16: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-16-Massachusetts General Hospital National Alliance for Medical Image Computing

Click “Apply”

Page 17: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-17-Massachusetts General Hospital National Alliance for Medical Image Computing

The images are now loaded

Page 18: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-18-Massachusetts General Hospital National Alliance for Medical Image Computing

Part 3: Visualizing the example data

Page 19: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-19-Massachusetts General Hospital National Alliance for Medical Image Computing

We can now see the alignment of the images. To see it better, we need to increase the viewpoint size.

Click on the layout chooser button

Page 20: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-20-Massachusetts General Hospital National Alliance for Medical Image Computing

Choose “Red slice only”

Page 21: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-21-Massachusetts General Hospital National Alliance for Medical Image Computing

Much better! We want to look at how well the images are aligned before we start

3D Slicer can view a “foreground” (F) and “background” (B) image at the same time. After loading, (F) is set to “None” in all views.

Page 22: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-22-Massachusetts General Hospital National Alliance for Medical Image Computing

Click, and select “fix” as the foreground imageand “mov” as the background.

Page 23: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-23-Massachusetts General Hospital National Alliance for Medical Image Computing

Use the “Manipulate Slice Views” slider to blend between foreground and background

Page 24: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-24-Massachusetts General Hospital National Alliance for Medical Image Computing

We can now see the alignment

of the images.

Page 25: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-25-Massachusetts General Hospital National Alliance for Medical Image Computing

Part 4: Creating Fiducial Lists

Page 26: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-26-Massachusetts General Hospital National Alliance for Medical Image Computing

Choose “Fiducials” from the Modules menu

Page 27: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-27-Massachusetts General Hospital National Alliance for Medical Image Computing

Clic on Fiducial List and Create New FiducialList

Rename it as “fixed”

Repeat one more time to obtain “moving” list

Page 28: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-28-Massachusetts General Hospital National Alliance for Medical Image Computing

Choose “fixed” list.

Slide to the foreground image.

Clic on “Create-and-place” fiducials.

Page 29: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-29-Massachusetts General Hospital National Alliance for Medical Image Computing

Create fiducials by clicking on lattice corners

Page 30: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-30-Massachusetts General Hospital National Alliance for Medical Image Computing

Slide to the background image.

Make “fixed” fiducials invisible.

Page 31: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-31-Massachusetts General Hospital National Alliance for Medical Image Computing

Choose “moving” list.

Create “moving” fiducials IN THE SAME ORDER as“fixed” fiducials.

Page 32: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-32-Massachusetts General Hospital National Alliance for Medical Image Computing

Part 5: Running LANDWARP Landmark deformable registration

Page 33: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-33-Massachusetts General Hospital National Alliance for Medical Image Computing

Go back to the module selector.

Choose “LANDWARP Landmark deformable registartion” from “Plastimatch” section

Page 34: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-34-Massachusetts General Hospital National Alliance for Medical Image Computing

Set “Fixed Volume” to “fix”Set “Moving Volume” to “mov”

Set “Output Volume” to “Create New Volume”

Set “Fixed Fiducials” to “fixed”Set “Moving Fiducials” to“moving”

Use default RBF radius, Stiffness and Default Pixel ValueClick “Apply”

Page 35: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-35-Massachusetts General Hospital National Alliance for Medical Image Computing

Check the status in the status bar

The registration takes 10 to 15 seconds

Page 36: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-36-Massachusetts General Hospital National Alliance for Medical Image Computing

When the registration is complete, the warped image is automatically displayed

Page 37: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-37-Massachusetts General Hospital National Alliance for Medical Image Computing

You have to set the foreground view again to see the registration quality

Your results should look like this.

Page 38: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-38-Massachusetts General Hospital National Alliance for Medical Image Computing

Part 6: Advanced Registartion Options

Page 39: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-39-Massachusetts General Hospital National Alliance for Medical Image Computing

By default, registration does not include regularization of the vector field, i.e. “Stiffness” is set to “0”

But for some images regularization is a need.

Page 40: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-40-Massachusetts General Hospital National Alliance for Medical Image Computing

Go back to File Menu and load images square_fix.mha, square_mov_mha and fiducials square_fixed.fcsv, square_moving.fcsv

Page 41: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-41-Massachusetts General Hospital National Alliance for Medical Image Computing

Blended foreground and background images look like this

You can look at them one at a time by sliding the slice view manipulator

To see fiducials right-click on any of them in the list

Page 42: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-42-Massachusetts General Hospital National Alliance for Medical Image Computing

Result for LANDWARP default settings looks like this

Page 43: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-43-Massachusetts General Hospital National Alliance for Medical Image Computing

Setting “Stiffness” to 0.3 improves the result significantly

Page 44: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-44-Massachusetts General Hospital National Alliance for Medical Image Computing

Increasing the “Stiffness” improves smoothness,

but

Declines accuracy of landmark matching

NOTE THAT

Page 45: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-45-Massachusetts General Hospital National Alliance for Medical Image Computing

Conclusion

Congratulations! You have completed the tutorial.

Please send corrections or suggestions to:

Nadya Shusharina

[email protected]

Or visit the web page at:

http://plastimatch.org

Page 46: -1- Massachusetts General Hospital National Alliance for Medical Image Computing Using Plastimatch for Landmark-Based Registration Nadya Shusharina Department

-46-Massachusetts General Hospital National Alliance for Medical Image Computing

National Alliance for Medical Image ComputingNIH U54EB005149

Acknowledgements

National Institutes of HealthNIH / NCI 6-PO1 CA 21239Federal share of program income earned by MGH on C06CA059267

Progetto Rocca FoundationA collaboration between MIT and Politecnico di Milano