39
GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Embed Size (px)

Citation preview

Page 1: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

GP-based Image Segmentation (GPIS)

withApplications to Biomedical

Image Segmentation

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 2: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Problem statement

(c) Louis Charbonneau and Nawwaf Kharma, 2009

• How do we select an optimal sequence of low-level image operators (& parameters) to get the segmented image?

Page 3: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Segmentation example: cell nuclei

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 4: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 5: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 6: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 7: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 8: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 9: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Model description• We use Cartesian GP:– Primitive operators are clearly defined, their right combination is the problem

– CGP allows for an easy interpretation of the resulting sequence

– Segmentation is a class of problems without one perfect solution; CGP can handle this

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 10: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

System objectives • Effectiveness: segmentation should be correct• Efficiency: The smallest number of operations• Transparency: operation sequences should be easy to understand

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 11: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

System objectives (cont.)• Segmentation should be doable without a priori information (except for training ground truths)• Generality: effective on wide classes of images• Ease of Use: Minimal human intervention

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 12: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 13: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 14: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 15: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Fitness criterion

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 16: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Crossover

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 17: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Mutations (I)

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 18: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Mutations (II)

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 19: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 20: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Data

(c) Louis Charbonneau and Nawwaf Kharma, 2009

1026 images, 512 x 384 pixels

120 images, 340 x 780 pixels

Page 21: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

System settings, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 22: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Pixel segmentation accuracy, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 23: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Cell segmentation accuracy, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 24: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Statistical results, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 25: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Example of evolved program, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 26: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Example of evolved program, database 1

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 27: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

System settings, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 28: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Pixel segmentation accuracy, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 29: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Cell segmentation accuracy, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 30: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Statistical results, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 31: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Example of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 32: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 33: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 34: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Intermediate steps of evolved program, database 2

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 35: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Superimposed input + evolved program

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 36: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

GPIS on other types of images

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Lane detection tree detection

Page 37: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

GPIS on other types of images

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Intra-cellular content of Wright-stained white blood cell images

Page 38: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Conclusion• CGP was able to adapt to the complexity of input images:– A short program was evolved to solve the easy problem – a longer program was evolved to solve the harder problem

• Operator pool can be extended with specialized operators• Injection was a reliable means of maintaining population diversity

(c) Louis Charbonneau and Nawwaf Kharma, 2009

Page 39: GP-based Image Segmentation (GPIS) with Applications to Biomedical Image Segmentation (c) Louis Charbonneau and Nawwaf Kharma, 2009

Conclusion• A training window approach is very effective for operator refinement

• A small but accurate set of ground truths is enough to evolve segmentation algorithms without a priori information on the images

(c) Louis Charbonneau and Nawwaf Kharma, 2009