Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014.01/06/2014 1/6

Dense semantic image segmentation with objects and attributes

Shuai Zheng, Ming-Ming Cheng, Jonathan Warrell, Paul Sturgess, Vibhav Vineet, Carsten Rother*, Philip H. S. Torr

Torr Vision Group, University of Oxford *The Technische Universität Dresden

Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014.01/06/2014 2/6

Traditional Goal• Object class segmentation

• Assigning an object class label to each pixel

Wall

Cabinet

Box

ceiling

Floor

Chair

Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014.01/06/2014 3/6

Our Goal• Segmentation with Objects and Attributes

• Assigning an object class and a set of attribute labels to each pixel

Wall:Wood,Painted,textured

Cabinet:Glossy,shiny,Cube,plastic

Box:cube

ceiling: painted, textured

Floor : pavement, textured, dry, flat

Chair:Wood

Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014.01/06/2014 4/6

Hierarchical Multi-Label Factorial CRF

Input Image Object segmentation

Attrib

utes

Se

gmen

tatio

n

Grid CRF Fully-connected CRF Hierarchical Fully-connected CRF

Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014.01/06/2014 5/6

Hierarchical Joint Inference

Painted attribute segmentation

Object Classes Segmentation

Cotton attributesegmentation

Glossy attributesegmentation

Input Image

Picture

Chair

Floor

Wall

Cotton

Glossy

Painted

Shuai Zheng et al. Dense Semantic Image Segmentation with Objects and Attributes. IEEE CVPR 2014.01/06/2014 6/6

Thank you! Posters P6 16:30-18:30, Thursday, June 26.

http://www.robots.ox.ac.uk/~tvg/