1
PUBLIC BIG DATA PROCESSING IN ARTWORK ANALYSIS Image processing in the service of painting restoration: Identify paint loss areas caused by aging and deterioration to assist pre-restoration analysis Identify areas of overpaint from previous restorations to assist pre-restoration analysis as well as to automate the reporting process (annotation of overpaint, retouches, fills) Use digital inpainting to fill-in the missing paint to provide a “simulation” for the impact of certain actions to be taken during the physical restoration process VIRTUAL RESTORATION CRADLE REMOVAL a Ghent University, TELIN-IPI-iMinds, Belgium; b Vrije Universiteit Brussel, ETRO-iMinds, Belgium; c Vrije Universiteit Brussel, DWIS, Belgium; d Duke University, Department of Mathematics, Durham, NC, US; d Ghent University, Dept. of Art, Music and Theatre, Belgium; e Royal Flemish Academy of Belgium for Science and the Arts, Brussels, Belgium; f Institute for Cultural Heritage KIK/IRPA, Brussels, Belgium L. Platiša, a B. Cornelis, b,d S. Huang, a A. Fésűs, a J. David, a W. Liao, a T. Ružić, a A. Dooms, c M. Martens, e,f H. Dubois, g B. Devolder, g M. De Mey, f A. Pižurica, a and I. Daubechies d WHAT IS CRADLING? THE PROCESSING STAGES OF PLATYPUS MEET PLATYPUS: A software solution that comes as a standalone application and a Photoshop plugin. It is specifically designed to digitally remove cradling artifacts in X-ray images of paintings on panel. http://project-platypus.net/ *by courtesy of the North Carolina Museum of Art contrast enhanced contrast enhanced contrast enhanced contrast enhanced © Sint Baafskathedraal Gent www.lukasweb.be - Art in Flanders vzw, photo Lukas -Art in Flanders VZW, photo Hugo Maertens The Ghent Altarpiece (open): visual image (top) and X-ray image (bottom) Closed altarpiece: Before (top) and after restoration (bottom) PAINT LOSS DETECTION VIRTUAL INPAINTING SELECTED PUBLICATIONS: Huang et al., Paint Loss Detection in Old Paintings by Sparse Representation Classification, iTWIST 2016. Deligiannis et al., “X-ray image separation via coupled dictionary learning,” IEEE ICIP 2016. Pižurica et al., Digital Image Processing of the Ghent Altarpiece: Supporting the painting's study and conservation treatment, IEEE Signal Proc. Mag., July 2015. Ruzic and Pizurica, Context-aware patch-based image inpainting using Markov random field modeling, IEEE Trans. Image Proc., 2015. Yin et al., "Digital cradle removal in X-ray images of art paintings," IEEE ICIP, 2014.

BIG DATA PROCESSING IN ARTWORK ANALYSIS · Pižuricaet al., Digital Image Processing of the Ghent Altarpiece: Supporting the painting's study and conservation treatment, IEEE Signal

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: BIG DATA PROCESSING IN ARTWORK ANALYSIS · Pižuricaet al., Digital Image Processing of the Ghent Altarpiece: Supporting the painting's study and conservation treatment, IEEE Signal

PUBLIC

BIG DATA PROCESSING IN ARTWORK ANALYSIS

Image processing in the service of painting

restoration:

• Identify paint loss areas caused by aging and deterioration

to assist pre-restoration analysis

• Identify areas of overpaint from previous restorations to

assist pre-restoration analysis as well as to automate the

reporting process (annotation of overpaint, retouches, fills)

• Use digital inpainting to fill-in the missing paint to provide a

“simulation” for the impact of certain actions to be taken

during the physical restoration process

VIRTUAL RESTORATION

CRADLE REMOVAL

aGhent University, TELIN-IPI-iMinds, Belgium;

bVrije Universiteit Brussel, ETRO-iMinds, Belgium;

cVrije Universiteit Brussel, DWIS, Belgium;

dDuke University, Department of Mathematics, Durham, NC, US;

dGhent University, Dept. of Art, Music and Theatre, Belgium;

eRoyal Flemish Academy of Belgium for Science and the Arts, Brussels, Belgium; fInstitute for Cultural Heritage KIK/IRPA, Brussels, Belgium

L. Platiša,a

B. Cornelis,b,d

S. Huang,a A. Fésűs,a

J. David,aW. Liao,

aT. Ružić,

a

A. Dooms,c M. Martens,e,f H. Dubois,g B. Devolder,g M. De Mey,f A. Pižurica,a

and I. Daubechiesd

WHAT IS CRADLING?

THE PROCESSING STAGES OF PLATYPUS

MEET PLATYPUS: A software

solution that comes as a

standalone application and a

Photoshop plugin. It is specifically

designed to digitally remove

cradling artifacts in X-ray images

of paintings on panel.

http://project-platypus.net/

*by courtesy of the North Carolina Museum of Art

contrast

enhancedcontrast

enhanced

contrast

enhanced

contrast

enhanced

© S

int

Baa

fskat

hedra

alG

ent

ww

w.lu

kas

web.b

e -

Art

in F

landers

vzw

,

photo

Lukas

-A

rt in F

landers

VZ

W, p

hoto

Hugo

Mae

rtens

The Ghent Altarpiece (open):

visual image (top) and X-ray image (bottom)Closed altarpiece: Before (top)

and after restoration (bottom)

PAINT LOSS DETECTION

VIRTUAL INPAINTING

SELECTED PUBLICATIONS:

Huang et al., Paint Loss Detection in Old Paintings by Sparse Representation

Classification, iTWIST 2016.

Deligiannis et al., “X-ray image separation via coupled dictionary learning,” IEEE

ICIP 2016.

Pižurica et al., Digital Image Processing of the Ghent Altarpiece: Supporting the

painting's study and conservation treatment, IEEE Signal Proc. Mag., July 2015.

Ruzic and Pizurica, Context-aware patch-based image inpainting using Markov

random field modeling, IEEE Trans. Image Proc., 2015.

Yin et al., "Digital cradle removal in X-ray images of art paintings," IEEE ICIP, 2014.