Three Case Studies on Conservation of Philippine Heritage ... Image... · Image Processing Case...

Image Processing Case Studies on Conservation of Philippine Heritage

Objects Maricor Soriano, Cherry May Palomero, Michelle Sze,

Maria Isabel Saludares

National Institute of Physics University of the Philippines

START 2012, 7 September 2012

Acknowledgements

• The UP Jorge B. Vargas Museum

• Inst. of Electronics and Electrical Engineering UP

• “Art Beyond Appearances – Physics Looks into Paintings” , Proj# 060629OG UP

• National Museum of the Philippines

• Janno Vergara

2

DIGITAL CLEANING AND “DIRT” LAYER VISUALIZATION

With Cherry May Palomero

Fernando Amorsolo Malacanang by the River 1948 Oil on canvasboard. 33.0 x 45.7 cm. Painting from the collection of the UP Vargas Museum.

Malacañang by the River

Digital Cleaning

Clean pixels

Dirty pixels

5

Virtual Restoration: Digital Cleaning

Actual Cleaning

• Completely invasive

• Trial and error approach

• Could be irrevocable

• Restored painting

Digital Cleaning

• Less invasive

• Trial and error approach

• Revocable

• Digitally-restored image

6

Previous Work

Various transformation models

– Linear [1,2]

– Ageing Spectrum [3]

– Quadratic [1]

– White point [2]

[1] M. Barni, F. Bartolini, V. Cappellini, Image Processing for Virtual Restoration of Artworks, IEEE Multimedia, pp 34-37, 2000 [2] M. Pappas, I. Pitas, Digital Color Restoration of Old Paintings, IEEE Transactions On Image Processing, Vol. 9, No. 2, 2000. [3] R. Berns, F. Imai, L. Taplin. Rejuvenating Seurat’s A Sunday On La Grande Jatte- 1884 using color and imaging science techniques: a simulation”, ICOM Committee On Conservation , pp 452-458, 2005.

7

Totally-non-invasive digital cleaning

– Clean segments = unexposed

– Dirty segments = adjacent exposed portions

Used artificial neural network for modeling

“Dirt” layer visualization

Contribution

8

ARTIFICIAL NEURAL NETWORK

INPUTS: RGB OF DIRTY PIXELS

OUTPUTS: RGB OF CLEAN PIXELS

Sampling Areas No. of Pairs

Blue sky 240

Clouds 240

Green leaves 180

Red leaves 60

Shore 120

Reflection of red leaves 60

Reflection of green tree 180

Gray water 270

Total 1350 10

Before

Before

After

After

13

“Dirt” Layer as a Filter

14

)(Clean

)(Dirty)(Dirt_Film

)(Dirty)(Dirt_Film)(Clean

Color-to-spectrum Transformation

16

sky water

foliage roof

3D-IMAGING OF ROCK ART

With Janno Vergara, Michelle Sze, and Maria Isabel Saludares

32

http://compareindia.in.com

http://www.cameralabs.com

Phase Shift Profilometry

33

Set-up Phase-shifted projected patterns

Outdoors

34

Projector

Camera Object

Photo courtesy of Ms. Loren Tusara in February 2010

Indoors

Results

36

Using simulated reference Phase map

37

38

39

40

41

42

“NILO” graffiti reconstruction

43

44

45

46

Ground truth data: d: 1.43 cm w: 1.68 cm Experimental result: d: < 1.7 cm w: ~ 1.5-2.0 cm

depth

width

For more information

• Contact

Maricor Soriano

National Institute of Physics

University of the Philippines Diliman

1101 Quezon City

jing.soriano@gmail.com

+63 920 9083305