Embed Size (px)
Citation preview
Image Processing Case Studies on Conservation of Philippine Heritage
Objects Maricor Soriano, Cherry May Palomero, Michelle Sze,
Maria Isabel Saludares
National Institute of Physics University of the Philippines
START 2012, 7 September 2012
Acknowledgements
• The UP Jorge B. Vargas Museum
• Inst. of Electronics and Electrical Engineering UP
• “Art Beyond Appearances – Physics Looks into Paintings” , Proj# 060629OG UP
• National Museum of the Philippines
• Janno Vergara
2
DIGITAL CLEANING AND “DIRT” LAYER VISUALIZATION
With Cherry May Palomero
Fernando Amorsolo Malacanang by the River 1948 Oil on canvasboard. 33.0 x 45.7 cm. Painting from the collection of the UP Vargas Museum.
Malacañang by the River
Digital Cleaning
Clean pixels
Dirty pixels
5
Virtual Restoration: Digital Cleaning
Actual Cleaning
• Completely invasive
• Trial and error approach
• Could be irrevocable
• Restored painting
Digital Cleaning
• Less invasive
• Trial and error approach
• Revocable
• Digitally-restored image
6
Previous Work
Various transformation models
– Linear [1,2]
– Ageing Spectrum [3]
– Quadratic [1]
– White point [2]
[1] M. Barni, F. Bartolini, V. Cappellini, Image Processing for Virtual Restoration of Artworks, IEEE Multimedia, pp 34-37, 2000 [2] M. Pappas, I. Pitas, Digital Color Restoration of Old Paintings, IEEE Transactions On Image Processing, Vol. 9, No. 2, 2000. [3] R. Berns, F. Imai, L. Taplin. Rejuvenating Seurat’s A Sunday On La Grande Jatte- 1884 using color and imaging science techniques: a simulation”, ICOM Committee On Conservation , pp 452-458, 2005.
7
Totally-non-invasive digital cleaning
– Clean segments = unexposed
– Dirty segments = adjacent exposed portions
Used artificial neural network for modeling
“Dirt” layer visualization
Contribution
8
ARTIFICIAL NEURAL NETWORK
INPUTS: RGB OF DIRTY PIXELS
OUTPUTS: RGB OF CLEAN PIXELS
Sampling Areas No. of Pairs
Blue sky 240
Clouds 240
Green leaves 180
Red leaves 60
Shore 120
Reflection of red leaves 60
Reflection of green tree 180
Gray water 270
Total 1350 10
Before
Before
After
After
13
“Dirt” Layer as a Filter
14
)(Clean
)(Dirty)(Dirt_Film
)(Dirty)(Dirt_Film)(Clean
Color-to-spectrum Transformation
16
sky water
foliage roof
3D-IMAGING OF ROCK ART
With Janno Vergara, Michelle Sze, and Maria Isabel Saludares
32
http://compareindia.in.com
http://www.cameralabs.com
Phase Shift Profilometry
33
Set-up Phase-shifted projected patterns
Outdoors
34
Projector
Camera Object
Photo courtesy of Ms. Loren Tusara in February 2010
Indoors
Results
36
Using simulated reference Phase map
37
38
39
40
41
42
“NILO” graffiti reconstruction
43
44
45
46
Ground truth data: d: 1.43 cm w: 1.68 cm Experimental result: d: < 1.7 cm w: ~ 1.5-2.0 cm
depth
width
For more information
• Contact
Maricor Soriano
National Institute of Physics
University of the Philippines Diliman
1101 Quezon City
+63 920 9083305
