Metadata for putting historical maps online / Chris Fleet (National Library of Scotland)

National Library of ScotlandLeabharlann Nàiseanta na h-Alba

National Library of Scotland

METADATA FOR PUTTING HISTORICAL MAPS ONLINE

Metadata for putting historical maps online22 July 2016

STRUCTURE

▪Map Images website overview

▪Main software and structural components

▪Metadata for maps and features

▪Metadata for georeferened images and web services

▪Future directions

Timothy Pont, ca. 1583-1614

T. Pont / J. Blaeu, 1654

James Gordon, 1661

Lewis Petit, 1715

John Home, 1774

James Crawford, 1804

Ordnance Survey, Perth, 1860

Ordnance Survey, Aberdeen, 1867

National Library of Scotland maps website http://maps.nls.uk

MAP IMAGES WEBSITE OVERVIEW

▪ NLS paper collections ca. 2 million maps

▪ NLS Map Images website 150,000 online maps - ca. 7.5%

▪2012-2015 - ca. 40,000 new maps added per annum

Google Analytics - http://maps.nls.uk - June 2016

▪ 97,039 users per month

▪ 165,177 sessions per month

▪ 797,147 page views per month

▪ 348 orders for images/printouts / £5,405 revenue

▪15 “commercial” permission requests / ca. £1,500 income

MAIN SOURCES

STRUCTURE

EXPANDING USE OF OPEN-SOURCE TECHNOLOGIES

Main open-source software:

● OSGeo suite

● GDAL

● QGIS

● GeoServer

● OpenLayers

● IIPImage Server

Main proprietary software:

● MapTiler

● ArcGIS

● Geographic Imager

● SQLServer

Find By PlaceViewer

Explore Georeferenced maps Viewer

OpenLayersViewer

WMS / WMTS Services, API

Derivative Images

Georeferenced Images

Descriptive Metadata

Shapefiles / bboxes

TIFF master images

Digital Objects Database metadata

STRUCTURAL OVERVIEW : MULTIPLE COMPONENTS WITH DIFFERENT REPLACEMENT CYCLES

STRUCTURE

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

DIGITAL OBJECT DATABASE METADATA

Unique IDs

Generated through the DOD and

retained for all derivatives - JPEG, JP2, and GeoTIFFs

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

GEOGRAPHIC COORDINATES FOR MAP EXTENTS - ARCGIS

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

GEOGRAPHIC COORDINATES FOR MAP EXTENTS - OPENLAYERS

GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN GEOSERVER

CACHING BOUNDING BOXES FOR RAPID ONLINE DISPLAY - GEOWEBCACHE

WEB FEATURE SERVICE (WFS)

An open standard developed by the Open Geospatial Consortium allowing requests for geographical features across the web using platform-independent calls.

URL format request with response received as Geography Markup Language (GML) or Javascript Object Notation (JSON) format

For example, a WFS request...

http://geoserver.nls.uk/geodata/wfs?service=WFS&version=1.1.0&request=GetFeature&typename=nls:OS_6inch_UK_27700&outputFormat=text/javascript&format_options=callback:loadFeatures&srsname=EPSG:3857&cql_filter=INTERSECTS(the_geom,POINT(530232 179709))

...and response

loadFeatures({"type":"FeatureCollection","totalFeatures":2,"features":[{"type":"Feature","id":"OS_6inch_UK_27700.1188","geometry":{"type":"MultiPolygon","coordinates":[[[[-16258.305954289,6704032.196635765],[-16226.801442981383,6714377.231410879],[-739.9404392996324,6714315.014511256],[-791.0370382677659,6703970.186406469],[-16258.305954289,6704032.196635765]]]]},"geometry_name":"the_geom","properties":{"IMAGETHUMB":"http://maps.nls.uk/imgsrv/iipsrv.fcgi?iiif=/10234/102347415.jp2/full/,150/0/native.jpg","IMAGEURL":"http://maps.nls.uk/view/102347415","SHEET":"Surrey III","DATES":"Surveyed: 1868 to 1873<br>Published: 1880"}},{"type":"Feature","id":"OS_6inch_UK_27700.1247","geometry":{"type":"MultiPolygon","coordinates":[[[[-17915.666782360982,6709058.027018599],[-17924.76285975371,6719409.4718413325],[-2428.1729460832776,6719408.392362227],[-2438.702515531777,6709056.951565147],[-17915.666782360982,6709058.027018599]]]]}, etc.

GEOREFERENCED SEARCH AND RETRIEVAL USING GEOGRAPHICAL COORDINATES

GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN SCOTLANDSPLACES

GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN OLDMAPSONLINE

GEOGRAPHIC COORDINATES FOR MAP EXTENTS - IN SHEETFINDER

SOURCES OF WEB TRAFFIC AND REFERRALS - 1 JULY 2015 - 30 JUNE 2016

MOST POPULAR PAGES 1 JULY 2015 - 30 JUNE 2016

ALL PAGES CONTENT DRILLDOWN

ASSIGNING PLACE METADATA THROUGH A SPATIAL JOIN

GOOGLE SPIDERING OF CONTENT

VALUE OF GEOGRAPHIC COORDINATES FOR INDEXING

● Allows flexible searching by text (place, postcode, county, etc.) and maps

● Allows multiple indexing by past/present geographies

● No need to be tied to fixed controlled vocabularies for geographic names

● Allows easier extension into other portals and harvesting sites

● Allows easier links from other websites and resources

● Allows creation of indexes of new names for new purposes

● Open, non-proprietory, and with complete institutional control over use

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

DOD METADATA TAKEN INTO MAPS WEBSITE SQLSERVER DATABASE

MAPS WEBSITE PAGE METADATA FROM SQLSERVER

MAPS WEBSITE E-COMMERCE MODULE

STRUCTURE

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

DERIVATIVE IMAGES - PHOTOSHOP BATCH FOR JPG AND KAKADU BATCH FOR JP2

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

CROPPING BORDER IN PHOTOSHOP

Digital mapping and Georeferencing22 June 2016

ADDING CONTROL POINTS IN ARCGIS

Digital mapping and Georeferencing22 June 2016

MAPS ARE SPATIALGeoreferencing 2

Capturing corner Co-ordinates

SHAPEFILE METHOD

Linking corner co-ordinates of maps

geographic extents in each polygon - within a shapefile

Automatic cropping and georeferencing based on shapefile to create seamless mosaic

National Library of ScotlandLeabharlann Nàiseanta na h-AlbaCROWDSOURCED GEOREFERENCING - BLAEU ATLAS MAIOR

National Library of ScotlandLeabharlann Nàiseanta na h-AlbaGEOTIFF METADATA

Projections and extents information in GeoTIFF headerDriver: GTiff/GeoTIFFFiles: c:\Lomond_S_export.tifSize is 6643, 7930Coordinate System is:PROJCS[" Projection Name = Transverse Mercator Units = meters GeoTIFF Units = meters", GEOGCS["OSGB 1936", DATUM["OSGB_1936", SPHEROID["Airy 1830",6377563.396,299.3249646000044, AUTHORITY["EPSG","7001"]], AUTHORITY["EPSG","6277"]], PRIMEM["Greenwich",0], UNIT["degree",0.0174532925199433], AUTHORITY["EPSG","4277"]], PROJECTION["Transverse_Mercator"], PARAMETER["latitude_of_origin",49], PARAMETER["central_meridian",-2], PARAMETER["scale_factor",0.999601272], PARAMETER["false_easting",400000], PARAMETER["false_northing",-100000], UNIT["metre",1, AUTHORITY["EPSG","9001"]]]Origin = (228721.187000000010000,701502.853000000000000)Pixel Size = (3.000000000000000,-3.000000000000000)Metadata: AREA_OR_POINT=Area TIFFTAG_SOFTWARE=IMAGINE TIFF SupportCopyright 1991 - 1999 by ERDAS, Inc. All Rights Reserved@(#)$RCSfile: etif.c $ $Revision: 1.10.1.9.1.9.2.11 $ $Date: 2004/09/15 18:42:01EDT $ TIFFTAG_XRESOLUTION=1 TIFFTAG_YRESOLUTION=1 TIFFTAG_RESOLUTIONUNIT=1 (unitless)Image Structure Metadata: INTERLEAVE=PIXELCorner Coordinates:Upper Left ( 228721.187, 701502.853) ( 4d45'34.02"W, 56d10'31.42"N)Lower Left ( 228721.187, 677712.853) ( 4d44'39.21"W, 55d57'42.74"N)Upper Right ( 248650.187, 701502.853) ( 4d26'19.41"W, 56d10'55.71"N)Lower Right ( 248650.187, 677712.853) ( 4d25'30.96"W, 55d58'6.83"N)Center ( 238685.687, 689607.853) ( 4d35'30.87"W, 56d 4'19.55"N)Band 1 Block=64x64 Type=Byte, ColorInterp=RedBand 2 Block=64x64 Type=Byte, ColorInterp=GreenBand 3 Block=64x64 Type=Byte, ColorInterp=Blue

Find By PlaceViewer

OpenLayersViewer

Derivative Images

Shapefiles / bboxes

TIFF master images

WEB MAP TILE SERVICE (WMTS)

An open standard protocol developed by the Open Geospatial Consortium for serving pre-rendered georeferenced map tiles over the Internet

Format:

server-and-url/zoom/x/y.png eg. http://geo.nls.uk/maps/popular/7/62/88.png

National Library of ScotlandLeabharlann Nàiseanta na h-AlbaHISTORIC MAPS API

National Library of ScotlandLeabharlann Nàiseanta na h-AlbaJOHN GRAY CENTRE, HADDINGTON

STRUCTURE

FUTURE DEVELOPMENTS

▪Expanding digitisation of maps and online availability

▪Growing functionality and range of uses

▪More collaborative applications

▪Greater engagement through crowdsourcing

▪Automatic georeferencing, OCR and vectorisation

Chris Fleet

c.fleet@nls.uk

/NationalLibraryofScotland

@natlibscotmaps

THANK YOU

Except for images or where otherwise stated this presentation is © National Library of Scotland and is licensed under the Creative Commons Attribution 4.0 International Licence. To view a copy of this license, visit: http://creativecommons.org/licenses/by/4.0/

Metadata for putting historical maps online / Chris Fleet (National Library of Scotland)

Data & Analytics

Putting Zone Putting Manual

Putting the Shock back into the Future · Long Term Repositories 2006 Existing Tools • JHOVE, DROID - Metadata extraction tools • OCLC’s INFORM, Cornell’s VRC – risk assessment

Working with Metadata in ArcGIS Aleta Vienneau. Working with metadata in ArcGIS View metadata Edit metadata Set your metadata style Leverage metadata

1 Copyright © 2012, Oracle and/or its affiliates. All ... · – Fleet Data New Documentation – How to migrate customized ETL, metadata, & reports – How to customize ETL, metadata,

Crossref Metadata and Metadata Services

Putting Off / Putting On

Metadata @ CSC Michael Moeller Metadata Specialist

Metadata Sandboxing | Education Metadata Meetup

Expert Review Big Metadata, Smart Metadata, and …microblogging.infodocs.eu/wp-content/uploads/2017/12/...Big metadata, smart metadata, and metadata capital are presented as part

Putting your fleet at your fingertips - DPL Telematics › wp-content › uploads › 2014 › 08 › 2014...Putting your fleet at your fingertips USAGE SERVICE SECURITY Compare runtime,

Metadata lecture 3, metadata schemes

Working with Metadata in ArcGIS · Esri UC2013 . Technical Workshop . Metadata in ArcGIS • ArcGIS metadata goals • Editing metadata • Setting your metadata style • Leveraging

Mind Your Metadata Geri Miller. Metadata in ArcGIS ArcGIS metadata goals Editing metadata Setting your metadata style Leveraging metadata in ArcGIS Importing

ESRI ArcGIS (slides 11 through 17). Definition: From article: “Putting Metadata in Plain English” Title, geographic area, time period or currency, spatial

Metadata AIXM 5.1 Seminar 12 – 13 December 2011. Metadata 2 What is metadata? Why is metadata relevant to us? How is metadata used in AIXM?

Metadata Creation and Validation Methods. Writing Metadata

METADATA: TRACKING AND ENCRYPTION. METADATA EXAMPLES Microsoft Word document properties Telephone/email metadata Camera/image metadata Web browser identification

WMO Core Metadata Profile version 1 - WIS browsingwis.wmo.int/2010/metadata/version_1-2/WMO Core Metadata Profile v1... · metadata, i.e. the overall management of the metadata resources

Getting your metadata using PROC METADATA

ISO/TC211 Geographic information/Geomatics Metadata · 2019-01-21 · ISO metadata foundation • Regional metadata standards – ANZLIC Working Group on Metadata: Core Metadata Elements