85th Annual WAD Conference 2010 – 24th September 2010

Integrating spatial and thematic data: the CRISOLA case for Malta and the European project Plan4all

Saviour FormosaVincent MagriJulia NeuschmidManfred Schrenk

www.um.edu.mt

ICCSA 2011 - International Conference on Computational Science and its Applications22 June 2011

The Theme: Crime

The Context

CRIME

SOCIAL LANDUSE

The FutureThe Conveyor

• A data dearth: most social data is in analogue format

• Access and limitations/moratoria to social data

• Cleaning the data where available is done mostly manually

• Spatial issues:• Projections and conversions of whole state has proven a ‘nightmare’• Geocoding is based on street centre points which does not allow for real locational analysis• Streets are non-networked• Address point database does not exist…

• However, major steps have been made to create an NSDI based on the requirements from the INSPIRE Directive, together with a pivot from the Aarhus Convention and other data-related legislation

• Study uses the initial work on data specifications as based on the Plan4All and INSPIRE specifications

• Techno-Centric or Socio-Technic Approach?

The Situation and the Thematic Reality

INSPIRE

Why use INSPIRE as the base for Social Data?

Environmental Needs• Better information needed to

support policies • Improvement of existing information

flows• Revision of approach to reporting

and monitoring, moving to concept of sharing of information

Situation • Lack of co-ordination across borders

and between levels of government • Lack of standards incompatible

information and information systems• Existing data not re-usable

fragmentation of information, redundancy, inability to integrate

Environmental data

90% is linked to geography

Social data`

? % is linked to geography

Environment:NaturalPhysicalSocial

Annex I Coordinate reference systemsGeographical grid systemsGeographical namesAdministrative unitsTransport networksHydrographyProtected sites

Annex I I ElevationAddresses of propertiesCadastral parcelsLand coverOrthoimagery

Annex III Statistical units census BuildingsSoilGeologyLanduseHuman health and safetyGovernmental services and

environmental monitoring facilities Classified sites (industry and

agriculture)Population distribution – demographyArea management and …. zonesNatural risk zonesAtmospheric conditions Meteorological geographical featuresOceanographic geographical featuresSea regionsBio-geographical regions

The INSPIRE Annexes: the social themes…

Zooming In: The State of Play

Population: 413,609 (Demographic Review, 2008)

Households: 140,000 (Census, 2005)

Land area: 316 Km2

(MEPA, 2010)

Dwellings: 192,000 (Census, 2005)

Enterprises: 50,000 (NSO, 2008)

Land cover: 27% - 85 Km2 (MEPA, 2005)

Plenty of opportunities for predators to operate in

Vacant Dwellings: 53,000 (Census, 2005)

The relationship between crime and the urban environment:Chicago to UK to Malta

Environmental Criminology – Urban Ecology

CRIME

SOCIAL LANDUSE

Theories

Opportunity TheoryRoutine Activity TheoryBroken Windows TheoryStructuration Theory

Cognitive landscape mindmaps

W6H

CRISOLA

Phase 1 - Conceptual Model Logical Matrix

Phase 2 – Identifying the linkages

Phase 3 – Identifying the datasets and attributes

Demographic Landscapes: Population Density

Social Landscapes: Unemployment Rates

Offender basedata in 1990s

Offender clusters in 1990s

Offender densities by EAs: popdens-offender correlation

Offender densities vs National densities: EAs

Offender - poverty hotspots

Offence analysis: pin it to a wall? Or easy digital process?

Year Crimes

1998 15,771

1999 16,046

2000 17,030

2001 15,912

2002 17,043

2003 17,773

2004 18,388

2005 18,579

2006 16,538

2007 15,150

2008 13,804

2009 11,823

Grand Total 193,857

Error Generation

Manual imposition

Dark Figure

85th Annual WAD Conference 2010 – 24th September 2010

Offence Incidences: spatio-temporal - Migration

85th Annual WAD Conference 2010 – 24th September 2010

Offence NNA: spatial – Type by spread – Most effected

Leisure & RecreationResidential

Parking

Leisure & RecreationResidential

Retail

HealthResidential

RetailParking

RecreationResidentialRetail - OfficesParking

Offence NNA: spatial – Type by spread – Pieta Detailed

St. Luke’s Hospital Detox

Bus TerminusParking Space

MarinaBus Stop

Traffic LightsRetail

Housing EstatePolitical Party HQs

SchoolsSports & Retail

Offence constructs: Zoning

Offences: Zoning Categories

Offence constructs: Residential offences

Offence Hotspots: spatial – Retail Crime

Offence Hotspots: spatial – Retail Crime

Buffer Analysis: Retail Impacts on the Neighbourhoods

San Giljan Case Study

Inner Zones Serious Crimes, Theft and Damage

Middle Zones Damage & Vehicle Crime

Success: reduction of >10% In Dragonara Road: Simple installation of lighting/CCTV

Outer Zones Vehicle, Damage Residential Burglaries

Mitigation: Requires effective policing and SIAs

Socio-Physical Models: The Conchin et al case study

Crime Constructs: a modelling perspective

Offence constructs: The Conchin et al case study - extended

Crime Constructs: a planning perspectiveIllegal development

Offence constructs: The Conchin et al case study - extended

Crime Constructs: a temporal perspectiveShadow impact

Offence constructs: The Conchin et al case study - extended

Crime Constructs: a trigger perspectiveOffender locations responsible for crimes psychologically induced

by stress-triggered factors caused by prolonged sunlight deprivation

The Conveyors: Early Mapservers

Map service: Malta CrimeMaps

Map service: Malta CrimeMaps

Map service: Census 2005 – Population and Housing

The Plan4All Project

What is Plan4all

Plan4all is a European project co-funded by the Community programme eContentplus. The main aim of the project is to harmonise spatial planning data and related metadata according to the INSPIRE principles.

The Plan4all consortium is composed of 24 partners from 15 European countries.

• To encompass the definition of standards for spatial planning data harmonisation according to INSPIRE

• To implement the Plan4all geoportal that consists of harmonised spatial planning data that can be shared

• To contribute to a European spatial data infrastructure

The Plan4All Objectives

• Plan4all Spatial Data Interest Communities registration

• INSPIRE Requirements Analysis

• Analysis of National Requirements on Spatial Planning Metadata

• Analysis of Conceptual Data Models for Selected Schemes

• Analysis of Demand on European Spatial Planning Data Sharing

• Plan4all Metadata Profile

• Conceptual Data Models for Selected Themes

The Plan4All work

The Plan4All workSpatial transformation process

The spatial transformation was more complex due to the fact that Malta holds all its data in a truncated ED50 format which required the following steps in order to be converted to the final required projection:

• Restoration of the truncated 4 in Northings and 39 in Eastings;• Reprojecting to WGS84: EPSG: 36233;• Conversion to shp format from .tab format;• Colour schemes are lost in the transition and need to be recreated in the geoserver.

The services offered by the system are WMS, WFS, whilst metadata services are provided through a link to the Plan4All metadata service where these files were stored in both xml and xls formats. The main data layers are made available through OpenLayers format incorporating WMS and WFS services.

Metadata of the spatial planning data was created and compiled by INSPIRE Metadata Editor (XML Creator). The INSPIRE Metadata editor makes it possible to create INSPIRE compliant metadata and to download it as an xml file.

The Plan4All work – UML

Business Stats

- NACE CODE- UNITS

operations()

Urban Boundaries

- Shape_ID- NUMBER

Dwelling Data

- Name- 2000- 2001- 2002- 2003- 2004- 2005- 2006- 2007- 2008- 2009- 2010- Total

Literacy

- Shape_ID- NUTS4_ID- NUTS4_DES- 2005- PERCENT- PERCENT0- PERCENT1

Census2005 Data

- Various Datasets

Private Households

- Shape_IDNUTS5_IDNUTS5_DES2005TOTALHOUSEHOL_2_3_4_5_6_7_8_9_10_

EducationalAchievements

- Shape_ID- NUTS4_ID- NUTS4_DES- 2005- TOTAL- SCHOOLING- WIT- PRIMARY- PRIMARY0- SECONDAR- SECONDAR0- TERTIARY- TERTIARY0

Labour Status

- - Shape_ID- NUTS4_ID- NUTS4_DES- 2005- TOTAL- EMPLOYED- UNEMPLYED- INACTIVE

EducationalQualifications

- Shape_ID- NUTS4_ID- NUTS4_DES- 2005- TOTAL- ATTAINED- _O_LEVEL- LEVEL- _A_LEVEL- NOT_ ISS- DIPLOMA- DEGREE- QUALIFICAT- MASTERS_ PHD_DBA_

Occupaton

- Shape_ID- NUTS4_ID- NUTS4_DES- 2005- TOTAL- FORCES- OFFICIALS- PROFESSIO- PROF- CLERKS- SHOP_AND_- AND_FISHE- WORKE- AN- OCCUPATIO

Health

- Shape_ID- NUTS4_ID- NUTS4_DES- 2005- TOTAL- COND- HEALTH_C- MALES- COND0- HEALTH_ C0- FEMALES- HEALTH_CO- HEALTH

The Plan4All work: CLC Case Study

Metadata Services

The Plan4All work: CLC Case Study

The Plan4All work: CLC Case Study

Transformation ServicesSchemas

The schema used for Land Cover was that identified by the Plan4All guidelines and the Application Schema

was the “Land Cover” Schema.

Feature CatalogueMap viewer

The webmap client used was geo server: (http://ftzgeo.org:8080/geoserver/web)

The Plan4All work: CLC Case Study

• INSPIRE Directive Deliverables– Implementation rules – standardisation– Base for National Data Infrastructure– Metadata– Spatial structures– Data Services– Discovery Services– View Services

What outputs will INSPIRE deliver?

The Next Steps: – The FUTURE

THE NEXT STEP FOR INTEGRATION OF CRISOLAIN THE MALTESE ISLANDS

WHERE SHALL WE GO FROM HERE?

The Next Steps: ERDF 156

Developing National Environmental Monitoring Infrastructure and Capacity

Structural Funds Projectunder the Operational Programme I Priority Axis 6

ERDF 156

Some Outputs: Serving as the base for social and spatial analysis

(1) Air Strategy and Data Acquisition

(2) Water Strategy and Baseline Study

(3) Noise and Radiation Strategy

(4) Chemicals in Soil Strategy

(5) Full LIDAR Scan: Terrestrial and Bathymetric

(6) Ground truthing for sea substrate type

(7) Oblique aerial imagery & satellite imagery

(8) Online information service

(9) Online mapservice - SEIS

(10) Statistical backing for experts – inc. spatial stats

(11) ALL Data is to be disseminated for FREE

The Area under Study

Maltese Islands coast inclusive of 1 nautical mile boundary from the baseline coastline

The Tools to enhance Analysis

(1) LIDAR Scan: Terrestrial(Topographic Light Detection and Ranging (LiDAR)) Digital Surface Model (DSM) and Digital Terrain Model (DTM)

(2) LIDAR Scan: Bathymetric

(3) Bathymetric Scan: Acoustic(interferometer swath and side scan sonar) Digital Surface Model and an acoustic information map of sea bed

(4) Oblique aerial imagery & orthophotos

(5) Satellite imagery

(6) Remote GPS Cameras (Remote capture GPS receiver)

(7) 3D scanner and GIS Handhelds

(8) Global Navigation Satellite System Station and geodetic receivers

(9) Link to the iphone app pollution data porting to social domains from the environmental domains

Annex I Coordinate reference systemsGeographical grid systemsGeographical namesAdministrative unitsTransport networksHydrographyProtected sites

Annex II ElevationAddresses of propertiesCadastral parcelsLand coverOrthoimagery

Annex III Statistical units census BuildingsSoilGeologyLanduseHuman health and safetyGovernmental services and

environmental monitoring facilities Classified sites (industry and

agriculture)Population distribution – demographyArea management and …. zonesNatural risk zonesAtmospheric conditions Meteorological geographical featuresOceanographic geographical featuresSea regionsBio-geographical regions

Revisiting INSPIRE

Annex IV Social Themes

The Information Social Dilemma Tower of Babel or Valhalla?

Today we are facing a period unprecedented in history: information is

available, it is easy to decipher and is accessible to all…

Or is it?

Are we going down the Babel way?

The most brilliant architects got together with the brightest inventions and plans..

But there were too many languages and they couldn’t communicate. That killed

the tower not the technology

If Techno-Centric Approaches appear difficult to understand imagine what it is like for the non-Technics thus socio-technic approaches

are the way forward.

Thank You

Saviour Formosa - saviour.formosa@um.edu.mt Vincent Magri - vincent@ascendconsulting.eu

Julia Neuschmid - j.neuschmid@ceit.at Manfred Schrenk - m.schrenk@ceit.at