Embed Size (px)
Citation preview
Urban Big Data Centre
Keith Dingwall [email protected]
UNIVERSITY OF GLASGOW
19th May, 2016
July 10, 2015
A wide spectrum of naturally-occurring data:
Generated through transactional, operational, planning and social activities
not all specifically designed for research or the linkage
Associated complexities which require special consideration: Technological Methodological Theoretical/epistemological Political economy
Big Data
Big Data in the Urban Context
Urban Big Data Examples
Sensor systems Environmental, water, transportation, building management
sensor systems; connected systems; Internet of Things
User-Generated
Content
Participatory sensing systems, citizen science projects, social
media, web use, GPS, online social networks and other
socially-generated data
Administrative
(governmental)
Data
Open administrative data on transactions, taxes and
revenue, payments and registrations; confidential person-
level microdata
Private Sector Data Customer transactions data from store cards and business
records; fleet management systems; usage data from utilities
and financial institutions; product purchases and terms of
service agreements
Arts and
Humanities Data
Repositories of text, images, sound recordings, linguistic
data, film, art and material culture, and digital objects, and
other media
Hybrid Data Sources
and Synthetic Data
Linked data including survey-sensor, census-administrative
records
Urban Big Data Centre
Mission: Promote innovative methods and complex urban data to address social, behavioural and environmental challenges facing cities.
Vision: Innovations for sustainable and socially-just cities
Disciplines – Urban Social Science + Data Science Urban studies, planning &
policy
Mathematics & Statistics
Economics
Computer Science
Education
Geography
Civil Engineering
UBDC Portfolio
What UBDC does
Data Products
Data Service
Research
Outreach/KE Training
a UK national data service to facilitate urban research, development and decision making
Urban Big Data Centre
IT environment: High performance computing cluster, specialist software (geoserver, information retrieval and data processing tools) secure data handling, web portal with user access via virtual machine.
Data collections, sourcing and acquisitions: discovering & acquiring data, addressing technical and legal issues
User access: resource discovery mechanisms, metadata, data catalogue, robust and accredited user experience, proposal development, technical support for data management
Governance: Research Approvals Committee & Data Approvals Committee
UBDC Data Service Infrastructure
Urban Big Data Centre
Access to of data
existing holdings, new acquisitions, novel data sets Personalised and secure user environments Expert support to data users Training and skills development Knowledge partnerships Consultative support for data owners Linking data owners to users
Services for Users and Data Owners
Urban Big Data Centre
UBDC Data Acquisitions
Glasgow City Council – Future City Demonstrator Transport Scotland British Geological Survey Scottish Government Renfrewshire, Fife and West Lothian Councils Barnet City Council MET Office Ordnance Survey Urban Insights (Cubic Group) Digital Globe Nokia HERE & TomTom Nestoria & Zoopla Vodafone, EE, Telefonica GNIP Strava UCAS & HESA
Urban Big Data Centre
Training and capacity building In-person training
Basic Training: statistical programming (R), GIS (ArcGIS) Advanced analytics training: spatial analysis using GIS, spatio-temporal
modelling, spatial count data modelling (CARBayes), social media data analytics Training in Agent-based modelling; visualisation; data management and access,
e.g. retrieving social media data, accessing administrative data
Online video tutorials Introduction to the Centre and iMCD
Webinars Webinar on iMCD’s data National Institute of Urban Affairs, Delhi, India
MSc Programme – Urban Transport 12 months full time / 24 months part-time designed to educate students to meet the needs of cities and urban areas in
planning and managing surface transport systems. http://www.gla.ac.uk/postgraduate/taught/urbantransport/
UBDC PhDs (7)
Urban Big Data Centre
Integrated Multimedia City Data (iMCD)
Motivations To study biases in various types of Big Data through a purposefully
designed combination of a large-scale structured household survey collected using statistically valid approaches, a large number of unstructured “Big Data” sources
To generate a data source that help in the formation of targeted behavioural interventions (sustainability, learning, health, etc.)
To understand the extent to which emerging unstructured data sources (e.g. social media and user-generated multimedia data) can help augment existing urban management practices;
To generate data-driven hypothesis about urban behaviours and trends that can be analysed and evaluated using urban models and simulations;
Urban Big Data Centre
Integrated Multimedia City Data (iMCD)
Primary survey of 1500 households in Glasgow and household members (~ 3000 people) Questionnaire-based survey – transport, education,
energy use, ICT use, attitude and personal preferences Sensor survey (GPS & lifelogging)
1 year of information Retrieval (internet text-based and multimedia data)
High Resolution satellite & LiDAR data to construct dynamic Digital Surface Model for Glasgow
Linking together a number of sensor networks: transportation, emissions, crime detection CCTV, weather etc.
Link to British Geological Survey (BGS) data on ground conditions beneath Glasgow
Urban Big Data Centre
GPS and Lifelogging Project
Autographer GPS tracker
Urban Big Data Centre
Urban Big Data Centre
iMCD Visualisation
Urban Big Data Centre Multimedia Data Capture and Information
Extraction Data Capture A variety of public data streams will be captured in real-time
for a period of 1 year
Social Streams News Glasgow Future City Data
Event Detection & Transport Mode Detection
• Streams (e.g. Twitter) will be analysed to detect specific events
• Determen transport mode being used (e.g. car, walk, bus and so on) of the GPS survey participants
Event Detection
Event Tracking/Analytics
Urban Big Data Centre
Other Activities
• Social Analytics Strategic Network – “SASNet” in Collaboration with Business and Local Government Data Centre (Essex)
• Workshops • Training • Fellowships • http://ubdc.ac.uk/our-services/sasnet/
• “Catch! – Citizens at the City’s Heart ” £2m Innovate UK funded project led by London based SME Travel AI to develop a prototype crowdsourcing mobile phone app based data service.
• ESRC/Chinese Academy of Sciences project “Urban Development, Migration, Segregation and Inequality”
UBDC – Stakeholders and Partners
