PowerPoint PresentationDay 1 | October 5, 2021 12 – 12:55 PM ET Data Self-Assessment
Session Overview: NCHRP produced a guidebook, Report 814 Data to Support Transportation Agency Business Needs: A Self-Assessment Guide, to help state agencies and metropolitan planning organization decision makers and data practitioners to evaluate and improve their data quality and data management practices.
Recently, a group of nine DOTs participated in an effort to implement and build internal capacity to use these self- assessments [NCHRP 20-44(12)]. Come and hear what they did and learned, obstacles faced, tips and tricks.
Find out: Why should you do it? What resources you will need? What new tools/products are expected to come out of this implementation project? Come ready to learn and then discuss how CDMA can continue to support implementation.
Moderator: Frances Harrison, Spy Pond Partners
Presenters: Kim Korejko, DVRPC; Will Duke, Spy Pond Partners; Frank DeSendi, Pennsylvania DOT; Scott Jones, Utah DOT; Peggi Knight, Iowa DOT; Angela Boardman, Minnesota DOT
1
Effectiveness for Agency Business Needs
Frances Harrison and William Duke, Spy Pond Partners, LLC
Tuesday, October 5, 2021
1. Research Implementation Project Overview • Project Overview • Participant Survey • Lessons & Feedback • Anticipated Products
2. Data Self-Assessment Panel Discussion • Why do this? • Obstacles you may face • Tips and tricks
4
Encourage Dissemination and Application of Practices and Principles of NCHRP Report 814
Target, Plan, and Deliver Data Assessments with Nine (9) Participating Agencies
5
Two assessment tools are available:
• Data Value Assessment – assess the extent data users feel data is providing value and meeting business needs
• Data Management Maturity Assessment – assess the agency capability to manage data assets to maximize their value
6
Implementation Experience
Data Value-Data Focus Curve and Grade Data
Data Value-Data Focus Traffic Signals Data
Data Value-Data Focus ITS Asset Data
Data Mgmt. Maturity Agency-wide
Data Value-Data Focus Culvert Data
Data Mgmt. Maturity Traffic Counts Program
Data Value-Data Focus Permanent Counts Data
Data Mgmt. Maturity Agency-wide
Caltrans
IADOT
MDOT
SHA
MnDOT
ODOT
PennDOT
Each assessment consisted of 4 phases: Initial Preparation Assessment Action Planning Evaluation and Closeout
Agency participants were surveyed regarding their experiences.
59 responses were received
Participant Survey – Assessment Value
Participants saw value in all assessment phases – with the group consensus
building and gap analysis discussions being most helpful.
90% Said the process raised awareness of data improvement needs and provided opportunities for productive dialog
80% Felt the assessment provided quantitative ratings that can be used to prioritize improvement and provided an action plan that will guide future activities
90% Recommend their agency conduct similar assessments in the future
9
Agencies have some capacity for self-assessment – however some require
outside assistance and there is a need for supplemental guidance and tools
30% Felt their agency had the capacity to complete assessments without outside support
53% Were unsure if their agency had the capacity without outside support
17% Did not feel their agency had the capacity without outside support
10
• Improving the tools
• Scoping an assessment
findings and highlight other two volumes
• Volume 2: Implementation Summary - Share approach, lessons, participant case studies and survey
• Volume 3: Implementation Support Materials
Facilitator Manual and supporting templates, presentations, or other materials
Sample assessments, kickoff and closeout presentations, and action plans
Updated assessment spreadsheet tools and instructions
Facilitator Manual _______________________
Panel Discussion Topics:
• Why do this?
Kim Korejko Manager, Data Coordination
Text Key Takeaways from our Experience • Keep your participant group below 10 people • Leadership is key to keeping the effort moving • Create deadlines and stick to them • Ensure management is dedicated to taking action on items identified
in the process • The process was easy to adapt to specific needs as an MPO
Rating: 5 stars, highly recommended!
Peggi Knight IADOT
TextIowa DOT Experience
Introduced the tools to Iowa DOT Developed Action Plan for Improvements Outside facilitator was very helpful
18
Crash Data Usability Priority Improvement Recommendations
TraCS
• Reduce data entry choices (e.g. through cascading data entry)
APS
• Apply transformations before Z-Table handoff
Overall Ratings
IADOT Curve and Grade Data Value – Group Consensus Assessment Outcomes
Curve and Grade Data Availability Priority Improvement Recommendations
• Document the specific coverage of what was collected:
• All paved roads that are included in the 2018-2019 cycles (took two years to get all local roads collected)
• Interstate was collected in both years (most recent year published as part of the data)
• No other immediate recommendations or needs
Overall Rating
Scope: agency-wide
Scope: program-level (imagery/remote-sensing)
Identified 29 improvement items (16 high)
Identified 12 improvement items
+ Outside facilitator
- Competing priorities
independently, how do we encourage consistent data management
across the agency?
MnDOT
datasets & reduce overlap/redundancy & ambiguity?
• Established • Data Value – Permanent Site (ATR/WIM) Program
• Underutilized • Programs Managed Within Bureau
TextData Management – Traffic Count Program • Conducted With Internal Bureau Staff
• Team Management • Stay on Schedule • DVRPC Participation
• Quickly ID’ed Shortcomings • Documentation – Processes & Inquiries • Some Components Complete
Text Data Value – Permanent Site Program • Conducted With Wider External Staff
• Team Management • Schedule Slip • A Data Discovery • Key Stakeholders Not Participating
• Actions • Marketing & Communication
• Surprising Result • POV
Scott Jones UDOT