Upload
innovation-network
View
2.100
Download
7
Embed Size (px)
Citation preview
Construction & Practical Design Tips
Data Placemats
Veena Pankaj@VeenaPankaj
Friday, November 13, 2015Evaluation 2015, Chicago IllinoisAmerican Evaluation Association
@InnoNet_Eval
Participants
Round 1 Round 2 Round 3
WKCF 143 154 168
GKCF 34 45 102
Planning
Analysis & Reflection
Action & Improvement
Data Collection
ParticipatoryEvaluation
StakeholderInvolvement
EvaluationUse
The Learning JourneyData Placemats
Pankaj & Emery, in press.
Created by Scott Lewisfrom the Noun Project
Created by Michela Tannoia, GBfrom the Noun Project
Information Architect
Created by EliRatus, ILfrom the Noun Project
Information Anxiety
Created by EliRatus, ILfrom the Noun Project
Information Anxiety
Data Knowledge
Unstructured Information Structured Information Knowledge
The Learning JourneyThe Learning Journey
12
3Before the data interpretation meeting
During the data interpretation meeting
After the data interpretation meeting
The Learning JourneyThe Learning Journey
12
3Before the data interpretation meeting
During the data interpretation meeting
After the data interpretation meeting
Before the Data Interpretation
Meeting
Phases
A Preliminary planning
B Mapping, organizing and analyzing data
C Designing the data placemat
Before the Data Interpretation Meeting
Preliminary PlanningA
Building a Data PlacematPreliminary PlanningA
What year did you participate in the fellowship program? (n=120)
Class Total
Class 10 (Year '03-04)19 out of 23
fellows
Class 11 (Year '04-'05)19 out of 24
fellows
Class 12 (Year '05-'06)23 out of 24
fellows
Class 13 (Year '06-'07)20 out of 22
fellows
Class 14 (Year '07-'08)19 out of 19
fellows
Class 15 (Year '08-'09)20 out of 20
fellows
Year of Participation (n = 120)4
Demographics and Involvement
Constituency Size1
Before I entered the fellowship I was undecided about what I wanted to do …but being in DC and interviewing professionals doing policy work, I [realized] that I wanted to work at the neighborhood/community level. -Alumnus, Class 1 (Interviewee)
Learning from the field and about policy was invaluable. I realized that while working at the DC policy level is a needed aspect of doing…social change work, I am better suited to do direct service and field organizing. -Alumnus, Class 2 (Interviewee)
The program helped me realize my potential as a leader. As a person of color and a person who has experienced poverty first-hand, the program gave me the courage and skills necessary to utilize and share my experiences constructively with others to diversify the discourse of anti-hunger and anti-poverty. – Alumnus class 5, Survey Respondent
Impact of Fellowship on CareerImpact of Fellowship on Career2
Facebook likes over time 5 Toolkit Utilization (n=120)6
Involvement with Programming3
Activities or
ServicesOutputs
Short-Term
Outcomes
Interim Outcom
es
Long-Term
Outcomes
Outcomes Evaluation Questions
Data Collection Method
Data Source
Preliminary Planning
1.What are the characteristics of program participants?
2. To what degree did socioeconomic status impact participation?
3. To what extent did geography play a role in the overall participant journey?
4. What were the barriers to participation?
Evaluation Questions
Created by Blake Thompson, USfrom the Noun Project
Mapping, Organizing and Analyzing Data
B
2
1
3
4
Mapping and Organizing Data
Data Collection Instruments
Survey
Interview Protocol
123
123
What are the characteristics of program participants?
To what degree did socioeconomic status impact participation?
To what extent did geography play a role in the overall participant journey?
What were the barriers to participation?
Evaluation Questions
Mapping and Organizing Data
Survey Data
Open-ended Responses Interview Analysis
Pivot Tables and Graphs
Analyze Data
Designing the Data PlacematC
Choose which pieces of databelong on your placemat
Pankaj & Emery, in press.
Determine how to use color
Header/theme
Supporting data
Chart/graph titles
Chronological labels for placemat elements
Components of a data placemat
1 are a means to an end
Keep in mind, data placemats …..
2 are a communication tool
4 offer an opportunity to collect additional context about the data
3 provide a chance to test initial evaluator assumptions
Sample Data Placemats
Accessibility and Satisfaction
During the DataInterpretation
Meeting
Phases
A Facilitative capacities of the evaluator
B Facilitation tips
Guiding questions
During the Data Interpretation Meeting
Sample data placemats
Technical Capacities Analyzing data Designing data placemats
Adaptive Capacities Perceiving and interpreting Flexibility Nurture productive dialogue Rely on intuition and instinct
Purpose
Format
Walk through each Placemat
What does this data tell you?
What surprises you about this data?
What factors may explain some of the
trends we are seeing?
Does this lead to any new questions?
come prepared with your back pocket themes
ask questions and gather additional context
During the data interpretation meeting …
make a list of all the additional analyses that you will conduct following the meeting
Created by Scott Lewisfrom the Noun Project
After the DataInterpretation
Meeting
1 23
Phases
A Conduct additional analyses
B Prepare final deliverable
After the Data Interpretation Meeting
Additional Analysis
Created by Mark Shorter, US; Creative Stall, PK; Milky Digital innovation, FR from the Noun Project
Prepare Final Deliverable
The Learning JourneyThe Learning Journey
12
3Before the data interpretation meeting
During the data interpretation meeting
After the data interpretation meeting
The Learning JourneyThe Learning Journey
Before the data interpretation meetingPreliminary planningMapping, organizing and analyzing data
Designing the placemat
The Learning JourneyThe Learning Journey
During the data interpretation meetingFacilitative capacities of evaluatorFacilitation tips
The Learning JourneyThe Learning Journey
After the data interpretation meetingConduct additional analysesPrepare final deliverable
Benefits of Participatory Data Analysis
Interest & Engagement1
2
3 Evaluation Use
High Quality Analysis
Data Placemats: Construction & Practical
Design Tips
Thank You!
Veena Pankaj@VeenaPankaj
Friday, November 13, 2015Evaluation 2015, Chicago IllinoisAmerican Evaluation Association
@InnoNet_Eval