Data Disaggregation: For Data Driven Decision Making
By Ron Grimes:Special Assistant to the Assistant Superintendent
Office of Career and Technical Accountability & Support
What is “data disaggregation” and why
should we use it?
Simple definition:
Looking at data (test scores, etc.) by specific
subgroups.
Data Types
Demographics
Perceptions
Student Learning
School Process
Ways that CTE can Disaggregate
• Gender• Concentration• WorkKeys data• Global 21 Performance Assessment
Data• Placement• Enrollment in concentrations• Stakeholder satisfaction• Return on Investment
CTE Data Concept Map
STUDENTLEARNING
Portfolios
WESTEST
CSO Profiles
Global 21 CTE
Performance
Projects
Work Keys Rubrics
Additional
Brainstorm Examples
Formative Assessments
CTSO State
Performance
Ways to Disaggregate
• There a several ways to disaggregate student learning data:– For example:
• Gender• Socio-economic status• Mobility (students moving between schools)• Race & ethnicity• Students with special needs• English as a Second Language (ESL)• Successful completion of a course(s)
Examples of Data Disaggregation
• WorkKeys Assessment DataWhy is there a Zero in math?
Does this score represent
SWD?
Are the LI scores
improving?
Examples of Data Disaggregation
• Global 21 Performance Assessment Data
Which concentrations have the best
results?
Which concentrations did not meet
standard?
Important Questions
• There are important questions that student learning data disaggregation can answer. – For example:
• Is there an achievement gap among our students?
• Is that gap growing or shrinking?• What do enrollment levels in particular
concentrations tell us?• Are students with special needs adequately
represented?
Data & Confidentiality• Be careful about the data you have access
to and its security. FERPA guidelines are very specific regarding specific types student data and its security.
• Any testing data that includes identifying information or information regarding exceptionality, socio-economic status, etc. cannot be use publicly and limited access can only be granted for professional use only.
CTE Data Concept Map
SCHOOL PROCESSES
CTSO
Interventions
Counseling
Global 21 CTE
Performance Process
Project-based Learning
Work Keys Process
Strategic Plan
Additional
Brainstorm Examples
Professional
Development
Discipline
LEA
Advisory Council Strategies
Ways to Disaggregate Process Data
• There a several ways to disaggregate process data:– For example – LEA Process – Database for Composite &
Individual School/County analysis:
• Use of Perkins funds• Programs of Study• Academic and Technical Skill strategies• Professional Development• Methods of Consultation• Program Evaluation methods• Access• Non-traditional preparation• Career Guidance & Academic counseling
Process DataLEA Plan Analysis
Agency4
3.45%
Business/Industry
4337.07%
Education45
38.79%
Higher Ed.2
1.72%
Parent3
2.59%
Student7
6.03%
*Undetermined12
10.34%
CRAFT Advisory Council Members
LEA Plan Data 2010-2011
116 Advisory Council Members
Agency6
3.43%
Business/Industry
12169.14%
Education30
17.14%
Higher Ed.5
2.86%
Parent2
1.14%Student
52.86%
*Undetermined6
3.42%
CRAFT Advisory Council Members
LEA Plan Data 2010-2011
175 Advisory Council Members
* = Reported but no information provided to determine type
Important Questions
• There are important questions that process data disaggregation can answer. – For example:
• Does the use of WIN as an academic technical skill strategy impact Work Keys scores?
• How many schools are implementing academic integration workshops?
• Is there an increased placement percentage with schools that offer industry credentials?
• How many advisory council members represent business/industry in the state.
CTE Data Concept Map
PERCEPTIONS
Parent Surveys
Teacher Surveys
Administration
Surveys
Advisory Council
Surveys
Task Forces
Student SurveysInterviews
Additional
Brainstorm Examples
Observations
Ways to Disaggregate
• There a several ways to disaggregate perception data:– For example:
• Student needs• Stakeholder type• Concentration • Teacher• Compare “satisfaction” rating with
performance
Important Questions
• There are important questions that perception data disaggregation can answer. – For example:
• Why are students enrolling in particular concentrations?
• What trends are identified in the labor market based on advisory council surveys?
• How satisfied are our stakeholders (measurable for trend analysis)?
• What strategies for improvement do the stakeholders suggest?
CTE Data Concept Map
DEMOGRAPHICS
Attendance
Discipline Incidences
Enrollment
Gender
Ethnicity
Free & reduced lunch
status
Concentrations
Additional
Brainstorm Examples
Drop out rates
College going rate
Placement
Ways to Disaggregate
• There a several ways to disaggregate demographic data:– For example:
• Gender• Socio-economic status• Mobility (students moving between schools)• Race & ethnicity• Labor market data• County educational attainment• Postsecondary education completion data
Important Questions
• There are important questions that demographic data disaggregation can answer. – For example:
• What percentage of students are enrolling in postsecondary education and graduating?
• Is there a decline in the county population?• What adult concentrations would benefit the
community based on labor market data?
Other Important Questions
• Disaggregated data can also tell you whether student mobility, professional development of teachers, or parental involvement is affecting student performance.
• Data can zero-in on information at the school level, the classroom level, the teacher level, the instructional level, etc.
EXCITING NEW DATA TOOLS
•Data Profile – Longitudinal Data•Online LEA Plan- user friendly•Promising/Best Practices Guide•State-wide Perception Surveys and Analysis•CTSO Results & Performance Analysis•Technology Resources – Usage & Impact on Performance
We analyzed the May 2011 Administrative Conference Surveys and listened to your needs:
Questions?