Upload
bruno-barber
View
217
Download
0
Tags:
Embed Size (px)
Citation preview
2012 SLDS P-20W Best Practice Conference 1
DEVELOPING AND USING P-20W LONGITUDINAL
REPORTSMonday, October 29, 2012
Carol Jenner, Washington State Education Research and Data Center
Charles McGrew, Kentucky P-20 Data Collaborative
Neal Gibson, Arkansas Department of Education Arkansas Research Center
2012 SLDS P-20W Best Practice Conference
• Arkansas: The Arkansas Research Center (ARC)
• Kentucky P-20: A Collaborative Approach
• Washington: Washington State Education Research and Data Center
OVERVIEW
2
2012 SLDS P-20W Best Practice Conference 6
RESPONSIBILITIESK12 Higher Education
Workforce/CTE Early Learning
Web Development
2012 SLDS P-20W Best Practice Conference 15
P-20 Data Collaborative Research Agenda• P-20 staff compile a list of potential
ongoing production and special report topics for the governance group based on feedback from various constituents, analyzing legislative topics, etc.
• Governance reviews and approves an annual reporting and research agenda.
HOW ARE REPORTS DEVELOPEDKY
2012 SLDS P-20W Best Practice Conference 16
Planned Development Process• Audiences are identified and contacted for
feedback or assembled as focus groups before the reports are created.
• Mock-up reports are developed for feedback and data are analyzed to ensure they are appropriate.
• Target audience iteratively review drafts.• Final reports released for vetting.• Reports released publicly.
HOW ARE REPORTS DEVELOPEDKY
2012 SLDS P-20W Best Practice Conference 17
Ad Hoc Development Process• Report or research request is made or
proposed• Approval process
o Requests from state entities are automatically approved within reason
o External requests are evaluated on merit, work required, and funding
• Initial reports are developed• Abbreviated vetting and approval process• Reports released
HOW ARE REPORTS DEVELOPEDKY
2012 SLDS P-20W Best Practice Conference 18
CURRENT AND NEAR-FUTURE REPORTS KYReport Audience Release
High School Feedback Reports – College Going
Schools, Districts, Parents, General Public
Winter
High School Feedback Reports – College Success
Schools, Districts, Parents, General Public
Fall/Winter
Kentucky County Profiles Policy Makers, Business, General Public
Summer
Early Childhood Profile Early Childhood Advisory Councils
Winter
Employment Outcomes Universities, Policy Makers, General Public
Fall
Adult Education Feedback Report
Adult Education Providers, KYAE, Policy Makers, General Public
Spring
Teacher Preparation, Student Performance, and Teacher Longevity
Teacher Prep Institutions, School Boards, General Public
Spring
Reports available at http://kentuckyp20.ky.gov
2012 SLDS P-20W Best Practice Conference 19
DATA PRESENTATION AND USEKY
Pitfalls• Know your audience. What do they
need to know and what format will best communicate it to them?
• Don’t waste people’s time with data for data sake. Does it have usable meaning?
• Just the facts. Don’t interpret data based on a political agenda. If you present it clearly people can make their own interpretations
• People don’t like surprises – vet for accuracy as much as to prepare people
2012 SLDS P-20W Best Practice Conference 21
The Education Research & Data Center• Centralized P-20W data warehouse in
development
• Longitudinal reports are designed and produced now
• Many reports have companion data sets
• Reports will eventually be data warehouse products
• P-20 reports for high schools and school districts website: www.erdcdata.wa.gov
• Plans for additional P-20W longitudinal reports for higher education and early learning sectors
BACKGROUND
2012 SLDS P-20W Best Practice Conference 22
Identify and involve stakeholders (for specific reports)
• SEA staff, district administrators, school counselors
• Higher education institutional researchers• State agencies, including P-20W partners• Legislators and legislative staff • Allow for stakeholder review before public
release
Other considerations• Maximize data available while maintaining
student privacy• Incorporate federal- and state-mandated
elements when possible
REPORT DEVELOPMENT
2012 SLDS P-20W Best Practice Conference 23
Public access at www.erdcdata.wa.gov
• Interactive, online reports based on de-identified data sets generated from the data warehouse (plus companion data sets for download)
Incorporation into SEA reporting (planned)• Some elements will be provided to SEA for
reporting to administrators and for public website
Directly from the data warehouse• By ERDC staff
ACCESS TO REPORTS
2012 SLDS P-20W Best Practice Conference 24
Focus on “Feedback” reports• P-20 Reports for high schools and
districts• Postsecondary enrollment by student
characteristics• Pre-college (“remedial”) course-taking
• P-20W Reports for baccalaureate institutions• De-identified data files to institutional
researchers now – detail file plus longitudinal summary
• Employment while enrolled and after graduation (annual earnings, industry of employment)
WHAT TYPES OF REPORTS ARE PRODUCED?
2012 SLDS P-20W Best Practice Conference 25
Employ effective data governance• Communication between agency decision-
makers, data stewards and custodians, and research coordinators
Promote a P-20W data culture (“Think P-20”)• Establish definitions appropriate for P-20W• Recognize that counts in P-20W reports may not
exactly match those in individual sector reports• Recognize that P-20W data provides richer
information and presents new ways of analyzing old questions
AVOIDING PITFALLS
2012 SLDS P-20W Best Practice Conference
Contact information:Carol Jenner, [email protected]
Charles McGrew, [email protected]
Neal Gibson, [email protected]
Keith Brown, [email protected]
CONTACTS & ADDITIONAL RESOURCES
26
2012 SLDS P-20W Best Practice Conference
For more information on developing and using P-20W longitudinal reports:
Data Use Issue Brief: Techniques for Analyzing Longitudinal Administrative Data: http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-4_Analysis-Techniques.pdf
Data Use Issue Brief: Turning Administrative Data into Research-Ready Longitudinal Data Sets: http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-3_Research-Ready-Datasets.pdf
CONTACTS & ADDITIONAL RESOURCES
27