Embed Size (px)
DESCRIPTION
Assessment Workshop. NSF CISE REU Sites PI Meeting March 18, 2010. Audrey Rorrer UNC Charlotte. CISE REU Sites Assessment Project. Assessment WG Overview a la carte Survey Evaluation Toolkit Common Application Future Directions Refinements Best Practices. Workshop Overview. - PowerPoint PPT Presentation
Citation preview
Assessment Workshop
NSF CISE REU Sites PI Meeting
March 18, 2010
Audrey RorrerUNC Charlotte
NSF CISE REU Sites PI Meeting 2010
CISE REU Sites Assessment Project
• Assessment WG Overview– a la carte Survey– Evaluation Toolkit– Common Application
• Future Directions– Refinements– Best Practices
NSF CISE REU Sites PI Meeting 2010
Workshop Overview
Workshop Goals
• Site evaluation cookbook
• Provide assessment support
• Interactive forum for information exchange– Table MentorsTable Mentors
Evaluation Step 1
Evaluation Cookbook
1. IRB approval2. Application3. Project Goals4. Assessment5. Analysis6. Reporting
NSF CISE REU Sites PI Meeting 2010
Research Compliance• Required for human subjects
studies
• Review time ~ 6 weeks
• Must have prior to collection of any assessments or surveys
NSF CISE REU Sites PI Meeting 2010
Evaluation Step 2
Evaluation
Cookbook
1. IRB approval
2. Application
3. Project Goals
4. Assessment
5. Analysis
6. Reporting
Student Applications• Common information points
• Reference letters
• Transcripts
Common Application
NSF CISE REU Sites PI Meeting 2010
Evaluation Step 3
Establishing Goals & Intended Outcomes
• Recommended indicators
• Map with a logic model
Evaluation
Cookbook
1. IRB approval
2. Application
3. Project Goals
4. Assessment
5. Analysis
6. Reporting
NSF CISE REU Sites PI Meeting 2010
Evaluation Step 4
Evaluation
Cookbook
1. IRB approval
2. Application
3. Project Goals
4. Assessment
5. Analysis
6. Reporting
Assessing Outcomes
• Methodology– Pre/post comparison– Data collection
• Tools– Shared assessments– A la Carte Survey
NSF CISE REU Sites PI Meeting 2010
Evaluation Step 5
Evaluation
Cookbook
1. IRB approval
2. Application
3. Project Goals
4. Assessment
5. Analysis
6. Reporting
Analysis• Descriptive analysis each
year– small number of participants
• Comprehensive statistical analysis year 3– pool all students– T test (SPSS)
NSF CISE REU Sites PI Meeting 2010
Evaluation Step 6
Evaluation
Cookbook
1. IRB approval
2. Application
3. Project Goals
4. Assessment
5. Analysis
6. Reporting
Reporting
• NSF Annual Reports
• Dissemination– toolkit– publications
NSF CISE REU Sites PI Meeting 2010
Table Working Groups
• Table discussions (10 minutes)
• Group discussion (15 minutes)
CISE REU Evaluation Toolkithttp://www.cs.uncc.edu/reu/toolkit/
