Embed Size (px)
DESCRIPTION
2014 California STEM Summit
Citation preview
CALIFORNIA DEPARTMENT OF EDUCATIONTom Torlakson, State Superintendent of Public Instruction
The Next Generation of Assessments in STEM Fields:
A New Paradigm for Understanding and Improving Student Learning
Diane Hernandez, DirectorAssessment Development and Administration Division
2014 STEM Summit
TOM TORLAKSONState Superintendent of
Public Instruction
Overview of Presentation
• Assembly Bill (AB) 484– Smarter Balanced Field Test– Requirements for science assessment
• 2013-14 science testing
• Science computer-based tryout
2
TOM TORLAKSONState Superintendent of
Public Instruction
Assembly Bill 484
• Assembly Bill (AB) 484, chaptered into law October 2, 2013, established the Measurement of Academic Performance and Progress (MAPP). Through regulation, the name has been changed to the California Assessment of Student Performance and Progress (CAASPP).
• CAASPP replaces the Standardized Testing and Reporting (STAR) Program.
• Among the requirements set forth in AB 484 is the requirement that local educational agencies (LEAs) participate in the Smarter Balanced Field Test. 3
Smarter Balanced Assessment System
4
Common Core State Standards
specify K–12
expectations for
college and career
readiness
Common Core State Standards
specify K–12
expectations for
college and career
readiness
All students
leave high
school ready for college
and career
All students
leave high
school ready for college
and career
Teachers and schools have
information and tools they need
to improve teaching and
learning
Interim assessments
flexible, open, used for actionable
feedback
Summative assessments
benchmarked to college and career
readiness
Formative assessment tools
and practicesfor teachers to
improve instruction
TOM TORLAKSONState Superintendent of
Public Instruction
Smarter Balanced Field Test
• The Field Test measures student achievement of the English language-arts (ELA) and mathematics Common Core State Standards.
• Participants include students in grades 3-8, 11 and a small sample of students in grades 9 and 10.
• The field test is estimated to take approximately 3.5 hours though it is untimed.
• Students exempt from participation in the field test:– Students who take the California Alternate
Performance Assessment (CAPA).– For ELA only, English learners who have
attended school in the United States for less than 12 months
5
TOM TORLAKSONState Superintendent of
Public Instruction
Adjustment to the Spring 2014 Field Test Assessment Plan
• On November 20, 2013, the State Superintendent of Public Instruction (SSPI) announced to LEAs an adjustment to the field test assessment plan.
http://www.cde.ca.gov/nr/el/le/yr13ltr1120.asp
• Ninety-five percent of students will take a sample of items from both ELA and mathematics.
• The remaining five percent of students will take a sample of items in one subject, either ELA or mathematics.
• All students will complete one performance task in one subject.
6
TOM TORLAKSONState Superintendent of
Public Instruction
2014 Smarter Balanced Field Test Windows
• The field test will be administered March 18 through June 6, 2014.
• Each school has been assigned a six-week window within this time frame and may test anytime within that assigned window.
• On November 20, 2013, Educational Testing Service (ETS) released school testing window assignments and notified district testing coordinators.
• Test window assignments are available at http://www.startest.org/FT-windows2014.html.
7
TOM TORLAKSONState Superintendent of
Public Instruction
Smarter Balanced Field Test Preparation
•Sample test items and performance tasks
http://www.smarterbalanced.org/sample-items-and-performance-tasks/
•Practice test
http://www.smarterbalanced.org/practice-test/
•New training test
Link available this week
8
TOM TORLAKSONState Superintendent of
Public Instruction
New Training Test
• Purpose: Provide students with an opportunity to quickly become familiar with the software and interface features that will be used in the field test
• Grade bands:– 3-5, 6-8 and high school
• 6-9 items per grade band per content area • No performance tasks• Includes new item types:
– Matching tables (ELA and math) – Fill in tables (math) – Evidence-based selected response (ELA)
• Includes all universal tools, designated supports and accommodations 9
Comparison of Training Test and Practice Test
Training Test Practice Test
Purpose
Provide students with an opportunity to quickly become familiar with the software and interface features
Provide students with a grade specific testing experience that is similar in structure and format to the field test
Grade Levels
3 grade bands •3–5 •6–8•High school
Each grade•3–8, 11
Number and Types of Items
Approximately 15 items per grade band (6 in ELA and 8–9 in math)
No performance task (PT)
Approximately 30 items in ELA and 30 items in math per grade level
Includes 1 ELA PT and 1 math PT per grade level
Universal Tools, Designated
Supports, and Accommodation
s
All included on Field Test are included
Most included Refresh scheduled for late April
ScoringItems are not scored Items are not scored, however
answer keys and scoring rubrics are available
TOM TORLAKSONState Superintendent of
Public Instruction
The Assessment of Science
11
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessments for the 2013–14 School Year
Grade-level tests in grades 5, 8, and 10: California Standards Tests (CSTs) California Modified Assessment (CMA) California Alternate Performance Assessment
(CAPA)These are required tests; paper-pencil tests only.End-of-course (EOC) CSTs in Biology, Chemistry, Physics, and Integrated Science 1-4, are not required, are available for purchase through ETSTests administered until there are successor science tests
12
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessment Development
ESEA Assessments Aligned to the NGSS:•The SSPI is required to:
As soon as is feasible after the adoption of the Next Generation Science Standards (NGSS), make recommendations regarding the assessment of the newly adopted science standards
When developing the recommendations, consult with stakeholders regarding the content, type of assessment, and grade level
13
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessment Development (cont.)
• The SSPI is required to: Include in the recommendations, an
implementation plan of at least one assessment in each grade span:
Grades 3 to 5, inclusive
Grades 6 to 9, inclusive
Grades 10 to 12, inclusive
14
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessment Development (cont.)
Additional (non-ESEA) Assessments Aligned to the NGSS:•The SSPI is required to:
No later than March 1, 2016, make recommendations to the SBE on expanding the CAASPP program to include additional assessments that would augment assessments in science and other subject areas
When developing the recommendations, consult with stakeholders regarding the content, type of assessment, and grade level
15
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessment Development (cont.)
• Recommendations shall include a: Consideration of the assessments already being
administered or planned to be used Consideration of the use of consortium-
developed assessments, various item types, computer-based testing, and a timeline for implementation
16
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessment Development (cont.)
• Recommendations shall include: Assessments by grade level, content, and type
of assessment A timeline for test development and
implementation and an assessment calendar or multi-year schedule for each assessment or test
• Recommendations may also address the use of various assessment options such as computer-based testing, performance tasks, and portfolios
17
TOM TORLAKSONState Superintendent of
Public Instruction
AB 484: Science Assessment Development (cont.)
• Science assessment stakeholder groups will include: California science teachersIndividuals with expertise in assessing English
learners and students with disabilities Measurement experts Parents Other groups or individuals
18
TOM TORLAKSONState Superintendent of
Public Instruction
2014 Science Stakeholder Meetings
• Process leading to science assessment recommendations
• CDE and ETS drafting a plan that includes: Goals Participants and nature of meetings Meeting schedules and timeline of activities Recommendations
19
TOM TORLAKSONState Superintendent of
Public Instruction
Science Computer-Based Test (CBT) Tryout
• Main purpose was to: Collect data about the readiness of California
schools and districts to administer computer-based science assessments
Try out items that would assess science inquiry standards that could not be assessed using the paper-pencil format
• Administered in October 2012 to a statewide representative sample of 21,473 students from 193 schools and 133 LEAs
20
TOM TORLAKSONState Superintendent of
Public Instruction
Science CBT Tryout–Data Collection
• Science Tests: Grades 5 and 8 Science High School Biology
• Item Types Per Test: 40 single select multiple-choice (MC) items 20 technology-enhanced (TE) items
Drag-and-drop & hotspot functionality Simulations Artificial intelligence scoring
21
TOM TORLAKSONState Superintendent of
Public Instruction
Science CBT Tryout–Data Collection (cont.)
• Data also collected through: Surveys Site visits: Test administration observations Interviews: Student, teacher, and administrator
22
TOM TORLAKSONState Superintendent of
Public Instruction
Science CBT Tryout–Key Findings
• Over 60 percent of sample schools indicated being either “somewhat” or “very” prepared for Science CBT
• Positive experience for students and educators
• MC items performed similarly in the CBT compared to paper/pencil administration
• TE items relatively more difficult than traditional MC items
23
TOM TORLAKSONState Superintendent of
Public Instruction
Science CBT Tryout– Key Findings
• Performance most likely impacted by: Zero-stakes nature of the test Student demographics Student exposure to computer technology Student and educator attitude towards CBT Educator experience with CBT
• Most schools preferred a hybrid test of CBT and paper-pencil
• Note: Full CBT Tryout report located at: http://www.cde.ca.gov/ta/tg/sr/technicalrpts.asp
24
TOM TORLAKSONState Superintendent of
Public Instruction
For Further Information
CDE Assessment Development and Administration (ADAD) Division
916-319-0803
CDE California Assessment of Student Performance and Progress (CAASPP) Office
CDE Support and Outreach Office916-445-8517
ETS California Technical Assistance Center (CalTAC)[email protected]
http://californiatac.org25
![STORMLab for STEM Education - Vanderbilt University€¦ · students enrolled in STEM fields, this will result in about 2.4 million STEM job vacancies by 2018 [2]. Therefore, increasing](https://img.pdfslide.us/doc/110x75/5fc90b0c14ef0f43a247f328/stormlab-for-stem-education-vanderbilt-university-students-enrolled-in-stem-fields.jpg)
