20
Using edTPA Official Scoring Data to Inform Program Improvement and Identify Candidate Support Needs Elisa Palmer Illinois State University

Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Using edTPA Official Scoring

Data to Inform Program

Improvement and Identify

Candidate Support Needs

Elisa Palmer

Illinois State University

Page 2: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Ways to Break Down

edTPA Data Composite Scores

Task Scores

Rubric Scores

Page 3: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Use of Composite Scores Pass rate of candidates

Prediction of retake needs

Snapshot of program effectiveness

Page 4: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Use of Task Scores Determine candidate’s overall areas of strength and

challenge

Can be used to determine which task to retake

Can be used to advise a candidate as to future professional development needs

Determine general areas of need for teacher candidate support

Identify professional development areas for faculty and staff

Page 5: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Sample Candidate Profile

Rubric 1

Rubric 2

Rubric 3

Rubric 4

Rubric 5

Rubric 6

Rubric 7

Rubric 8

Rubric 9

Rubric 10

Rubric 11

Rubric 12

Rubric 13

Rubric 14

Rubric 15

Composite Score

2 3 2 3 3 3 1 1 1 2 3 2 2 3 3 34

Task 1 = 13 Task 2 = 8 Task 3 = 13

Page 6: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Sample Candidate

Profiles Rubric

1 Rubric

2 Rubric

3 Rubric

4 Rubric

5 Rubric

6 Rubric

7 Rubric

8 Rubric

9 Rubric

10 Rubric

11 Rubric

12 Rubric

13 Rubric

14 Rubric

15 Composite

Score

3 3 3 3 3 5 4 5 5 4 2 2 2 2 2 48

Rubric 1

Rubric 2

Rubric 3

Rubric 4

Rubric 5

Rubric 6

Rubric 7

Rubric 8

Rubric 9

Rubric 10

Rubric 11

Rubric 12

Rubric 13

Rubric 14

Rubric 15

Composite Score

3.5 3.5 3 3 3.5 3 2 3 3.5 3.5 3.5 3.5 2.5 2.5 3.5 47

Task 1 = 15 Task 2 = 23 Task 3 = 10

Task 1 = 16.5 Task 2 = 15 Task 3 = 15.5

Page 7: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Use of edTPA Rubric

Scores #1

Use proficiency rate to

target supports in

programs and unit

Page 8: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

edTPA Rubric Blueprint

8

Task name: Rubric Title

Guiding Question

Level 1 Level 2 Level 3 Level 4 Level 5

Struggling

candidate,

not ready to

teach

Some skill

but needs

more practice

to be teacher-

of-record

Acceptable

level to begin

teaching

Solid

foundation

of knowledge

and skills

Stellar

candidate

Page 9: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Mean

Sco

re

edTPA Rubric

Mean edTPA Score by Rubric

Page 10: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

0%

20%

40%

60%

80%

100%

120%

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

Pro

fici

en

cy R

ate

edTPA Rubric

2013-14 edTPA Proficiency Rate by Rubric

Page 11: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Outcomes Professional development modules that target areas of

challenge

Strategic backwards mapping of edTPA-related terms

and activities in the curriculum

Revision of clinical reflections and assignments

Effective use of limited program resources

Page 12: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Use of edTPA Rubric

Scores #2

Compare candidate rubric

performance to feedback

about edTPA experience

Page 13: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Teacher Candidate Exit

Survey Candidates were asked to rate their perceptions of the

difficulty of various aspects of completing the edTPA

portfolio

Page 14: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Sample Task Statements Identifying students’ personal/cultural/community assets.

Designing assessments to monitor student learning throughout the learning segment.

Getting video permission slips signed and returned.

Selecting and trimming desired video clip(s).

Justifying your proposed instructional changes with research.

Explaining how students were to use feedback to improve their learning.

Supporting your responses with evidence from analysis of student learning and/or student work sample(s).

Page 15: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Comparing Survey Results

to edTPA Rubric Scores We correlated the individual task statements with

relevant edTPA rubric.

We then compared the teacher candidates’ perception of the task’s difficulty with their proficiency on the corresponding rubric.

Found “discrepancies” between candidates’ reported perceptions and rubric scores in Rubrics 10-15.

Page 16: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Use of edTPA Rubric

Scores #3 Use edTPA rubric scores to advise teacher

candidates as to future professional

development needs

Discuss with teacher candidates how they can

use the edTPA score feedback in interviews

and other discussions about their professional

performance

Page 17: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Sample Candidate

Profiles Rubric

1 Rubric

2 Rubric

3 Rubric

4 Rubric

5 Rubric

6 Rubric

7 Rubric

8 Rubric

9 Rubric

10 Rubric

11 Rubric

12 Rubric

13 Rubric

14 Rubric

15 Composite

Score

3 3 3 3 3 5 4 5 5 4 2 2 2 2 2 48

Rubric 1

Rubric 2

Rubric 3

Rubric 4

Rubric 5

Rubric 6

Rubric 7

Rubric 8

Rubric 9

Rubric 10

Rubric 11

Rubric 12

Rubric 13

Rubric 14

Rubric 15

Composite Score

3.5 3.5 3 3 3.5 3 2 3 3.5 3.5 3.5 3.5 2.5 2.5 3.5 47

Page 18: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Use of edTPA Rubric

Scores #4 Identify possible task(s) to

retake

Use rubric scores to determine professional development or support needs during retake process

Page 19: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Rubric 1

Rubric 2

Rubric 3

Rubric 4

Rubric 5

Rubric 6

Rubric 7

Rubric 8

Rubric 9

Rubric 10

Rubric 11

Rubric 12

Rubric 13

Rubric 14

Rubric 15

Composite Score

2 3 2 3 3 3 1 1 1 2 3 2 2 3 3 34

Page 20: Using edTPA Official Scoring Data to Inform Program ... · Professional development modules that target areas of challenge Strategic backwards mapping of edTPA-related terms and activities

Questions? Contact Information…

Elisa Palmer

[email protected]