Embed Size (px)
Citation preview
KEEP Debriefing 2014February 19, 2014
Newman University, Wichita, KS
KSDE: Bill Bagshaw, Assistant Director, TLA and Kayeri Akweks, EPC, TLAShelley H. Billig, PhD, Vice President, RMC Research Corporation
Trudy L. Cherasaro, PhD, Senior Researcher, Marzano Research Laboratory
Welcome to KEEP Debriefing 2014
• Introductions • Review the Agenda• Coffee, Water, Facilities• Lunch Location – Newman University Student
Union Cafeteria• Breaks
KEEP - Instructional Practice Protocol
Teacher Survey Results
67%
21%
0%
1% 0%
10%
Who conducted your evaluation? (n=831)
Principal
Assistant principal
Human resources staff
District superintendent
District curriculum director
Other
18%
10%
21%13%
12%
26%
Number of Years Teaching(n=831)
1-2 years3-4 years5-10 years11-15 years16-20 yearsMore than 20 years
What grade level(s) do you currently teach? n=830
Grade NumberEarly Childhood 17Kindergarten 1271st Grade 1352nd Grade 1333rd Grade 1364th Grade 1355th Grade 1346th Grade 1427th Grade 1688th Grade 1749th Grade 19110th Grade 21811th Grade 22712th Grade 207Other 46
Content Area NumberLanguage Arts/Reading 340Math 320Science 277Social Studies 281Art 78Health 71Physical Education 49Music 33Technology 128World Languages 21Other 75
What subject/content area do you currently teach? n=831
Role NumberClassroom teacher 648ELL Teacher 16Special Education Teacher 73Intervention Teacher 42Librarian 15Gifted and Talented Teacher 5Other 69
What is your current role? n=831
guide professional learning
provide accurate portrayal of teaching
results in instructional improvement
provide accurate ratings
provide useful information
identify areas of improvement
identify areas of strength
focus on aspects of quality teaching
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
11
12
11
14
10
12
12
12
8
10
6
8
9
5
5
5
17
21
18
19
20
18
17
13
45
38
42
36
37
40
39
36
19
19
23
23
24
25
28
34
To what extent does the KEEP evaluation system:(n=~816)
% Don't know % Not at all % A little % Somewhat % A lot
had an evaluation system defined enough for consistent ratings
would have given similar ratings if he/she examined different evidence
observed me on a typical day
had sufficient understanding of the curriculum observed
had sufficient understanding of evaluation criteria
had sufficient knowledge of my teaching position
had sufficient knowledge of how students learn
0% 20% 40% 60% 80% 100%
10
11
12
9
9
8
9
15
5
5
7
4
6
3
25
14
12
11
10
7
6
50
70
71
73
78
79
83
My evaluator: (n=~808)
% Not Applicable % Disagree/Strongly Disagree % Neither Agree nor Disagree%Agree/Strongly Agree
instructional strategies to improve teaching
classroom strategies to improve teaching
suggestions to improve content/knowledge
conversations about growth in professional responsibilty
0%10%
20%30%
40%50%
60%70%
80%90%
100%
16
16
16
15
11
12
12
7
16
15
15
14
28
28
26
22
29
30
31
42
To what extent to did your evaluator's feedback include:(n=~793)
% Not Applicable % Never/Rarely % Sometimes % Occasionally % Often
Answer NumberNo 126Yes, hosted by KSDE 40Yes, hosted by my district 460Yes, hosted by my school 296Yes, hosted by another source 13
Did you attend an orientation to KEEP? n=831
33%
12%9%
46%
Did your KEEP orientation provide you with the information you needed to un-derstand the KEEP system?
(n=757)
Not at all A little
Somewhat A lot
Goal Setting
Teacher evaluation rubrics
Observation process
Timelines
Process for collecting evidence
Summary rating process
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
9
11
12
17
19
21
37
40
38
42
48
44
48
42
43
36
29
31
6
6
7
5
4
4
How would you rate your level of understanding of the KEEP processes? (n=~806)
% Little to No Understanding % Some Understanding % Good Understanding% Excellent Understanding
Innovative applications of content knowledge
Learner development
Assessment
Instructional strategies
Learner differences
Planning for instruction
Collaboration and leadership
Reflection and continuous growth
Learner environment
Content knowledge
0%10%
20%30%
40%50%
60%70%
80%90%
100%
6
6
5
6
5
5
6
5
5
5
20
18
17
16
17
15
18
16
13
12
60
59
59
59
57
60
55
58
58
57
14
18
19
19
20
20
21
21
24
26
Rate your understanding of each of the KEEP components(n =~802)
%Little to No Understanding % Some Understanding % Good Understanding% Excellent Understanding
10%
30%
53%
7%
Was the website easy to navigate?n=638
Not at AllA LittleSomewhatA Lot
78%
22%
Have you accessed the KEEP website?(n=811)
YesNo
10%
30%
53%
7%
Does the website provide you with the information you need about KEEP?
(n-638)
Not at AllA LittleSomewhatA Lot
Principal Survey Results
18
12
29
17
13
12
Years Experience as Principal (n=108)
1-2 years3-4 years5-10 years11-15 years16-20 yearsMore than 20 years
Grade Level NumberPreK 21Primary 52Intermediate 50Middle School 36High School 42
What grade levels does your building serve? Did you attend training on the KEEP system for evaluating teachers?
Answer NumberI did not attend KEEP training. 9
I attended training provided by the state. 52
I attended training provided by my district. 63
I attended training provided by another source. 20
Guide professional learning?
Provide an accurate measure of effective teacher practice?
Provide an accurate portrayl of your evaluatees' teaching?
Result in accurate identification of areas of strength?
Provide you, as an administrator, with useful information to improve practice?
Result in instruction improvement?
Focus on the most important aspects of quality teaching?
0% 20% 40% 60% 80% 100%
3
5
4
4
3
6
4
5
4
4
3
4
4
3
15
13
18
11
15
12
10
48
47
43
45
40
40
34
29
31
32
37
38
38
49
To what extent does the KEEP teacher evaluation system:(n =~109)
% Don't Know % Not at all % A little % Somewhat % A lot
Collecting artifacts/sources of evidence.
Completing the summary rating form.
Conducting formal observations.
Conducting ongoing informal observations.
Conducting conferences with teachers.
0%10%
20%30%
40%50%
60%70%
80%90%
100%
17
9
7
6
5
45
35
28
26
23
28
39
45
48
46
10
17
19
19
26
How prepared are you for the following KEEP processes?(n =~109)
% Not prepared % Somewhat prepared % Mostly prepared % Completely prepared
Teacher evaluation rubrics
Process of collecting artifacts/sources of ecidence
Summary rating process
Observation process
Timelines
0%10%
20%30%
40%50%
60%70%
80%90%
100%
6
11
7
6
5
31
49
36
29
32
56
31
43
52
43
7
9
13
13
21
How would you rate your level of understanding of each of the following KEEP processes?
(n =~107)
% Little or no understanding % Some understanding % Good understanding% Excellent understanding
Conducting a formal observation
Completing the summary rating form
Conducting a conference with the evaluatee
Conducting an informal observation
0%10%
20%30%
40%50%
60%70%
80%90%
100%
1
6
5
31
2
22
31
32
33
27
31
15
44
29
22
8
20
16
12
13
Average number of minutes you are spending on : (n =~106)
% 15 min or less % 16 to 30 min % 30 to 45 min % 45 min to 1 hr % More than 1 hr
