Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data
Course: CEM Information Systems for Beginners and New Users
Day 1 Session 2Wednesday 17th October 2012
Peter Hendry: CEM Consultant
‘Everything should be made
as simple as possible but not
simpler’
Albert Einstein
A well known person
‘The goal is to transform data
into information, and information
into insight’
‘Carly Fiorina’
Ex-president and Chair of Hewlett-
Packard
Bands, percentiles, standardised scores…
0
50 60 70 80 90 100 110 120 130 140 150
Standardised scores
DC B
A
105 20 301 40 90 958070 996050Percentiles:
National Quartile Ability Bands
BASELINE D C B A
ALIS: AV GCSE <5.0 5.0-5.7 5.7-6.55 >6.55
Yellis % >43 43-52 52-61 >61
STANDARDISED CABT MidYIS, Yellis and Alis <90 90-100 100-110 >110
IN ANY COHORT, 25% OF THE POPULATION WILL BE IN EACH BAND.
THE VALUES MAY VARY SLIGHTLY FROM YEAR TO YEAR
BANDS
Nationally, 25% in each band
Alis: year 12 students, two baseline profiles for the same school
Band Profile Graph: all MidYIS cohort
Checking this graph each year will give you an immediate overview of your intake.
A school with a ‘completely average’ intake would have 25% of pupils within each band.
Band D Band A
3526
21 17
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Maths: Percent in each BandYear 7 MidYIS Test 2011/2012
17
37
2025
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Vocabulary: Percent in each BandYear 7 MidYIS Test 2011/2012
Band A Band ABand D Band D
Comments?
1121
33 35
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Non-Verbal: Percent in each BandYear 7 MidYIS Test 2011/2012
2924 26
21
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Skills: Percent in each BandYear 7 MidYIS Test 2011/2012
2924 26
21
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Skills: Percent in each BandYear 7 MidYIS Test 2011/2012
38
2619 17
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Proof Reading: Percent in each BandYear 7 MidYIS Test 2011/2012
24 23 2330
0
10
20
30
40
50
60
70
80
90
100
D C B A
Perc
ent
Perceptual Speed & Accuracy: Percent in each BandYear 7 MidYIS Test 2011/2012
Vocabulary Maths Non Verbal Skills MidYIS Score
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
Average 100.6 95.9 105.3 99.2 98.1
St. error 1.1 1.1 1.1 1.1 1.1
On another day, with 95% certainty, the score of 100.6 (+/- 1.1 x 2) • would not be higher than 100.6 + 2.2 = 102.8• would not be lower than 100.6 – 2.2 = 98.4
Standardised Scores Sort Data By...
Mean Score: 100
Standard Deviation: 15
Scores Standardised On A Nationally Representative Sample of Schools
Vocabulary Maths Non Verbal Skills MidYIS ScoreSt
. Sco
re
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
100.6 95.9 105.3 99.2 98.1
1.1 1.1 1.1 1.1 1.1
134 A 119 A 116 A 87 D 130 A95 C 97 C 88 D 85 D 95 C99 C 104 B 112 A 110 B 101 B93 C 94 C 120 A 91 C 93 C
116 A 99 C 118 A 84 D 109 B93 C 95 C 120 A 113 A 93 C92 C 83 D 112 A 94 C 87 D
102 B 102 B 112 A 108 B 102 B
Proof Reading PSA
St. S
core
Ban
d
St. S
core
Ban
d
93.7 102.2
1.1 1.1
101 B 83 D76 D 93 C97 C 114 A80 D 99 C
102 B 78 D119 A 107 B80 D 102 B
106 B 107 B
Scores over 130 – top 2% nationally
Scores over 126 – top 5% nationally
Scores over 120 – top 10% nationally
Scores over 110 – top 25% nationally
Using national baseline test scores to Identify Gifted Pupils
Year 7: the ‘top’ students
Vocabulary Maths Non Verbal Skills MidYIS ScoreSt
. Sco
re
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
St. S
core
Ban
d
100.6 95.9 105.3 99.2 98.1
1.1 1.1 1.1 1.1 1.1
150 A 150 A 142 A 150 A 150 A122 A 132 A 130 A 150 A 130 A134 A 119 A 116 A 87 D 130 A120 A 123 A 110 B 132 A 123 A127 A 113 A 122 A 95 C 123 A117 A 121 A 116 A 109 B 121 A117 A 120 A 120 A 128 A 120 A125 A 111 A 114 A 100 B 120 A
146 146145 146101 83124 129109 89
Proo
f rea
ding
Perc
eptu
al s
peed
an
d ac
cura
cy
50 60 70 80 90 100 110 120 130 140 150 Standardised Test Score
Stanine 1
2 3 4 5 6 7 8 9
4% 4 % 7% 7% 12% 12% 17% 17% 20%
Individual Pupil Record 75Date Of Birth: 24/12/97 Student Number:Sex: F Form:
Band Stanine Percentile Standard Score
Vocabulary B 5 53 101
Maths B 5 52 101
Non-Verbal C 5 46 98
Skills C 5 46 99
MidYIS Score B 5 52 101
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
106 B 96 CProof Reading PSA
A relatively lower vocabulary score might indicate a difficulty which:
• could contribute to under-performance in most, if not all subjects
• might lead to ‘stressful situations’
• may lead to further investigation and subsequent pupil support
Individual Pupil Record ZUHA OKARVIDate Of Birth: 15/10/98 Student Number:Sex: F Form: 8C
Band Stanine Percentile Standard Score
Vocabulary C 4 35 94
Maths B 6 75 110
Non-Verbal B 6 63 105
Skills A 7 84 115
MidYIS Score B 5 54 102
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
Individual Pupil Record RAWAD OKBIDate Of Birth: 29/08/99 Student Number:Sex: M Form: 8E
Band Stanine Percentile Standard Score
Vocabulary D 3 20 87
Maths B 5 58 103
Non-Verbal B 6 67 107
Skills B 6 71 108
MidYIS Score C 4 34 94
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA Proof Reading PSA121 A 108 B 88 D 118 A
A relatively low maths score might indicate potential weaknesses in subject areas which require:
• numerical skills
• logical thinking
• skills such as sequencing
CONVERSELY: a high maths score but a low vocab/reading score…….
Individual Pupil Record RACHEL STRONACHDate Of Birth: 13/1/99 Student Number:Sex: F Form: 8E
Band Stanine Percentile Standard Score
Vocabulary B 6 63 105
Maths D 3 15 84
Non-Verbal A 6 76 111
Skills B 6 67 107
MidYIS Score C 4 37 95
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
Individual Pupil Record CAMERON BALLDate Of Birth: 29/10/98 Student Number:Sex: M Form: 8E
Band Stanine Percentile Standard Score
Vocabulary C 5 45 98
Maths A 9 99 135
Non-Verbal C 4 39 96
Skills B 6 74 110
MidYIS Score A 7 87 117
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
A relatively high non-verbal score might indicate potential strengths in subject areas which require:
• 3d, and 3d into 2d, visualisation
• Spatial awareness
• Understanding images in 2d representing 3d
• Extracting information from visual images
• Science, D and T, Art, Geography……
and vice versa
Individual Pupil Record SULAIMAN BAHELMIDate Of Birth: 23/2/99 Student Number:Sex: M Form:
Band Stanine Percentile Standard Score
Vocabulary A 7 81 113
Maths B 6 66 106
Non-Verbal D 3 18 86
Skills B 6 68 107
MidYIS Score A 7 77 111
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
Date Of Birth: Student Number:Sex: M Form: 7E
Band Stanine Percentile Standard Score
Vocabulary C 4 32 93
Maths C 4 34 94
Non-Verbal A 8 91 120
Skills C 4 28 91
MidYIS Score C 4 31 93
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
A relatively low skills score might indicate potential weaknesses such as:
• Speed of processing/working
• Potential underperformance in test/examination conditions
• Poor written work (SPG etc.)
and vice versa
Date Of Birth: Student Number:Sex: M Form: 7Y
Band Stanine Percentile Standard Score
Vocabulary A 9 99 134
Maths A 8 90 119
Non-Verbal A 7 85 116
Skills D 3 20 87
MidYIS Score A 9 98 130
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA
Sex: M Form:
Band Stanine Percentile Standard Score
Vocabulary C 5 50 100
Maths A 8 89 119
Non-Verbal B 5 54 102
Skills B 6 61 104
MidYIS Score B 6 72 109
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA101 B 83 D 83 D 114 A
SEN use of MIDYIS test results
Analysis of baseline test individual skill profiles to indicate potential areas of learning difficulties
e.g. If the two lowest scores are the vocabulary and skills section and are, or close to being, statistically significant (see IPR)
• Then the student might be dyslexic.......
• Follow-up with appropriate diagnostic tests…..
Individual Pupil Record LAUREN BAKERDate Of Birth: 28/11/99 Student Number: J870396003050Sex: F Form: 7C
Band Stanine Percentile Standard Score
Vocabulary C 4 27 91
Maths B 6 68 107
Non-Verbal B 6 75 110
Skills D 2 10 81
MidYIS Score C 5 45 98
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Natio
nally
Sta
ndar
dise
d Sc
ores
Nationally Standardised Scores with 95% Confidence Band
INSIGHT Pupil IPR
Band Stanine Percentile Standard Score
KS3 Equivalent
Speed Reading B 6 69 107 6c
Text Comprehension B 5 60 104 5a
Passage Comprehension C 5 45 98 5b
Overall Reading B 5 59 103 5a
Number & Algebra D 3 19 87 4a
Handling Data B 6 61 104 6a
Space, Shape & Measures D 4 23 89 5c
Overall Mathematics C 4 31 93 5b
Biology A 7 82 114 6a
Chemistry A 9 96 127 7a
Physics A 8 89 118 7c
Overall Science A 8 93 122 7b
Vocabulary B 6 65 106
Non Verbal B 6 70 108
Skills A 8 92 121
Overall Ability C 4 36 94
40
60
80
100
120
140
160
Spee
d R
eadi
ng
Text
Com
preh
ensi
on
Pass
age
Com
preh
ensi
on
Ove
rall
Rea
ding
Num
ber &
Alg
ebra
Han
dlin
g D
ata
Spac
e, S
hap
e &
Mea
sure
s
Ove
rall
Mat
hem
atic
s
Bio
logy
Ch
emis
try
Phys
ics
Ove
rall
Sci
ence
Voc
abul
ary
No
n Ve
rbal
Skill
s
Ove
rall
Abi
lity
Stan
dard
ised
Sco
res
Standardised Scores With 95% Confidence Band
N2a
c3bac
4bac
5bac
6bac
7bac
8ba
Spee
d R
eadi
ng
Text
Com
preh
ensi
on
Pass
age
Com
preh
ensi
on
Ove
rall
Rea
ding
Num
ber &
Alg
ebra
Han
dlin
g D
ata
Spac
e, S
hape
& M
easu
res
Ove
rall
Mat
hem
atic
s
Biol
ogy
Che
mis
try
Phys
ics
Ove
rall
Scie
nce
KS3
Leve
lKS3 Equivalent Levels with 95% Confidence Band
IPRs in KS3 Levels
NATIONAL AVERAGE