19
Progress in Reading Assessment (PiRA) Second edition Interim Manual for Autumn tests – Years 1 & 2 (updated) Colin McCarty & Kate Ruttle

Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Embed Size (px)

Citation preview

Page 1: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Progress in Reading Assessment (PiRA)

Second edition

Interim Manual for Autumn tests – Years 1 & 2 (updated)

Colin McCarty & Kate Ruttle

Page 2: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 2

Contents 1 Introduction 3

This interim manual for PiRA Autumn What is PiRA? Why use PiRA? Measuring and following progress using PiRA Progression in reading demand in PiRA

2 Administering the PiRA tests 6 When to test Group size Timing Preparation Administering the tests

3 Answers and mark schemes 8

Marking the answers Finding the total raw score Obtaining other scores Answers and mark scheme: PiRA 1 Autumn Answers and mark scheme: PiRA 2 Autumn

4 Obtaining and interpreting test scores 13 Summative measures Diagnostic and formative interpretation

5 Standardised score tables 17

Age-standardised scores Standardised scores

Page 3: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 3

1 Introduction

This interim manual for PiRA Autumn This free teacher guidance provides everything you need to administer and mark the Autumn tests. More extensive teacher guidance, including information relating to the PiRA Spring and Summer tests will be provided in the full PiRA Manuals – Stages 1 and 2, which will be published in January 2016, together with the PiRA tests for Spring and Summer. The PiRA Manuals will also include the following information, to assist you when using PiRA across the whole school year: • Diagnostic and formative information • Pupil profile sheets for each term, to enable you to review patterns of strengths and

weaknesses across the year • Further information about interpreting and analysing results • Technical information about the standardisation and equating study • Answers and mark schemes for the PiRA Spring and Summer tests. In the meantime, should you have any queries about using the PiRA Autumn tests, please email [email protected]. What is PiRA? This is the second edition of Progress in Reading Assessment (PiRA). It provides a termly standardised assessment of a pupil’s reading attainment, plus a profile of reading skills, which helps you identify those pupils who may need further teaching and practice, as well as enabling you to celebrate success. Separate tests are available for the spring and summer terms in Reception and for each of the autumn, spring and summer terms in Years 1–6. PiRA is designed for whole-class use, with pupils of all abilities. This new edition retains all the texts of the original edition, but about 20 per cent of the questions have been replaced so that it fully matches the 2014 National Curriculum and the content domain-assessable elements of the reading test framework. The new questions have been written to reflect the styles of questions exemplified in the test framework. The tests provide thorough coverage of the new National Curriculum Programme of Study for each year. This has been assured by systematically sampling Key Stage 1 and 2 performance descriptors for English using the 2015 reading test framework and being informed by the sample material for the Key Stage 1 and Key Stage 2 national tests. A sophisticated equating exercise was carried out for each termly test between January and July 2015 (comprising over 5,000 pupils), to ensure that the marks pupils obtain on each new PiRA test are equated to the marks they gained in the original tests. This enables continuity of data for schools using the new edition of PiRA. Further details of this process will be provided in the technical chapter of the full published manual.

Page 4: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 4

Why use PiRA? PiRA provides reliable summative information. For example: • It provides three carefully designed tests for each year, enabling you to follow the progress of

your pupils from term to term, as well as year to year throughout primary school. • Marks have been calibrated onto the Hodder Scale, which is an independent measure of

progress throughout primary. This enables you to follow progress term by term and compare progress to national norms. It allows you to predict what score pupils should obtain in subsequent terms and so set meaningful targets.

PiRA also has a diagnostic capability, enabling you to investigate the strengths and weaknesses of your pupils’ reading skills. PiRA tests give you five distinct types of information to inform you of each child’s, class’s and cohort’s progress:

• age-standardised scores, which take into account a pupil’s chronological age so that you can

see how a pupil’s performance compares with other pupils of the same age; • standardised scores, which show the standard score for a year cohort; • reading age for a quick at-a-glance-reference; • performance indicators to help you make a judgement against the year-related expectations

of the 2014 National Curriculum; • the Hodder Scale, which is an independent measure of progress throughout primary.

To enable you to use the information in a diagnostic/formative way, total scores can be broken down into the following distinct aspects of reading.

Reading analysis Content domain reference

Comprehension 1b Inference 1d, 1e Language, structure and presentation 1a, 1c

Details of the content domain are given in the mark schemes, along with the reading analysis, which defines the relevant area of the curriculum. PiRA systematically assesses pupils’ reading of different text types or genres – fiction, various forms of non-fiction, poetry and playscripts – in line with national guidelines across the primary phase. You can also examine the performance of pupils on each question. Using the percentage of pupils that answered each question correctly in the national standardisation (technically, the facility value), you can easily compare the performance of your own pupils with those in the national sample. You will find facility values alongside every question in the mark scheme for the test. Measuring and following progress using PiRA The PiRA test results have been statistically linked from term to term and year to year to enable you to track or predict progress through the whole primary phase, using the Hodder Scale. This enables you to monitor and compare in detail individual patterns of performance against the norms and patterns for the term or year. The Hodder Scale acts as a common ‘spine’ on which all of the PiRA tests across the whole primary phase are plotted. It provides the statistical basis for predicting pupil progress and future attainment, based on the termly performance data of over 15,000 pupils nationally. The Hodder Scale is presented in Table 4.2.

Page 5: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 5

Profiling performance by category The reading category that the question focuses on is indicated by a code letter beneath each mark box. (We have used the abbreviations ‘comp’ for comprehension – literal understanding and retrieval from text; ‘inf’ for making inference – including prediction from text; and ‘lsp’ for language, structure and presentation – understanding structure and purpose of text.) If you wish to profile the pupil’s performance, add up the number of correct answers the pupil has obtained in each coded category and record these in the boxes at the bottom of the grid on the front cover. You can then compare the pupil’s performance to the national averages from the equating study, which are provided in a table beneath the mark scheme for each test. Progression in reading demand in PiRA Each test has been designed to ensure there is a steady progression in the demand of both the reading texts and the questions. We have evaluated the demand of each PiRA question, taking the DfE performance descriptors into consideration, as well as the ‘facility’ for each question (see below) and our own professional judgement. More detail will be provided about this in the full published manuals. Performance indicators We have provided an algorithmically derived set of thresholds that indicate where the child is with respect to the National Curriculum performance descriptors, by applying the summer standard for the whole year to a test being taken in the autumn or spring.

In the mark schemes, we have provided the facility for each question, which is the percentage success of children who took the test in the standardisation. (Note: a high facility indicates an easy question and a low facility a difficult question.) It is possible to set thresholds drawing on the performance of children in the equating standardisation trials, by using the facilities of the questions and applying a reasonable set of expectations (presented in the table below). Please note that these thresholds apply to the curriculum age-expectation for complete years. Therefore, in autumn they will be seen as very challenging and hard to achieve, but any child achieving the expected standard in autumn will be doing very well. This information is given at the end of the mark scheme for each year. It links the performance (facilities) to the language most commonly used to describe children’s performance (for example, ‘working towards’, ‘emerging’), based on our test-development experience.

Table 1.1: Thresholds for performance indicators

Working towards 90–100% success

(i.e. facility) Emerging 60–89% success Expected 20–59% success Exceeding 0–19% success

Our thinking is: to be at the ‘expected’ standard of performance, for example, children need to get 90 per cent of the ‘emerging’ questions of that term’s test correct, over 60 per cent of the ‘expected’ questions correct, all of the ‘working towards’ but none of the ‘exceeding’ questions. (The thresholds for ‘emerging’ and ‘exceeding’ will be explained in the full published manual.) There is no official definition or golden rule that gives us this. However, many years of working in test development and analysing related data have given us the considerable experience to create algorithms to produce thresholds. The critical factor is that the rule we use has to have a sense of reasonableness, that is to say it is based on our experience, which has been informed by discussions with a number of headteachers and literacy co-ordinators who concur with our thinking and methodology for creating a data-driven way to evolve thresholds.

Page 6: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 6

2 Administering the PiRA tests When to test • PiRA should ideally be used just before or shortly after the relevant half-term, as this exactly

mirrors when they were standardised and will therefore give the most dependable data.

Group size • You can administer the tests to whole classes or large groups, if you feel comfortable doing so.

With younger children, however, it may be better with small groups supported by a teaching assistant.

• In Year 1, it is permissible and often advisable to administer the tests in three sessions with breaks (so, a pair of pages at a time), but this should not normally be necessary at Year 2.

Timing • For the Year 1 tests, the time taken is controlled by the pace of the teacher’s delivery. A

maximum time limit of 40 minutes is set for the Year 2 tests. In practice, in all years, the time is likely to take less than 30 minutes for most pupils, unless they are particularly slow readers or hesitant pupils.

Preparation • Each pupil will need the appropriate test booklet plus a pencil or pen and an eraser. • The tests Year 1 and Year 2 use questions which are ‘embedded’ after short sections of reading

material, wherever possible on the same page spread, so that pupils are not required to hunt through the test for answers.

• Some questions are read aloud by the teacher to the pupils. Where relevant, a teacher's script is provided on the back cover of the test booklet.

• At Key Stage 1, the PiRA tests vary in their phonics content, and the text and questions to be read aloud to the pupils (and hence whether the children will be working at their own pace), so when explaining a test to the class you should always be guided by the particular test you are giving. Key points are:

- Tell pupils that they will be reading a number of short stories, poems and non-fiction texts,

and answering questions about them. - Tell them that some questions will be read to them, but others they will read for

themselves. (The details of this are given on the front cover of the test booklet, with any specific script on the back.)

- They should do their best to answer all the questions. Say that there will be some questions they will be able to do easily, but that the test tends to get harder towards the end. They should not worry if they find some questions difficult, but just try their best and move on to see if they can answer some of the following questions.

Administering the test • Give each pupil a test booklet. Ask them to write their names on the front cover − at

Key Stage 1, the other information is best supplied by the teacher or teaching assistant when marking the test.

• The general guideline is that all questions and instructions for you to read aloud are printed in colour, in a different, smaller font. Text and questions for the children to read themselves is printed in black.

Page 7: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 7

• In the Year 1 Autumn test, almost all of the questions are mediated orally, including all the phonics at the beginning of the test. Most of the reading-for-meaning questions are also introduced orally, to ensure pupils are not left struggling. A script is provided on the back page of the test for the phonics.

• In the Year 2 Autumn test, only the first one or two pages of the test (phonics) are mediated orally (see the details on the front of the test). Following this, the pupils are required to read the questions for themselves.

• Teachers should follow the relevant teacher’s scripts strictly, to ensure that results are both valid and reliable.

• If any pupils are not clear about what to do, you may give additional explanation to help them understand the requirements of the test, but do not read any of the actual questions, unless it is indicated they are to be mediated by a teacher or teaching assistant. Do not help with individual words.

• For the results to be reliable, it is important that pupils work alone, without copying or discussing their answers.

Page 8: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 8

3 Answers and mark schemes Marking the answers • Use the score box in the right-hand margin alongside each question in the test booklets to

record marks. • Follow the mark scheme carefully and use your professional judgement – some questions have

more than one part, or attract more than one mark. • For scores to be valid, you should not award half-marks. • Please use your professional judgement when marking, recognising that children often write

more words than the brief, crisp answers given in the mark scheme. • Capital letters are not required unless specifically stated in the mark scheme. • Do not penalise spelling: as long as the meaning is clear, always award the mark. • Where a question asks for, say, three answers ticked and a pupil ticks four, deduct one mark. Finding the total raw score • You can record total marks for the page at the bottom of each page in the test booklets. Then

add together the page scores to find each pupil’s total raw score and record this at the bottom of the front cover.

Obtaining other scores • Refer to the appropriate tables in this manual to obtain the standardised score,

age-standardised score, reading age, Hodder Scale score and performance indicator for each pupil.

Page 9: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 9

Answers and mark scheme: PiRA 1 Autumn

No. Answer Mark Content domain

reference

Reading analysis

Facility %

Early reading 1 bag and cat joined to correct pictures 1 1a lsp 81 2 The cat is eating. 1 1a lsp 74 3 banana and orange joined to correct

pictures 1 mark for each correct answer.

1 1

1a 1a

lsp lsp

84 83

4 boat and barn joined to correct pictures 1 mark for each correct answer.

1 1

1a 1a

lsp lsp

74 66

5 frogs 1 1b comp 61 6 fish in a child’s fishing net

Do not accept two lines – to net and fish above the net or a line down from the fish to the net.

1 1a

lsp 72

7 A bee can quack. buzz. An owl can A duck can hoot. 2 marks for three correct; 1 mark for one or two correct.

1 1

1a 1a

lsp lsp

71 63

total 10 Hen in the Shed

8 hen 1 1b comp 83 9 “I can not get into the shed” joined to the

fox. “I am going to sleep” joined to the hen.

1 1c lsp 68

10 fox 1 1a lsp 81 11 No

No No 2 marks for three correct; 1 mark for one or two correct.

1 1

1b 1b

comp comp

73 28

12 chick 1 1b comp 66 13 The chick will get out of the egg. 3

The chick is in the egg. 1 The chick will crack the egg. 2

1

1c lsp 27

14 Eggs and Chicks 1 1b comp 59 total 8 Bob’s Hat

15 red Accept red written in sentence.

1 1a lsp 60

16 To keep his hair dry. 1 1d inf 24 17 No

No No 2 marks for three correct; 1 mark for one or two correct.

1 1

1b 1b

comp comp

69 30

Page 10: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 10

18 paint, hat, coat, boots joined to or pointing at correct parts of picture. 1 mark for three or four correct answers. Do not accept lines from paint to clothes, hat and boots for the paint label.

1 1b comp 63

19 2 Bob got some paint. 3 Bob painted his boots black. Both required for the mark.

1 1c lsp 53

20 black 1 1d inf 42 total 7 Overall 25

Analysis of performance by category

Text type Questions Marks National average mark

Word reading 1–7 10 7.0 Story 8–14 8 4.7 Story 15–20 7 3.3

Total marks 25 Reading analysis Comprehension 10 6.5 Making inference 2 0.6 Language, structure and presentation 13 7.8

Raw score Performance indicator 0–3 Working towards

4–16 Emerging 17–22 Expected 23–25 Exceeding

Page 11: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 11

Answers and mark scheme: PiRA 2 Autumn

No. Answer Mark Content domain

reference

Reading analysis

Facility %

My Week 1 2 1 1b comp 52 2 sleep 1 1c lsp 63 3 pig 1 1d inf 45 4 It is where I eat. 1 1a lsp 59 5 It has rhyme.

It has rhythm. Both required for the mark.

1 1c lsp 9

6 hen Accept chicken, bird, snake, duck or spider

1 1b comp 82

7 horse 1 1d inf 48 8 stable 1 1b comp 51 9 course 1 1c lsp 45

total 9 Sam

10 Sam 1 1b comp 75 11 at school 1 1d inf 81 12 Arrows correctly labelled:

head (do not accept hair) ear or ears throat (do not accept neck)

1 1 1

1a 1a 1a

lsp lsp lsp

75 71 45

13 Any one from: looked up shook his head put his head down (on his hands) cry or cried Do not accept felt all wobbly or wants his mum.

1 1b comp 43

14 Mrs Jacobs boy Sam office lady Mrs Patel teacher All required for the mark.

1 1b comp 62

15 Mrs Jacobs was going to let him go home. 1 1b comp 58 16 Sam is ill. 1 1d inf 68

total 9 Motorbikes

17 On the Road 1 1b comp 35 18 12 or 13 1 1c comp 52 19 Motorbikes (accept Motorcycles) Capital

not required. 1 1b comp 58

20 4 or 5 1 1b comp 48 21 Either of:

Why do motorbike riders wear helmets? How do you steer a motorbike? Award no mark if more than one ticked unless both correct answers are ticked.

1 1d inf 29

Page 12: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 12

22 2 marks for three or four words appropriately linked; 1 mark for one or two words appropriately linked. Accept for handlebars the lump above the headlight.

1 1

1a 1a

lsp lsp

82 76

total 7 Overall 25

Analysis of performance by category Text type Questions Marks National average mark

Poem 1–9 9 5.8 Story 10–16 9 4.4 Non-fiction 17–22 7 2.3

Total marks 25 Reading analysis Comprehension 11 5.5 Making inference 5 2.5 Language, structure and presentation 9 4.6

Raw score Performance indicator 0–5 Working towards

6–16 Emerging 17–22 Expected 23–25 Exceeding

Page 13: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 13

4 Obtaining and interpreting test scores Summative measures The results obtained from PiRA will also enable you to report pupil performance in terms of: • age-standardised score (see Chapter 5) • standardised score (linked to the Hodder Scale; see Chapter 5) • reading age (Table 4.1) • the Hodder Scale (previously known as the PiRA Scale; Tables 4.2–4.3) • and new performance indicators (see Chapter 1). Age-standardised scores There are a number of advantages of using age-standardised scores for comparing summative performance. These include:

• They are standardised to an average score of 100, immediately showing whether a pupil is

above or below average, relative to PiRA’s national standardisation sample. • They allow comparisons to take into account the pupils’ ages: older pupils are likely to have

higher raw scores than younger pupils, but could have a lower age-standardised score. This enables you to rank pupils in order of achievement after age has been accounted for. (Note: with younger pupils, exposure to teaching is likely to have a significant if not a greater impact on achievement than the chronological age of the child.)

Standardised scores Standardised scores are also standardised to an average of 100. In many ways they are similar to age-standardised scores, except no allowance is made for the age of the child. They are useful to compare children from one cohort to another, but require that the children take the same test for this comparison to be made. We have taken standardised scores and linked them to the Hodder Scale to enable teachers to monitor progress term by term using the scale, and to predict progress too, which standardised scores are not designed to do. A simple way is to look up the marks and use the standardised scores (and Hodder Scale) in Chapter 5 and assume that all children within the range 90–110 of the mean (100) are at the appropriate level in that term and are on target to achieve the expected level at the end of the year. Please note that age-standardised and standardised scores are quite different measures and are calculated differently. (For example, if a class includes a significant number of older children, then an older child could have a high standardised score, but a lower age-standardised score.) Therefore it is not appropriate to relate a child’s age-standardised score to their standardised score. Further explanation about using and interpreting age-standardised and standardised scores will be provide in the full published PiRA manuals. Reading ages Many teachers use ‘reading ages’ as a quick reference: they show the average chronological age of the pupils who obtained each particular raw score (i.e. the chronological age at which this level of performance is typical). For more detailed comparative information, however, and especially for tracking progress over time, please refer to age-standardised scores.

Page 14: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 14

Table 4.1: Reading ages for PiRA 1 & 2 Autumn tests

PiRA 1 Autumn

raw score

Reading age

PiRA 2 Autumn

raw score

Reading age

1 1 2 2 3 3 <5:5 4 <4:6 4 5:5 5 4:6 5 5:6 6 4:7 6 5:9 7 4:9 7 5:11 8 5:0 8 6:2 9 5:2 9 6:4

10 5:4 10 6:7 11 5:7 11 6:9 12 5:9 12 6:11 13 5:11 13 7:2 14 6:2 14 7:4 15 6:4 15 7:7 16 6:7 16 7:9 17 6:9 17 7:11 18 6:11 18 8:0 19 7:0 19 >8:0 20 >7:0 20

Diagnostic and formative interpretation Summative measures are valuable, but only give an overall picture of the child’s performance relative to his or her peers. Such data may, for example, confirm that the pupil is doing well for his/her age and indicate that no intervention strategy is required. However, a more detailed check may show, for example, that good literal reading accuracy is masking a weakness in comprehension and inference. Profiling pupil performance You can analyse pupils’ performance in the different reading categories, to see if there are patterns of strengths and weaknesses.

You may also go one stage further and check a pupil’s individual performance on a specific question and compare how they have performed relative to other pupils in the same year group. Refer to the mark scheme to see what proportion of pupils in that year group answered each question correctly. This is called the facility and is shown as a percentage: 60 per cent shows that 60 per cent of pupils in the national sample answered the question correctly. Reporting progress using the Hodder Scale In developing the PiRA tests, seven cohorts of pupils - over 15 000 pupils - were tracked termly over a full academic year. Using this information, plus Optional and Key Stage test data, it was possible to link pupil performance from term to term and year to year, to identify patterns that provide a firm basis on which to project future performance and establish realistic expectations. The equating trials carried out in 2015 ensure that the linking of Hodder Scale scores remains secure for this new edition.

Page 15: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 15

Table 4.2: Relating PiRA raw scores to the Hodder Scale

PiRA 1 Autumn

raw score

Hodder Scale

PiRA 2 Autumn

raw score

Hodder Scale

1 0.2 1 0.7 2 0.3 2 0.9 3 0.4 3 1.0

4–5 0.5 4 1.1 6–7 0.6 5–6 1.2

8–10 0.7 7 1.3 11–13 0.8 8 1.4 14–15 0.9 9–10 1.5 16–17 1.0 11 1.6 18–19 1.1 12 1.7

20 1.2 13 1.8 21 1.3 14 1.9 22 1.4 15–16 2.0 23 1.5 17 2.1 24 1.6 18 2.2 25 1.7 19 2.3

20 2.4

21–22 2.5 23 2.6 24 2.7 25 2.8

Predicting future performance with the Hodder Scale The Hodder Scale enables teachers to monitor progress term by term at a much finer level than the scaling used by most data-tracking programs. The tests for each term have been designed to cover a range of demand appropriate to the year and term. In Table 4.3 you can see at a glance the Hodder Scale score of a pupil in the Autumn term and track to the next column to see the anticipated Hodder Scale score they will obtain if they make average progress the next term. As the tests have been designed to challenge the pupils around the level at which they are expected to be working, you may find that pupils get similar raw scores from term to term across each year, but their level of performance, as shown in the Hodder Scale score, will continue to increase. You may wish to set targets for the future and monitor progress over a term or year. In Key Stage 1, expected progress is usually at least one-third of a Hodder Scale score each term. Some children do better than this, others less well. Table 4.3 shows how, on average, pupils gaining different Hodder Scale scores move on in subsequent terms up the Hodder Scale. Monitoring the difference between the actual Hodder Scale score and the predicted average Hodder Scale score – for an individual pupil or for a whole class – enables you to see if there is increasing divergence or convergence to normal progress.

Page 16: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 16

Table 4.3: Monitoring and predicting progress from Autumn to Spring terms

Average Hodder Scale score

Average Hodder Scale score

PiRA 1 Autumn

PiRA 1 Spring

PiRA 2 Autumn

PiRA 2 Spring

0.2 0.5–0.6 0.7 1.1 0.3 0.7–0.8 0.8–0.9 1.2 0.4 0.9 1.0 1.3 0.5 1.0 1.1 1.4 0.6 1.0 1.2 1.7 0.7 1.1 1.3 1.8 0.8 1.1 1.4 1.8 0.9 1.2 1.5 1.9 1.0 1.3 1.6 2.0 1.1 1.3 1.7 2.1 1.2 1.4 1.8 2.1 1.3 1.5 1.9 2.2 1.4 1.6 2.0 2.2 1.5 1.6 2.0 2.3 1.6 1.6 2.1 2.4

2.2 2.5–2.6 2.3 2.7 2.4 2.8 2.5 2.9 2.6 3.0

Page 17: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

5 Standardised score tables Age-standardised scores for PiRA 1 Autumn

Age in years and completed months Raw

Score 5:0 5:1 5:2 5:3 5:4 5:5 5:6 5:7 5:8 5:9 5:10 5:11 6:0 6:1 6:2 6:3 6:4 6:5 6:6 6:7 6:8 6:9 6:10 Raw Score

1 77 76 76 75 74 74 73 73 72 72 72 72 71 71 71 71 71 71 70 70 70 70 70 1 2 82 81 80 79 79 78 78 77 77 76 76 76 76 75 75 75 74 74 74 73 73 73 73 2 3 86 85 84 83 82 82 81 80 80 79 79 78 78 78 77 77 77 77 76 76 76 76 76 3 4 89 88 87 87 86 85 84 84 83 82 82 81 81 80 80 79 79 79 78 78 78 77 77 4 5 93 92 91 89 89 88 87 86 86 85 84 84 83 83 82 82 81 81 80 80 80 79 79 5 6 95 94 93 93 92 91 90 89 88 87 87 86 85 85 84 84 83 83 82 82 81 81 81 6 7 97 96 95 94 94 93 92 92 90 90 89 88 87 87 86 86 85 85 84 84 83 83 83 7 8 98 98 97 96 96 95 94 94 93 92 91 90 90 89 88 88 87 87 86 86 85 85 84 8 9 100 99 99 98 97 97 96 95 95 94 93 93 92 91 90 90 89 88 88 87 87 86 86 9

10 101 101 100 100 99 98 98 97 96 96 95 94 94 93 93 92 91 90 90 89 88 88 87 10 11 103 102 102 101 101 100 99 99 98 97 97 96 95 95 94 94 93 93 92 91 90 90 89 11 12 104 104 103 103 102 101 101 100 100 99 98 98 97 96 96 95 95 94 93 93 92 92 91 12 13 106 105 105 104 103 103 102 102 101 100 100 99 99 98 97 97 96 95 95 94 94 93 93 13 14 107 107 106 106 105 104 104 103 103 102 101 101 100 100 99 98 98 97 96 96 95 95 94 14 15 109 108 108 107 107 106 106 105 104 104 103 102 102 101 100 100 99 99 98 97 97 96 95 15 16 110 110 109 109 108 108 107 107 106 105 105 104 103 103 102 101 101 100 99 99 98 98 97 16 17 112 111 111 111 110 110 109 108 108 107 106 106 105 104 104 103 102 102 101 100 100 99 98 17 18 113 113 113 112 112 111 111 110 110 109 108 108 107 106 106 105 104 103 103 102 101 101 100 18 19 115 115 114 114 114 113 113 112 112 111 111 110 109 108 108 107 106 105 105 104 103 102 102 19 20 117 117 116 116 116 115 115 114 114 113 113 112 112 111 110 109 108 108 107 106 105 104 103 20 21 119 119 119 118 118 118 117 117 116 116 115 115 114 113 113 112 111 110 110 109 108 107 106 21 22 123 123 123 122 122 121 121 120 119 119 118 118 117 117 116 115 115 114 113 112 111 110 109 22 23 129 129 128 128 128 127 127 127 126 125 125 124 124 123 122 121 120 119 118 117 115 114 113 23 24 130 130 129 129 128 128 128 127 127 127 126 125 24 25 130 25

5:0 5:1 5:2 5:3 5:4 5:5 5:6 5:7 5:8 5:9 5:10 5:11 6:0 6:1 6:2 6:3 6:4 6:5 6:6 6:7 6:8 6:9 6:10

Award >130 for all scores in this area

Page 18: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Copyright 2015 Hodder and Stoughton Ltd. Version Two 23/11/2015 18

Age-standardised scores for PiRA 2 Autumn

Age in years and completed months Raw

Score 6:0 6:1 6:2 6:3 6:4 6:5 6:6 6:7 6:8 6:9 6:10 6:11 7:0 7:1 7:2 7:3 7:4 7:5 7:6 7:7 7:8 7:9 7:10 Raw Score

1 72 70 1

2 86 85 84 82 82 81 80 79 78 77 76 76 75 74 74 73 72 72 71 70 70 70 2 3 89 88 87 86 85 85 84 83 82 81 81 80 79 78 78 77 77 76 76 75 75 74 73 3 4 92 91 90 89 88 87 87 86 85 85 84 83 82 82 81 80 80 79 79 78 78 77 77 4 5 95 94 93 92 91 90 89 89 88 87 86 86 85 85 84 83 83 82 81 81 80 80 79 5 6 97 96 95 94 94 93 92 91 90 90 89 88 87 87 86 86 85 85 84 83 83 82 82 6 7 98 98 97 96 96 95 94 93 93 92 91 90 90 89 88 88 87 86 86 85 85 84 84 7 8 100 99 99 98 97 97 96 95 95 94 93 92 92 91 90 90 89 88 88 87 87 86 86 8 9 101 101 100 100 99 98 98 97 96 96 95 94 94 93 92 92 91 90 90 89 89 88 87 9

10 103 102 102 101 100 100 99 99 98 97 97 96 96 95 94 94 93 92 92 91 90 90 89 10 11 105 104 104 103 102 101 101 100 100 99 98 98 97 97 96 95 95 94 93 93 92 91 91 11 12 107 106 105 105 104 103 102 102 101 100 100 99 99 98 97 97 96 96 95 94 94 93 93 12 13 108 108 107 106 106 105 104 103 103 102 101 101 100 99 99 98 98 97 97 96 95 95 94 13 14 110 109 109 108 108 107 106 105 105 104 103 102 102 101 100 100 99 98 98 97 97 96 96 14 15 112 111 110 110 109 109 108 107 107 106 105 104 103 103 102 101 101 100 99 99 98 98 97 15 16 113 113 112 112 111 110 110 109 109 108 107 106 106 105 104 103 102 101 101 100 100 99 98 16 17 116 115 114 114 113 112 112 111 110 110 109 108 108 107 106 105 104 103 103 102 101 101 100 17 18 118 117 116 116 115 115 114 113 112 112 111 110 110 109 108 107 106 106 105 104 103 102 101 18 13 120 119 119 118 118 117 116 116 115 114 113 113 112 111 110 110 109 108 107 106 105 104 103 19 20 123 122 122 121 120 120 119 118 118 117 116 116 115 114 113 112 111 110 109 109 108 107 106 20 21 126 125 125 124 124 123 122 122 121 120 119 119 118 117 116 115 114 113 112 111 110 109 108 21 22 129 129 129 128 128 127 126 126 125 124 124 123 122 121 120 119 118 117 116 115 113 112 111 22 23 130 130 129 128 128 127 126 125 124 122 121 120 118 117 116 23 24 130 129 128 126 124 24 25 130 25

6:0 6:1 6:2 6:3 6:4 6:5 6:6 6:7 6:8 6:9 6:10 6:11 7:0 7:1 7:2 7:3 7:4 7:5 7:6 7:7 7:8 7:9 7:10

Award >130 for all scores in this area

Award <70 for all scores in this area

Page 19: Progress in Reading Assessment (PiRA) · PDF file5 Standardised score ... the whole year to a test being taken in the autumn ... • The tests Year 1 and Year 2 use questions which

Standardised scores PiRA 1 Autumn PiRA 2 Autumn

Hodder Scale

Raw Score

Standardised Score Hodder

Scale Raw

Score Standardised

Score

0.2 1 71 0.7 1 75

0.3 2 74 0.9 2 77

0.4 3 76 1.0 3 79

0.5 4 78 1.1 4 81

0.5 5 80 1.2 5 83

0.6 6 82 1.2 6 85

0.6 7 85 1.3 7 88

0.7 8 87 1.4 8 90

0.7 9 89 1.5 9 92

0.7 10 91 1.5 10 94

0.8 11 93 1.6 11 96

0.8 12 95 1.7 12 98

0.8 13 98 1.8 13 100

0.9 14 100 1.9 14 102

0.9 15 102 2.0 15 105

1.0 16 104 2.0 16 107

1.0 17 106 2.1 17 109

1.1 18 109 2.2 18 111

1.1 19 111 2.3 19 113

1.2 20 113 2.4 20 115

1.3 21 115 2.5 21 117

1.4 22 117 2.5 22 119

1.5 23 119 2.6 23 122

1.6 24 122 2.7 24 124

1.7 25 124 2.8 25 126