Upload
anthony-atkinson
View
216
Download
0
Tags:
Embed Size (px)
Citation preview
Presenting:
Unit V1
Presenting:
Unit V1
Who this presentation is suitable for?Who this presentation is suitable for?
Internal verifier-candidates working towards Unit V1: ‘Conduct internal quality assurance of the assessment process’
OR
Those internal verifiers already holding D34/V1 (as part of their CPD)
Aims Aims
Recognise where the verifiers’ role naturally matches the evidence requirements of V1
Identify the elements that make up V1 and their evidence requirements
Identify the Learning and Development Assessment Strategy requirements for assessing and verifying the V1 Unit
The information contained in the following slides should enable you to:
TerminologyTerminology
The slides in this presentation refer to the internal verifier and at other times they refer to the IV-Candidate. They should be taken to mean one of the same.
There are a small number of slides towards the end of the presentation that refer specifically to the internal verifier and assessor of the IV-Candidate. Where this is the case these text names have been highlighted in bold.
The Verifier UnitsThe Verifier Units
V1 — Conduct internal quality assurance of the assessment process
V2 — Conduct external quality assurance of the assessment process
Unit V2 is targeted at external moderators and therefore will be not covered in the following slides
Overview of V1 (1)Overview of V1 (1)
The A and V Unit standards were developed by the ENTO in consultation with employers, awarding bodies in the UK and practitioner assessors and verifiers
Good practice, based on tried and tested methods, has been incorporated into the standards and agreed common evidence requirements
Overview of V1 (2)Overview of V1 (2)
The language used to describe Performance Criteria and knowledge has been simplified and made more relevant to work based learning
Activities such as monitoring assessor performance, working to an IV Strategy and evaluating systems etc, have been more explicitly written into the standards
The IV role has been given more of a quality management focus
Assessment environment for Unit V1 Assessment environment for Unit V1
This Unit is work based, meaning the evidence of the verifier-candidates’ performance must be taken from their normal work activity (the ENTO have stipulated that simulation is not allowed)
Similarly, the work of the assessors and candidates they verify must also be work based
The Internal Verifier’s Role (1)The Internal Verifier’s Role (1)
Identifying the ongoing development/training needs of assessors (and own development needs) and supporting assessors in planning their development
The assessor undertakes a number of key activities as part of their role such as:
The Internal Verifier’s Role (2)The Internal Verifier’s Role (2)
Ensuring assessors have the appropriate resources to enable them to carry out their role effectively — provide opportunities for regular standardisation meetings
Checking of individual assessor judgements using an effective sampling plan and carrying out formal observation of assessors at appropriate intervals
The Internal Verifier’s Role (3)The Internal Verifier’s Role (3)
Meeting with a representative percentage of candidates during their ongoing assessment, including monitoring their level of satisfaction
Giving assessors accurate and helpful feedback on assessment decisions
Ensuring that new awards and assessors are subject to an appropriate level of verification
The Internal Verifier’s Role (4)The Internal Verifier’s Role (4)
You may already be familiar with many the activities previously mentioned, however, in comparison with the D34 Unit, there are a number of responsibilities in V1 that are generally set at a higher level.
We will cover these responsibilities in the following slides.
Conduct internal quality assurance of the assessment processConduct internal quality assurance of the assessment process
The V1 Unit comprises four elements:
V1.1 Carry out and evaluate internal assessment and quality
assurance systems
V1.2 Support assessors
V1.3 Monitor the quality of assessors’ performance
A1.4 Meet external quality assurance requirements
- Support assessors - Monitor their performance
- Carry out evaluation of systems.
- Meet external quality assurance requirements
- Implement IV Strategy
- Ensure standardisation
The IV role and key principles of V1The IV role and key principles of V1
Internal Verifier levels of responsibility (1)Internal Verifier levels of responsibility (1)
The role of the internal verifier reflects one of proactively managing the quality assurance in his/her occupational area/department
Internal Verifier levels of responsibility (2)Internal Verifier levels of responsibility (2)
Learning and Development Assessment Strategy quote:
‘All internal verifiers will have direct responsibility and quality control of assessment of the occupational standards or the quality assurance of the assessment process within an approved centre’
The role of internal verifiers is now more proactive and hands-on, not a deskbound-based role
The Internal Verifiers’ Role in relation to V1.1 (1)The Internal Verifiers’ Role in relation to V1.1 (1)
Internal verifiers plays a vital role in:
Maintaining quality through adopting an effective Internal Verifier Strategy
Example of what an IV Strategy may include:
Assessment Strategy requirements
Details of assessors and their competence and experience
The Internal Verifiers’ Role in relation to V1.1 (2)The Internal Verifiers’ Role in relation to V1.1 (2)
Sampling arrangements ie awards & Units/assessment methods/assessors, locations & sites (taking account of new/revised/problematic Units)
Arrangements for maintaining standards in assessment through assessor CPD activity etc
The Internal Verifiers’ Role in relation to V1.2 (3)The Internal Verifiers’ Role in relation to V1.2 (3)
Supporting assessors and providing them with the resources to carry out their role effectively
The Internal Verifiers’ Role in relation to V1.2/3 (4)The Internal Verifiers’ Role in relation to V1.2/3 (4)
Identifying assessor development needs
The Internal Verifiers’ Role in relation to V1.3 (5)The Internal Verifiers’ Role in relation to V1.3 (5)
Monitoring performance
Internal Verifier
The Internal Verifiers’ Role in relation to V1.3 (6)The Internal Verifiers’ Role in relation to V1.3 (6)
Monitoring performance
Internal Verifier
The IV should also monitor:
Assessors’ decisions for consistency & reliability
The progress and satisfaction of candidates
Procedures for equal access to assessment/opportunities
The Internal Verifiers’ Role in relation to V1.3 (7)The Internal Verifiers’ Role in relation to V1.3 (7)
The Internal Verifiers’ Role in relation to V1.3 (8)The Internal Verifiers’ Role in relation to V1.3 (8)
Assessors’ record keeping
Resources, assessment materials, assessor to candidate ratios
The Internal Verifiers’ Role in relation to V1.4 (9)The Internal Verifiers’ Role in relation to V1.4 (9)
The Internal Verifier plays a vital role in:
Meeting external quality assurance requirements through provision of information, liaising with all persons responsible for internal quality assurance
The Internal Verifiers’ Role in relation to V1.4 (10)The Internal Verifiers’ Role in relation to V1.4 (10)
Working with external moderators to raise the quality assurance levels of the organisation )
Procedures for the dissemination of points/feedback from external moderation visits should be built into centre systems. This will ensure that all involved are working to the same shared goal — that of best practice
The Internal Verifiers’ Role in relation to V1.1/4 (11)The Internal Verifiers’ Role in relation to V1.1/4 (11)
Carrying out an ongoing and rolling programme of evaluation and improvement of internal quality assurance practices
Contributing to the review of the assessment and verification cycle and making recommendations — nothing stands still and all systems policies and procedures should be regularly evaluated
Structure of the V1 Unit Structure of the V1 Unit
Each unit is broken down into 4 elements
Each element contains Performance Criteria, Scope (previously Range) and Knowledge requirements (40 in all) are based on the complete unit and not individual elements.
Each unit also has a set of Evidence Requirements
We are about to look at each of these areas in more depth
Performance Criteria (1)Performance Criteria (1)
The language use has been simplified.
Example element V1.2:
a) Ensure assessors have appropriate technical and vocational experience
b) Ensure assessors are familiar with and can carry out the specific assessment, and follow the recording and internal audit procedures
Performance Criteria (2)Performance Criteria (2)
c) Identify the development needs of assessors in line with:
principles of assessment the needs of candidates their technical expertise and competence
d) Give assessors the chance to develop their assessment experience; and monitor their competence
Performance Criteria (3)Performance Criteria (3)
e) Ensure assessors have regular opportunities to standardise assessment decisions
f) Monitor how assessors are capable of maintaining standards
The Scope for IV (1)The Scope for IV (1)
Use their centre’s system for internal quality assurance
Provide assessment information on occupational standards
Support assessors, monitor their assessment decisions, providing feedback
The Scope (previously ‘range’) covers centre systems, where the IV-Candidate is expected to show how they:
The Scope for IV (2)The Scope for IV (2)
Monitor assessment practice (watching assessors)
Sample evidence, ensuring standardisation arrangements are effective
Evaluate systems using internal and external quality assurance processes
Meet external/awarding body requirements
Knowledge requirements Knowledge requirements
Knowledge requirements for V1 encompasses 40 points
Points cover the essential knowledge required by an internal verifier in order to perform effectively. Therefore, to achieve V1, knowledge should be recognised wherever possible in the performance of the IV-Candidate, through their work activities.
Key evidence requirements V1.1 (1)Key evidence requirements V1.1 (1)
quality assuring assessment decisions for one or more national awards
identifying and applying relevant performance measures
recording assessment decisions in a way that meets awarding body requirements
A record of written or oral explanation, supported by detailed policies and documentation, of the organisation’s procedures for:
Key evidence requirements V1.1 (2)Key evidence requirements V1.1 (2)
conducting internal standardisation of assessment
dealing with complaints and appeals
evaluating the effectiveness of internal quality assurance arrangements
keeping up-to-date with assessment, verification and quality assurance requirements
Key evidence requirements V1.1 (3)Key evidence requirements V1.1 (3)
disseminating information on assessment and feedback from external verification
monitoring health and safety and equal opportunities policies and practices
A record of a written statement that documentation and evidence are acceptable to external awarding bodies (via External Verifier or Quality Assurance Managers’ reports)
Key evidence requirements V1.2 (1)Key evidence requirements V1.2 (1)
A list of assessors/candidate-assessors used by the centre for the same qualification, with an explanation of the criteria used to ensure their vocational experience
The assessment information and support materials provided to assessors in relation to the same qualification and an explanation of how assessors are supported in their use
Key evidence requirements V1.2 (2)Key evidence requirements V1.2 (2)
The induction programme used in the centre to ensure that assessors can operate the specific assessment and recording requirements for at least one national qualification
A record of assessor standardisation meetings led by the internal verifier-candidate covering standardisation activities for at least two assessors
Key evidence requirements V1.2 (3)Key evidence requirements V1.2 (3)
An explanation on how the standardisation arrangements ensure consistency between assessors over time and across candidates
Personal development plans and action plans developed in conjunction with the internal verifier-candidate for at least two assessors
Key evidence requirements V1.3 (1)Key evidence requirements V1.3 (1)
An observation of at least two assessors on two separate occasions (2 observations in total), assessing different candidates, including providing feedback with a written record of the process
One observation by the external moderator or internal verifier of the internal verifier-candidate monitoring the performance of one assessor
Key evidence requirements V1.3 (2)Key evidence requirements V1.3 (2)
A sampling plan applied to at least two assessors which details:— checks to ensure that the assessors have all the
necessary materials
— when and how the assessors will be monitored making assessment decisions, including interim sampling arrangements and how feedback will be given on their performance
Key evidence requirements V1.3 (3)Key evidence requirements V1.3 (3)
— how the full range of agreed assessment methods will be sampled and recorded and varied to reflect the numbers and experience of different assessors and candidates
— how the assessor/candidate relationship will be monitored
— how equality and access procedures are being followed by assessors
— the accuracy, completeness and promptness of assessors’ record-keeping
Key evidence requirements V1.3 (4)Key evidence requirements V1.3 (4)
This sampling plan must be supported by appropriate reports from at least one external moderator for a national qualification which confirm that the support arrangements for assessors are satisfactory
Key evidence requirements V1.4 (1)Key evidence requirements V1.4 (1)
an explanation of their involvement with external verification visits
confirmation of the timing and nature of external verification visits
complete assessment records and supporting evidence as required by the awarding body
The documentation and materials presented for one successful external moderation visit (no holds placed), which contains:
external moderator reports indicating the outcomes and the procedures followed to address quality issues from such reports
records of internal feedback on the quality assurance process and any reviews of procedures
This above will be supported by evidence from the external verifier confirming the sufficiency of these arrangements via an External Moderator Report
Key evidence requirements V1.4 (2)Key evidence requirements V1.4 (2)
Key evidence requirements V1.4 (3)Key evidence requirements V1.4 (3)
Evidence relating to the communication with the awarding body which provides evidence of meeting the requirements of the awarding body and the centre’s procedures for dealing with disagreements and disputes
In SummaryIn Summary
IV-Candidates are required to:
Develop a comprehensive understanding of the standards to be internally verified and provide the necessary support (time, materials, other resources), to their assessors
Apply their centres’ Internal Verification Strategy and constantly evaluate and review their QA systems
In SummaryIn Summary
Monitor assessor performance, ensuring regular standardisation meetings take place, leading to improved and effective assessment practices
Ensure their centre maintains quality in assessment and internal verification in order to meet external moderator/awarding body requirements
The Assessment StrategyThe Assessment Strategy
All centres offering delivery of the A & V Units must sign up to abide by the assessment Strategy, which includes:
Occupational Competence of Assessors and Internal Verifiers
Ongoing updating of knowledge and skills (CPD)
Independent assessment (quality control)
Occupational Competence (1)Occupational Competence (1)
Internal verifiers of the A and V Units must have a sound working knowledge of the assessment and verification principles as defined in the V1 Unit and must hold the appropriate D or A and V Units
The Assessment Strategy for Learning and Development states:
Internal verifiers verifying in all other subject areas who currently have the D Unit(s) or TQFE/TQSE do not have to attain the V1 Unit, but they should aim to update their knowledge and working practices in line with V1 Unit standards
The following slides relate to internal verifiers of the A and V Units.
Occupational Competence (2)Occupational Competence (2)
Assessor of V1Assessor of V1 I am already a qualified
assessor and internal verifier
I have been a qualified practising internal verifier for at least one year within the last two
OR I could have been a qualified experienced trainer of internal verifiers for at least one year
I have a sound working knowledge of V1
I have undertaken at least two updating activities in the past year
Internal Verifier of V1Internal Verifier of V1
I am already a qualified practising assessor and internal verifier
I have been an assessor for D34/V1 (similar standards would also be acceptable) for at least one year within the last two years
I have a sound working knowledge of the assessment and verification principles as defined in V1
I have undertaken at least two updating activities in the past year
Independent Assessment (1)Independent Assessment (1)
Introduced by ENTO to strengthen quality assurance (Guidance on independent assessment can be found in the Learning and Development Assessment Strategy)
Requires the IV-Candidates to present a balance of evidence which must include a substantive component which has been assessed by someone who is independent from the IV-Candidates, ie not their main assessor or internal verifier for the V1 Unit
Independent Assessment (2)Independent Assessment (2)
For V1: An internal verifier-candidate observation of an assessor conducting the assessment process with a candidate
ENTO have given the following as an example of a substantive piece of outcome evidence for the Independent Assessor to assess:
The Independent AssessorThe Independent Assessor
Should be occupationally competent and qualified
Must not be the verifier- candidate’s primary assessor or internal verifier
May be employed by the same centre or by another approved centre
Should feature in Assessment Plans
Updating of knowledge & skills (CPD)Updating of knowledge & skills (CPD)
Internal Verifiers should demonstrate Continuing Professional Development within the last year involving at least two of the following activities:
Qualification development work
Other appropriate occupational activity as agreed with the External Verifier
Attending Awarding Body verification training courses
Studying for learning and development Units
Study related to job role
Collaborative working with Awarding Bodies
Who is responsible for the CPD process?Who is responsible for the CPD process?
The centre is responsible for including arrangements for CPD in their Internal Verification Strategy. CPD should at least partially be planned in advance.
Assessors and Internal Verifiers are responsible for managing, maintaining and recording their own CPD.
External Moderators are responsible for monitoring CPD activity within centres.
Any questions?Any questions?