Embed Size (px)
Citation preview
CASAS National Summer Institute 2007
SPEAKING & WRITING FIELD TEST IN SINGAPORE
Christopher YipPrincipal Manager
Generic Skills Development DivisionSingapore Workforce Development Agency
2
Background to the Speaking & Writing assessment development
• WDA adopted the Comprehensive Adult Student Assessment System (CASAS) as a foundation
• One reason for this was its strong grounding on workplace competencies across a range of employability skills areas
• And because it is a precise and strongly validated framework for assessment of literacy and numeracy levels on a calibrated scale of performance
• CASAS competencies were adapted to the Singapore context
• Reading and Numeracy CAT, Listening CBT currently available
3
WRITING
• Comprises two types of prompts: picture (for lower level writers) and essay (for more proficient writers)
• Began in Oct 06; To be completed by 3Q of 2007
• Field tests started in May 2007
SPEAKING
• Comprises a set of questions and picture prompts
• Began in Oct 06; To be completed by 1Q of 2008
• Field tests started in May 2007
Speaking and Writing assessments tools development timeline
4
• 5 Speaking test forms were developed; 2 Writing picture prompts and 2 Writing essay prompts were developed
• At least 300 test takers for each prompt across the level range
• Test takers need to have a range of ages, education, and ethnicity; about equal number of males and females
• Test protocol for writing: 3 different combinations
– Each examinee takes both picture prompts
– Each examinee takes both essay prompts
– Each examinee takes one picture and one essay prompt
• Each response triple scored and consensus reached
Speaking and Writing tryouts and field tests
5
• Regular dialogue between CASAS and WDA on development issues (a teleconference every 2-3 weeks)
• Localising the context of the test prompts, e.g. left-hand drive to right-hand drive; blondes to brunettes; environmentally friendly packaging to recycling
• Development of local anchors particularly for Speaking
• Training and deployment of local scorers with expertise in Singapore Standard English as early as the field test stage, and regular checks on scorer consistency
• Implementation of computer-based testing and scoring
• Paying workers to take the field tests
Critical success factors
The Singapore WDA/CESCASAS Experience
Alice Sia Principal Manager
Centre for Employability [email protected]
7
The Singapore - CES Experience
IntroductionStatus of WPLN CAT Appraisals at CES
CES facilities for SWT and CAT Appraisals
8
From Singapore to San Diego
9
The CES TeamAmidst Tropical Greenery
10
CES Opens All Year Round
11
CAT Appraisals for Workers at Company sites
and Learning Festivals
12
Workplace Literacy and Numeracy Assessments at the Centre for Employability Skills (CES)
13
Popularity of CAT Appraisals during Ministerial Visit to CES in May 2007
14
VIPs at the CAT Station atat the Learning Event, May 2007
15
New WPLN Assessment Programmes
• Writing / Speaking Assessments(Field test stage)(Targeted roll-out in July 07)
• Recruitment of Associate Part-time Scorers • Selection interviews and training of a pool of 18
part-time scorers for writing assessments• Selection Criteria for part-time scorers
16
Number of CAT Appraisals
CY 2007 CY 2006
MAY Cumulative To Date
JAN TO DEC 06
WPLN Assessments: Computer Adaptive Tests
Reading 1743 7075 6593
Numeracy 1534 6728 6494
Listening 1743 7039 6523
Total 5020 20 842 19610
17
Headcount Breakdown by Referral Sources
CY 2007 CY 2006
Individuals/ DCN
Referred
Company-Referred
Total Individuals/ DCN
Referred
Company-
Referred
Total
MAY Cum MAY Cum MAY Cum Jan to Dec 06
Jan to Dec 06
Jan to Dec 06
Noof Pax 1556 5370 196 1750 1752 7120 2354 4278 6632
18
The Language Laboratory
19
Window View from Side Cubicles
20
Sound-absorbing Panels with Fibre-glass and Cloth Fabric Side Panels
21
Lab Designed with Headsets for CASAS CAT Appraisals
22
Proctor’s Station in Language Laboratory
23
Conducive Assessment Environment
24
Thank you
