Embed Size (px)
DESCRIPTION
John Winkley of AlphaPlus discusses some forthcoming JISC funding opportunties in the area of assessment
Citation preview
Joint Information Systems Committee 10/04/23 | Supporting education and research | Slide 1
E-Assessment SIG 22 May 2008 Glasgow
Joint Information Systems Committee Supporting education and research
JISC Programme DevelopmentsJohn Winkley
Joint Information Systems Committee
New Projects & Activities for 2008
Formative Assessment Study about to commence
A new demonstrator call in early June 08
Two new studies tendering in early June 08
Ongoing programme work:
– Evaluation of progress, baselines
– Roadmap and development planning
Joint Information Systems Committee
Demonstrator ProjectAssessment Tools
“composite applications using existing components from existing JISC Toolkits and elsewhere”
At least 2 toolkits/components
leverage existing assessment content resources
Broaden the uptake and usage of QTI2 and support the developer community.
Joint Information Systems Committee
Demonstrator ProjectAssessment Tools (2)
• Let via a JISC Circular: “HE institutions funded via HEFCE and HEFCW, and by FE institutions in England that teach HE to more than 400 FTEs”
• Up to 4 projects, each up to a maximum of £45k. Each with an available £15k additional funding for the toolkit provider(s) to support the project.
• Work to be completed by end March 2009
• “risk-managed setting”
Joint Information Systems Committee
Demonstrator ProjectAssessment Tools (3)
Possible Applications include:
Workflow applications for item production and banking processes such as quality assurance, editorial, etc.
Orchestration of test creation and assembly applications
Loading/converting of existing item bank content to a QTI2 item bank
Wider assessment applications (eg online surveys)
Adapting components/groups of components to alternative requirements for example formative assessment delivery applications
Multi-standard player application (eg SCORM2004, QTI1.x, QTI2.x)
Integration of/connection of existing components into other information systems, eg learning environments, administration and student record systems
Integration with e-portfolio services
Joint Information Systems Committee
Design Principles for Studies
Benefits of e-assessment well documented
But take-up not as fast as expected. Why is this?
Need to broaden the pool of participants
Need to broaden the vision for e-assessment services
Joint Information Systems Committee
Study ProjectAdvanced e-assessment techniques
Scoping study of the state-of-the-art in e-assessment techniques across the world and in all education sectors.
Designed to underpin roadmap and framework/information knowledgebase component specification developments.
All aspects of e-assessment including on-screen presentation and marking, but excluding e-portfolio. Summative or formative assessment. Assessment in professional and academic domains. UK and international applications.
6 month project
Up to £40,000 including VAT and expenses
Let via an open tender: any organisation can bid.
Joint Information Systems Committee
Study ProjectAdvanced e-assessment techniques (2)
Look at specific e-assessment technology and more general techniques and technologies. Examples might include:
Computer marking of free text responses (sentences, paragraphs, essays)
Response with and assessment of complex mathematical responses
Computer marking of other complex responses (eg source code, diagrams)
Integration of computer-marking with streamlined human marking, expert and judgement support systems
Peer and Group Assessment
Associated services such as detection of plagiarism and other cheating
Data mining, Fuzzy Logic and Pattern Matching
Multi User Virtual Environments (MUVEs) and virtual worlds
Serious gaming (to some extent would be covered by (e) above)
Web 2.0 technologies such as Flickr
Joint Information Systems Committee
Study ProjectQuality of e-assessment
Mixed methods study to look at qualitative and quantitative measures of fitness for purpose in the e-assessments used in the JISC community today.
Applying
6 month project
Up to £40,000 including VAT and expenses
Let via an open tender: any organisation can bid.
Joint Information Systems Committee
Study ProjectQuality of e-assessment (2)
Consensus that e-assessment offers considerable potential to improve assessment quality, but e-assessment also presents some risks to quality, notably:
– multiple choice objective tests may lead to impoverishment.
– Multiple choice objective tests tend to emphasise memorisation and factual recall.
– Multiple choice objective tests require particular attention to be paid to the authoring and item performance evaluation process.
Thoroughly explored in literature, this study aims to investigate the quality of actual items in use.
Joint Information Systems Committee
JISC Programme DevelopmentsQUESTIONS
Myles DansonJISC Programme [email protected] 336319
