Quality Control: Towards a Framework for Assessing Online Training Courses by Gavin Dudeney and Thom Kiddle

A TCE - NILE collaboration, April 2015

Quality Control: Towards a Framework

for Assessing Online Training Courses.

Gavin Dudeney (TCE) & Thom Kiddle (NILE)

✓


About us

Thom Kiddle

Director, NILE

Gavin Dudeney

Director, TCE


Session overview

✓ Your thoughts

✓ Technology in education

✓ Standards for TTEd✓ Standards for TTEd online

✓ Your thoughts revisited

✓ The benefits of collaboration

✓ What next?

✓


What makes successful / effective online training courses?

Which criteria?

Tutor (ing)Materials (input & output)

Activities & Interactions Participants & Community

Organisation & institutional support

Usability & InterfaceOutcomes

Assessment

Takeaways (download or access post-course)


Tech in education

John Hattie

Professor, Melbourne

Visible Learning was based on more

than 800 meta-analyses of 50,000

research articles, about 150,000 effect

sizes, and about 240 million students.

A further 100+ meta-analyses

completed since Visible Learning was

first published have subsequently been

added.


Tech in education

0.90

0.82

0.75

0.61

0.49

0.48

0.37

0.33

0.18

0.11

Simulations / games

Formative feedback

Quality of teaching

Small group learning

Web-based learning

Distance education

Classroom discussion

Computer-assisted instruction

Problem solving teaching

Teacher credibility


Tech in education

0.90

0.82

0.75

0.61

0.49

0.48

0.37

0.33

0.18

0.11

Teacher credibility

Classroom discussion

Formative feedback

Problem solving teaching

Small group learning

Quality of teaching

Computer-assisted instruction

Simulations / games

Web-based learning

Distance education


Tech in education

John Hattie


Much of the data on technology was

gathered starting in 1987 (pre-

Windows, pre-internet...). The earliest

meta-analysis cited goes back to 1977,

25 are pre-1990 and the next 25 pre-

2000 (more than half of the 114 total).

In the latest Visible Learning for

Teachers, neither ‘computer’, nor

‘technology’ feature in the index….


Tech in education

John Hattie


John Hattie admits that half of the

Statistics in Visible Learning are wrong

(…) Hattie reluctantly acknowledges

that the CLE has in fact been

calculated incorrectly throughout the

book…

“People who don’t know that Probability

can’t be negative, shouldn’t write books

on Statistics.”


Current standards


• design and delivery of the training

• experience and expertise of trainers

• building on trainee knowledge and experience

• response to trainees’ specific training needs

• links between generic principles and specific context or content

Current standards


Why have them online?

MOOCs

Public image

Completion

AttritionMyths

Empowerment


Overall Language Proficiency

Communicative Strategies Communicative Language Competencies Communicative Activities

Reception Production Interaction Mediation

Spoken Written

Understanding a

native speaker

Informal

Discussion

Obtaining goods

and services

Conversation

Formal

Discussion

Interviewing and

being interviewed

How might they look?


Overall Course Approach

Organisational Domain Technological Domain Pedagogical Domain

Course Design Tutor Skills Course Content ???

Materials Pre-Course

Copyright

Multimedia

Learning objectives

Interaction types

Evaluation

Community




? ? ?


Who might this concern?


Why work together?

&


Why work together?“Deemed as a long-term

trend, the prevalence [ of

consortia in HE ]

underscores a vision of

institutions belonging to

part of a larger ecosystem

in which long-term survival

and relevance in higher

education relies on the

mutually beneficial

partnerships.”

“Developing a successful model for

collaborative innovation— for innovating

together— is thus the most sorely needed

disruption in higher education. This requires a

new kind of collaboration that is intentional,

self-forming, and based on shared values and

goals, bringing together institutions with limited

competitive interaction. Most importantly, this

new kind of collaboration necessitates

thoughtful coordination to bring more value to

each institution than is taken from each

institution.”


“Beware of:

• people making a career out of QA –

it’s a parasitical industry

• abuses of CPD frameworks

• evaluations of quality based solely

on paper evidence and box-ticking”

How to work together

Rod Bolitho

Hyderabad, 2015


What Next?

Q&A


Contact us…Grab the slides…

[email protected]

[email protected]

http://goo.gl/gYuQUr

Education

Quality Control: Towards a Framework for Assessing Online Training Courses by Gavin Dudeney and Thom Kiddle