Online Learning and Evaluation

Online Learning and Evaluation

A Review

Insert logo here

High Impact Learning Solutions

Instructor-led TrainingStructured MeetingsOn-the-Job Coaching/Mentoring

Virtual ClassroomWebcast/Satellite BroadcastInteractive TVAudio/Video ConferencingOnline Chats

Self-Paced WorkbookPrint DocumentationAudio/videotape

Web-based TrainingComputer-based TrainingOnline DocumentationElectronic Performance Support SystemAudio/Video BroadcastsOnline Discussion Groups

Traditional Learning & Performance Support Solutions

E-Learning & Performance Support Solutions

SynchronousAsynchronous

Low Tech High Tech2

Development Highlights

Pedagogical Framework

Instructional Design

Best PracticesEvaluation

Tools

Instructional Design Process

Performance analysis

Job and task analysis

Design

Development

Testing and Implementation

Learner Performance

Goals and outcomes

Online Course Essential Elements

Online Course

Introduction

Modules Syllabus

Getting Started

Module Elements

Objectives

Activities/Learning Content

Readings

Tasks/Assignments

Assessment/Rubric

Quality Matter Rubric

Quality Matters (cont.)

Job Aids & Performance Support

“A job aid is a repository for information, processes, or perspectives that is external to the individual and that supports work and activity by directing, guiding, and enlightening performance.”

—Rossett and Gautier-Downes, A Handbook of Job Aids, p. 45.

Principles

Multimedia: Use words and graphics rather than words alone

Contiguity: Align words to corresponding graphics

Modality: Present words as audio narration

Redundancy: Explain visuals with words in audio or text, not both

Principles (cont.)

Coherence: Add extra material can hurt learning

Personalization: Use conversational style and virtual coaches

Segmenting and Pre-training: Break a lesson into parts

What is collaborative learning?

• Assignments for teams of 2 or more individuals in service of a learning goal. What examples can you give for: Collaborative learning Competitive learning Individual learning

Criteria for successful collaboration

www.Clarktraining.com

Criteria DescriptionSocial Interdependence The goal of each team member depends

on the achievement of all other team members

Outcome Goals The desired results of are appropriate for collaboration

Dialog Quality All team members make substantive contributions.

What is CSCL? • Engagements among teams of 2 – 5 members using synchronous and/or asynchronous tools in order to support an instructional goal.

Produce a product Resolve a case problem Analyze a video example Solve problems

Factors affecting CSCL outcomes

Outcomes: Individual VS group learning Group composition: Size & make up Technology: Synchronous – asynchronous Task assignment: Well structured – ill structured Group roles and instructions Time for collaboration Team skills training Incentives

Phase 1: ReviewProblem

Phase 2: Prepare & DeliverPro and Con Arguments

Argumentation

Phase 3: Develop Synthesis

PRO Team CON Team

Example: Wallwisher

Three types of thinking skills

Type Description Examples

Creative thinking Generating novel and useful ideas

Design an e-learning course

Critical thinking Evaluating products and ideas

Assess validity of an Internet resource

Metacognition Monitoring thinking and learning processes

Monitor your learning progress

www.Clarktraining.com

Focus on job-specific skills

Define the Problem

GenerateIdeas

Plan andImplement

EvaluateIdeas

• Brainstorm• Visualize• Metaphors• Mindmap

• Goals• Framing• Assuming• Chunk

Source: Entertainment Software Association, 2010 Report.

Sales of computer games

Source: Entertainment Software Association, 2010 Report.

Sales of video games

A model of a real-world system

Responds in dynamic and rule-based ways to user responses

Railroad Safety Simulation

What is a simulation ?

• A rule-based environment with goals

• Responsive to learner actions

• Challenging

• Cumulative so the current state

• reflects previous actions and

• show progress toward goals

• Game Database

What is a game ?

Research shift

Are games and simulations effective?

What features of games and

simulations lead to learning?

Value-added Research Approach

Match game types to goals

LearningGoal

Role-Play

Strategy

ActionPuzzle

Adventure

KWHL Chart

Write down what you KNOW about online

learning (or E-Learning)

Then write down what you WANT to know about online learning (or E-

Learning)

Write down HOW you found the information

Show what you have LEARNED about online

learning

KWHL