42
What do serious game players think? JC Kinnamon R & D Division ICELW Columbia University June 2014

What do serious game players think?

  • Upload
    torin

  • View
    58

  • Download
    0

Embed Size (px)

DESCRIPTION

What do serious game players think?. JC Kinnamon R & D Division. ICELW Columbia University. June 2014. Who am I? Columbia in “School Psychology”…. Who am I? … computer-based learning. Who am I? … reluctant learners. Who am I? … reluctant learners. Fact Sheet. - PowerPoint PPT Presentation

Citation preview

Page 1: What do serious game players think?

What do serious game players think?

JC Kinnamon R & D Division

ICELWColumbia University

June 2014

Page 2: What do serious game players think?

Who am I?

Columbia in “School Psychology”…

Page 3: What do serious game players think?

Who am I?

… computer-based learning

Page 4: What do serious game players think?

Who am I?

… reluctant learners

Page 5: What do serious game players think?

Who am I?

… reluctant learners

Page 6: What do serious game players think?

Deliver continuing legal education (CLE)

800,000 CLE hours

3,400 live program attendees

40,000 Webcast attendees

Fact Sheet

Page 7: What do serious game players think?

304 live programs

326 live webcasts

112 one-hour audio briefings

1739 hours of webcasts archived for on-demand playback

Fact Sheet

Page 8: What do serious game players think?

R&D

Mission: make the learning experience better…

Page 9: What do serious game players think?

R&D

Mission: make the learning experience better…

…with little or no staff

Page 10: What do serious game players think?

R&DAsynchronous E-learningMarketing the firm  - (Kaleidoscope Learning)Improving law-firm profitability – (Kaleidoscope Learning)  Synchronous Online CoursesEffective communication with the legal aid client (MOOC)  - 1 week course  (Kaleidoscope Learning)Patent preparation  – 10 week course (Kaleidoscope Learning)  

Page 11: What do serious game players think?

R&DLive facilitator led simulationsNegotiations with other lawyers – 1 hour (Empower the User)Advising clients on trademarks – 20 minutes (Empower the User)  Serious GameThe Internal Investigation Game (Ranj Serious Games)  

Page 12: What do serious game players think?

What is a serious game?

Page 13: What do serious game players think?

What is a serious game?

Page 14: What do serious game players think?

What is a serious game?

“A game in which education is the primary goal rather than entertainment”

Page 15: What do serious game players think?

What is a serious game?

“A game in which education is the primary goal rather than entertainment”

Whodunit? The Case of the Lost Advantage

Page 16: What do serious game players think?

Games

vs.

PRO CON

Page 17: What do serious game players think?

Games

vs.

Jane McGonigal

PRO CON

Page 18: What do serious game players think?

Games

Richard Mayer

John Sweller

vs.

Jane McGonigal

PRO CON

Page 19: What do serious game players think?

Why this topic?• What do

serious game players think?

Want to share what I heard from users after experiencing a serious game …

Page 20: What do serious game players think?

Why this topic?• What do

serious game players think?

Did they learn?

Page 21: What do serious game players think?

Why this topic?

Control cognitive load?

• What do serious game players think?

Page 22: What do serious game players think?

Why this topic?

User acceptance?Desirability?

• What do serious game players think?

Page 23: What do serious game players think?

Data Collection Methods

Live observations

Remote observation

Post-experience

surveys

Post-experience debriefings

Concurrent self reports

Page 24: What do serious game players think?

Subjects

Observations/Individual Debriefs

13 Attorneys

Individual homework assignment / group

/debrief

15 Law students

Page 25: What do serious game players think?

Game description• Just imagine…

Page 26: What do serious game players think?

Game descriptionSkills• Planning• Interviewing• Gathering information• Eliciting cooperation• Challenging lies• Documenting• Reporting out findings

Page 27: What do serious game players think?

Game sample

Page 28: What do serious game players think?

So what did they think?

Page 29: What do serious game players think?

“Serious Game”

They had no idea what we were talking about

As true for the younger subjects as well as the older ones

Page 30: What do serious game players think?

Cognitive Load

Generally managed(tweaked based on early testing)

With a consistent user interface, learners gained speed

Page 31: What do serious game players think?

Cognitive Load

Ramp up time led to criticism

“Too easy.” “Too linear” for a few who bailed out early

Page 32: What do serious game players think?

MotivationScoring game element was a powerful motivator

Restarted seeing they were being scored

Grabbed pads of paper to take notes

Wanted to get questions right

Page 33: What do serious game players think?

StoryThe narrative was a powerful element in the pull of the game

Learners recounted details Need for closure

Page 34: What do serious game players think?

Story

Be careful—has to be relevant

Younger audience had harder time

Page 35: What do serious game players think?

Reading on-screen text

% of on-screen text read is normally low in compulsory training

Startling high level witnessed

Read when necessary

Little expository text

Skipped positive feedback

Page 36: What do serious game players think?

EngagementAnnoyed by technical glitches

Little tolerance for distractions

“I couldn’t multitask. I had to stop whatever else I was doing.”

Page 37: What do serious game players think?

EngagementAnnoyed by technical glitches

Little tolerance for distractions

“I couldn’t multitask. I had to stop whatever else I was doing.”

Focused on relevant details

Page 38: What do serious game players think?

Mastering techniques

Disclosure

Open- ended questions

Gaining cooperation

General questions before focused questions

Planning strategies

Challenging lies

Page 39: What do serious game players think?

FeedbackFocused on learning from errors

Changed behavior

Challenged evaluations

Page 40: What do serious game players think?

Quotable Quotes• “I had never done an internal investigation before. I want to do one now.”

• “I would pick a sim over a lecture; particularly for a skill topic.”

• “It was fun. That is not something I thought I would say.”

• “It is more valuable to do it vs. hear about it.”

• “It is wonderful to see how it is done. Better than sitting and listening.”

• “The game throws you in.... gives an associate a taste of how things happen.”

• “After the first episode I stopped playing a game and I did it like it was real.”

Page 41: What do serious game players think?

SummaryWhat did they think?

• Lawyers (serious professionals) embraced the game approach; they preferred it for skill-related content

• They thought about the content a lot, i.e. “engaged” with it

• They remembered key aspects-- t least in the short term

• They strived to finish• Trade-off: Cognitive load vs. motivational factors

Page 42: What do serious game players think?

Thanks for coming! Questions?

[email protected](212) 824-5813