Copyright 2007,Marjorie Meacham, Jenna Miley, Dianna Smith 1 ADDIE and Rapid Prototype Design SALT Conference New Learning Technologies 2008 Orlando February

Copyright 2007,Marjorie Meacham, Jenna Miley, Dianna Smith

1

ADDIE and Rapid Prototype Design

SALT Conference

New Learning Technologies 2008

Orlando February 20-22


2

Speakers

Margie Meacham, American Express Jenna Miley, Bainbridge College Dianna Smith, SSB, Inc.


3

Purpose

Share the MMS model NEW model that combines Rapid Prototyping

techniques with ADDIE rigor Reduces design time Enhances quality design

Invite further study


4

Overview


5

Background

Collaborated on project Reviewed Existing Models Created MMS Model


6

Bates Model

• Product oriented

• Focus on distant learner

• Implied correlation w/ADDIE

• Evaluation

• Linear


7

Dick & Carey Model

• Systems approach model

• Most widely cited

• Time consuming

• Appears to be linear


8

K & G Model

• Appears linear overall

• ADDIE variation\

• Definite lack of evaluation


9


10

The MMS Model


11

Classic ADDIE

Analyze

Design

Evaluate

Implement

Develop

Linear approach Evaluation takes place

after implementation Assumes that each

phase is dependent on the one preceding

Longer cycle time


12

Rapid Prototyping

Design

Develop

Implement

Applies mathematical models to design

Puts a version of the product in customer hands quickly

Analysis and evaluation are replaced by the feedback loop


13

ADDIE, MMS and Rapid Prototyping

Preserves the rigor of analysis and evaluation

Evaluates at the end of each phase instead of after implementation

Leverages some of the advantages of rapid prototype design


14

Field Trials

6 courses: 1 six-week new hire 2 e-learning courses

revised 3 new blended courses from scratch

Results Reduced design time Reduced learning time Increased employee satisfaction


15

Early Indicators

Type of Training Average Design Hours*

MMS Design Hours**

Instructor-led Training

34 28

E-learning with 20% interactivity

220 160

*Based on a study of 200 companies conducted by Brandon-Hall Consulting.**Based on six courses designed using MMS model.


16

Delphi Study Results

Research Question: To what extent does a group of experts in the field of instructional design perceive the MMS model as efficient, effective and easy to use?

The modified Delphi study required two rounds. Round one asked nine open ended questions regarding the MMS Instructional Design Model. Respondents were sent information regarding the model, its phases and how the phases would be used.

Round two of the study contained 28 questions derived from round one responses. The questions were rated on a 5-point Likert scale with 1= Strongly disagree, 2 = Disagree, 3 = Undecided, 4 = Agree and 5 = Strongly Agree.


17


Easy to UseMean = 4.45/StdDev = 0.522/N = 11

4.4

4.6

4.8

5

5.2

5.4

5.6

5.8

6

6.2

1=SD 2=D 3=N 4=A 5=SA

Likert Scale

Fre

qu

en

cy

Agree Strongly Agree

Standard deviation .522

Interquartile deviation = 1 However that deviation was between Agree and Strongly Agree. Therefore there is consensus that the model is easy to use.


18


Standard deviation = .467 Standard deviation = 1 Again this is between

Agree and Strongly Agree and supports consensus among panel members.

Appears FlexibleMean = 4.27/StdDev = 0.467/N = 11

0

1

2

3

4

5

6

7

8

9

1=SD 2=D 3=N 4=A 5=SA

Likert Scale

Fre

qu

en

cy

Agree Strongly Agree


19


Model is EffectiveMean = 4.00/StdDev = 0.894/N = 11

0

1

2

3

4

5

6

7

1=SD 2=D 3=N 4=A 5=SA

Likert Scale

Fre

qu

en

cy

Disagree Undecided Agree Strongly Agree


20


Standard deviation = .894 Interquartile deviation = 1

Model is Efficient (w /exper. Designer)

Mean = 4.00/StdDev = 0.894/N = 11

0

0.51

1.52

2.53

3.54

4.5

1=SD 2=D 3=N 4=A 5=SA

Likert Scale

Fre

qu

en

cy

Disagree Undecided Agree Strongly Agree


21


There was one caveat to this question and that was to an experienced instructional designer. Several of the respondents felt that as written the model would be effective when used by someone with experience. As you can see 1 panel member disagreed with that statement, one was neutral but 6 panel members agreed that the model is effective if used by an experienced ID, and 3 Strongly agreed.

Standard deviation = .924 Interquartile deviation = 1 Therefore, statistically,

there is consensus among panel members.


22



23

Evaluation at Each Phase


24

Further Study

Masie Center – Learning 2008 Further Field Trials – Margie Meacham


25

Based on this overview …

What are the advantages of employing this model?

What challenges or gaps do you see in this model?

What value do you see in this model for your environment?


26


27

Thank You!

Margie Meacham - [email protected]

Jenna Miley – [email protected] Dianna Smith – [email protected]

Documents

Copyright 2007,Marjorie Meacham, Jenna Miley, Dianna Smith 1 ADDIE and Rapid Prototype Design SALT Conference New Learning Technologies 2008 Orlando February