2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
1
Backward (Instructional) Design Updating ID Toolboxes for Personalized, Adaptive, & CBE
CAEL 2015 INTERNATIONAL CONFERENCE, BALTIMORE MD
Jon Mott, PhDChief Learning Officer
MJ Bishop, PhDDirector, Center for Academic Innovation
Cristi Ford, PhDAssistant Vice Provost for
Learning Innovation Initiatives
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
@drmjbishop@drmotx@jonmott
2
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Agenda
Welcome & Workshop OutcomesContext: Problem, Opportunity, & DefinitionsCASE STUDIESNew Tools for the ID ToolboxReport Outs & Takeaways
3
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Welcome & Workshop Outcomes 4
Workshop participants will be able to:
1. Apply working definitions of personalized, adaptive, and CBE in design contexts;
2. Design the right personalized, adaptive, and / or competency-based sequences and workflows for the right contexts using the right tools;
3. Evaluate tools, platforms, and courseware based on updated toolbox (ask "hard" questions about "black boxes");
4. Design personalized, adaptive, and CBE programs and courses utilizing new tools and frameworks
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
5
CONTEXTProblems
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Curriculum & courses are (generally): 6
TIMEBOUND LINEAR
TEACHERCENTRIC
ONE-SIZE-FITS-ALL
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Assessment is frequently:
7
DESIGNEDFOR
SCALABILITY
NORMREFERENCED
DIGITALKINKOS
FORCOURSES
SUPPORTSTAFFFOR
SMEs
IDs are perceived as:
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
8
CONTEXTOpportunities
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
9
Learning Design
Alignment
Capabilities
ActivitiesMeasurement
Policies & Assessments
Backward Design
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
10Criterion-referenced assessment (CBE)● Establish unambiguous,
objective measures of capability
● Hold all learners to same standard
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
11Authentic learning & assessment● Match learning and
assessment to real-world performance
● Match learning and assessment contexts as closely as possible
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
12Rethink role of instructional designers ● Professional
peers● Unique expertise
and skillsets ● Equal partners in
process
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
13
DEFINITIONS
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
14Personalized learning
PreferencePlacementPathPace
4 Ps of Personalization
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
15Adaptive learning
PreferencePlacementPathPace
AdaptiveLearning
● Multiple remediation loops
● Pacing / path rules
● Algorithms● Predictive
analytics
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
16Competency-based education
FORMATIVE
DIAGNOSTIC
SUMMATIVE
CAPABILITY
TRANSCRIPT
KNOWLEDGE, SKILLS, ABILITIES
CAREER & LIFE
GOALS
PLA
LEARNIN
G
ASSESSMEN
TS
PERSONALIZED& ADAPTIVE
LEARNING PLAN
COURSEWARE
ACTIVITIES
SIMULATIONS
PROJECTS
INTERACTIONS
Remedial | O
n track | Advanced
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
17
CASE STUDIES
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
18CASE STUDIESINTRO TO ACCOUNTING
● Positioned as “weed out” course
● Wide variability in incoming preparation
● Varied pace of learning
● Sporadic / intermittent demand for remediation
● Instructor burnout
GE COURSE w/ HIGH DFWs
● Required GE course● Negative student
course & faculty ratings
● High enrollments ● Varied approaches
across sections of the course
● Wide variation in preparation and performance
STUDENT TEACHER & MATH
● Student returned to school after 15 years
● Earned teaching degree with a 3.0 GPA
● Proved incapable of calculating fractions when teaching students
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
19
NEW TOOLS for TOOLBOX
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
20
Learning Design
Alignment
Capabilities
ActivitiesMeasurement
Policies & Assessments
Backward Design
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
21Authentic PLA, diagnostics, formative assessment ● What are you
measuring? ● How often will you
measure it? ● Will it be computer or
human graded? ● What is the
relationship between formative & summative assessment?
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
22Rules & algorithm-based personalization & adaptive
LEARNER
ACTIVITY
ACTIVITYEVALUATION
PERSONALIZATION RULE or
ALGORITHM
UPDATED LEARNING
PLAN
TYPE? NUMBER?
FREQUENCY?
LATENCY?
WHAT RULE(S)?
ALGORITHM(S)?
FREQUENCY?MANNER?
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
Other tools and considerations 23
PROGRAMLEVEL
PERSONALIZATION
DATA, TRACKING & ANALYTICS
CONTENTCREATION
&CURATION
EFFICACYEVALUATION
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
INTEROPERABILITY! 24
LTI 2.0 ANALYTICS CBE + eT
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
The right tool for the right context 25
Intensity / frequency of teacher-student interaction
Cognitive complexity of task
Cont
ent
/ act
ivit
y vo
lum
e re
quir
emen
tsM
achi
ne s
cora
ble
/ gui
dabl
e
AdaptiveLearning
Personalized
Learning Program-level
Personalized Learning
Knowledge • Comprehension • Application • Analysis • Synthesis • Evaluation
Adaptive Practice & Test Prep Personalize
courseware & learning sequences
Program mapping,
delivery, & analytics
2015 International Conference • Baltimore MD
Bishop, Ford, & Mott: Backward (Instructional) Design: Updating ID Toolboxes for Personalized, Adaptive, & CBE
26
REPORT OUTSNEXT STEPS
© 2015 Learning Objects.
non-integratedLMSb
(or faculty website, publisher
course, etc.)
LMSa
27
SIS ProgramSystem of
Record
Personalized & AdaptiveCourseware
CapabilityDashboard
Capability
Transcript
COMPREHENSIVE
PROGRAMPERFORMANCE
DATA
● LMSs● 3rd Party Courseware● Proprietary Learning Tools ● Assessment Tools
GRADES (manual)
COMPREHENSIVE PROGRAM DESIGN & DELIVERY TOOLS & SERVICES
Learning Technology
& Curriculum
Design Services
Learning-centered architecture