2012 ERGA Conference19-21 September 2012
Karen Nelson, John Clarke & Ian Stoodley, QUT
ERGA WORKSHOPVerifying a SESR-MM: a reality
check!
Establishing a framework for transforming student engagement, success and retention in HEIs:
An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
2
The need for an holistic view ...
.... We have now reached the stage where universities must recognise the need for institution-wide approaches to enhancing the first year experience. Responsiveness to the needs of demographic and cultural subgroups demands that student support staff, academics and administrators work together to integrate their efforts and initiatives for the benefit of all students...
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Krause, Hartley, James & McInnis, 2005, ¶8.8.6
3
Workshop Activities
Part 1: Setting the scene Background to project:
rationale, significance, & objectives
Beyond the transition pedagogy Overview of maturity models
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Part 2: The SESR-MM
Parts of the SESR Model
A worked example
Part 3: Verifying the model Developing a maturity assessment scale Assessing the maturity of one institutional practice Discussion
Part 1: Setting the scene
Focusing on the project ....
Establishing a framework for transforming student engagement, success and retention in HEIs:
An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
4
5
Rationale
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Existing bodies of work report on students perceptions and their experiences in higher education (e.g. AUSSE, CEQ, FYEQ, UES, ISB...)
No similar attention to sector-wide assessment of institutional activities designed to enhance students learning experiences
Timing for the sector – WP, performance based funding, compacts, increased attention to HE reputation, quality ...
Concept of a maturity model appealing: Focus on sustainable processes Enable contextual interpretation of activities Assess other organisational imperatives (e.g. Quality, BPM)
6
Project Activities & Timeline
Key Activities Timeframe
Develop a SESR Maturity Model (SESR-MM)• Conceptual model from literature analysis (top
down)• Categories derived from practices and processes
identified through workshops in team institutions (bottom up)
Oct 2011 - Sept 2012
Design a SESR Maturity Inventory Feb – Dec 2012
Conduct SESR Maturity Assessments in 3 institutions
• 3 stage process: desk-top audit, workshops & interviews.
Develop a series of Case Studies to explain & describe SESR maturity in the context of each institution.
Feb – April 2013March - May 2013
Publish Institutional Maturity Reports (team institutions)
June - July 2013
Develop & publish a Sector SESR Maturity Model Report (model, case studies & tools)
August - Sept 2013
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
7
Informing Literature
SESR-MM
Student Engagement
(AUSSE)
Transition Pedagogy
FYEQ Data & Reports
Model of student
engagement
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-
2013
Capability
Maturity Models
Maturity Models
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-
2013
8
Precursors in Maslow’s (1954) Hierarchy of Needs and Nolan’ (1973, 1979) Stage Theory
Influenced by TQM and the evolutionary stages of practice adoption (Crosby, 1979)
Emergence of Capability Maturity Models Key concepts of org. Mgt derived from TQM Notions of sequential and progressive stages Ideas about capability of s/ware development orgs
CMM frameworks map an improvement path from ad-hoc immature to a mature disciplined processes
9
Features of Maturity Models
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Precursor InfluencesTheory, practice, background and history of maturity
models
Discipline theory
and practice
Content:
Categories
Processes
Practices
Dimensions of
maturityMeasures Adequacy
(scale of 4 points)
Maturity of key
practices interpreted for each dimensio
n
10
Content of models
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Category (5)
Process (n)
Practices (Nn)
11 Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
practices
Ad hoc Delivery
Planned
Defined
Managed
Optimising
Not
ad
eq
uate
Part
ially a
deq
uate
Fu
lly a
deq
uate
Larg
ely
ad
eq
uate
Content Dimensions
Adequacy
processes
categories
12
What we have found so far ?
SESR Category Example Processes Example Practices
Curricula that engage students in learning
-engaging pedagogies-authentic assessment -feedback processes
-role plays-collaborative learning
Access to support -proactive monitoring-extended service ‘hours’
-monitoring student learning engagement-academic advising
A sense of belonging
-inclusive language & practice-develop successful identity-flexible delivery
-peer programs-cultural competence-communication strategies
Transition pedagogy
-whole of course design -academic & professional
-orientation and transition as a process
Capacity, resources, infrastructure, policy
-staff development -promotion policies -physical & virtual
-technologies that support flexible learning
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Part 2: The SESR Maturity Model
Introducing the SESR Maturity Model ....
Establishing a framework for transforming student engagement, success and retention in HEIs:
An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
13
14
Practice
The delivery / provision/visibil
ity of Orientation Programs
A worked example ...
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Orientation programs
are available to
students
Access to
Support
Transition to Uni
No p
rogra
ms
are
pro
vid
ed
Lim
ited d
iscr
ete
pro
gra
ms
Inte
gra
ted s
uit
e o
f pro
gra
ms
/ a h
olis
tic
ap
pro
ach
Generi
c &
dis
cip
line
pro
gra
ms
Ad hoc Delivery
Planned
Process
Category
Defined
Managed
Maturity Assessment:Pervasiveness &
Adequacy
DimensionsContent
Optimising
15
SESR Content ... an example
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Access to Support
Extended
service hours
Virtual learnin
g adviser
s
Transition to
University
Accessible
information
On-line resourc
es
O- evaluati
on informs design
P – Suite of
ongoing activitie
s
Orientation
ProgramM –
outcomes are
monitoredD –
policies: type and quality
AH – disciplin
e program
s
Not adequate: No discipline programs available
Partially adequate: Some disciplines offer programs
Largely adequate: Most disciplines offer programs
Fully adequate: All faculties / disciplines have programs
16
Indicators of Maturity
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Content: Assessing Maturity
Categories Access to support Faculty / discipline orientation and / or transition programs are available to support students.
Processes First year experience & transition
Practices Orientation activities
Pervasiveness:
Indicator Reach
Ad hoc delivery
Faculty/discipline programs Not adequate
Partially adequate
Largely adequate
Fully adequate
Planned Part of suite of transition activities
Defined Policies define program quality & type
Managed Outcomes are monitored
Optimised Evaluation information informs design
17
Indicators of Maturity
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Practice Example:
Orientation programs are available for students
Reach
(Adequacy)N P L F
Pervasiveness
(Dimensions)
Ad Hoc DeliveryPlanningDefining
ManagingOptimising
Part 3: Applying the model
Assessing the maturity of SESR processes
Establishing a framework for transforming student engagement, success and retention in HEIs:
An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
18
19
Your turn to map a practice
Establishing a framework for transforming student engagement, success and retention in HEIs: An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
Content: Assessing Maturity
Categories Name a category Name one dimension of one practice.
Processes Name of one process in this category
Practices Name one practice
Pervasiveness:
Indicator Reach
Ad hoc delivery
Not adequate
Partially adequate
Largely adequate
Fully adequate
Planned
Defined
Managed
Optimised
Thank you for participating in this workshop
Please contact the authors or refer to the project web site for further information about this project.
Establishing a framework for transforming student engagement, success and retention in HEIs:
An Australian Government Office for Learning and Teaching funded project ID11-2056:2011-2013
http://studentengagementmaturitymodel.net/
ERGA WORKSHOPVerifying a SESR-MM: a reality
check!