Upload
others
View
4
Download
0
Embed Size (px)
Citation preview
Input, output, and outcome:two approaches to measureinternationalisationUwe Brandenburg | CHE Consult GmbHRome, September 2012
2
Core assumptions and statements
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
Internationalisation
No goal in itself but effective instrument to achieve other goals
can enhance education, research, civic engagement etc.
Measuring Internationalisation
So far too many assumptions made, to few things proved: we claim but we do not know!
Satisfaction surveys dominate next to input measurement
Outcome (impact) is not measured yet
3
Three projects…
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
Complexityof interna-
tionalisation
IMPI
IMS2020MEMO©
Input & OutputInput & OutputOutcomesOutcomes
4
Step 1: acknowledging diversity through a toolbox
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
IMPI (Indicators for mapping and profilinginternationalisation)The IMPI toolbox
No ranking tool
No ultimate set of key indicators
Tool for tailored-made profiling and self-assessment, inter-institutional comparison
Inclusion of very broad set of relevant indicators
Changes due to interactivity with user (rating relevance, no. of users)
Globally relevant as based on different global projects & used globally!
5IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
6IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
7IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
8IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
9IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
10IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
A toolbox is not building the house!
11IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
First strategic goals, embeddedness in overall strategy; then indicators
Easy indicators have little meaning
only meaningful when combined with other resources
No definitive answers with regard to “success” or “failure”
provides framework for collecting data
effective use of the toolbox requires reflection, dialogue, and analysis
12IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
• Using the number of users, rate of relevance and standard deviation• Calculated per goal dimension and aggregated over all• Example: aggregated indicators:
with: v = average rating value, n = number of users, s = standard deviationwith: v = average rating value, n = number of users, s = standard deviation
with: v = average rating value, n = number of users, s = standard deviation
13IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
03-009 Does the unit have a specific organisational structure to support internationalisation?
07-002 Does the unit monitor its international visibility?
01-027Out of all students in the unit, what proportion is in international joint/double/multiple degree programmes in a given year?
05-023Out of all degree programmes offered by the unit in a given year, what proportion are international joint/double/multiple degree programmes?
05-022In a given year, what proportion of international joint/double/multiple degree programmes does the unit offer at the Doctoral-level?
07-013Does the unit participate in national, regional or local networks supporting internationalisation?
02-041In a given year, out of all of the unit's academic staff members, what proportion is involved in international joint doctoral supervision / co-tutelle?
05-022In a given year, what proportion of international joint/double/multiple degree programmes does the unit offer at the Doctoral-level?
05-021In a given year, what proportion of international joint/double/multiple degree programmes does the unit offer at the Master's-level?
01-004 Out of all students in the unit, what proportion studies abroad in a given year?
14IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
Number of choices of indicators under the
respective goal dimensionGoal 1 „to enhance the quality of education” 1330Goal 2 „to enhance the quality of research” 1048Goal 3 „to well-prepare students for life and work in an intercultural and globalising world” 864
Goal 4 „to enhance the international reputation and visibility of the unit” 998
Goal 5 „to provide service to society and community social engagement” 130
15
Distribution of IMPI users by country of origin (Autumn 2012)
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
502 users428 non-project300+ non-EU52 countries
16
Users by types of institutions
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
0
50
100
150
200
250
300
Two-yeardegree
Bachelor Master Doctoral degree
17
Users by size of institutions
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
0
50
100
150
200
250
under 1,000 between 1,000and 5,000
between 1,000and under
5,000
between 5,000and under
10,000
more than10,000
MEMO©Monitoring Exchange Mobility OutcomesUwe Brandenburg | CHE Consult GmbHCGU Annual conference, Oulu / Finland, September 2012
19
The structure of MEMO
Measuring Exchange mobility outcome
Combined sociometric, satisfaction and psychometric tool
SociometricsDiversity of
outgoing cohort
SociometricsDiversity of
outgoing cohort
PerceptionsQuality of services,
international orientation
PerceptionsQuality of services,
international orientation
Psycho-metrics
Change of attitudes
Psycho-metrics
Change of attitudes
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
20
Do you want to know…
whom you send abroad?
what effect these stays have on the people?
where your students develop more, where less?
how you perform against your peers worldwide or in a group (anonymously of course)?
memo© has the answers …
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
21
Who participates …
30+ HEIs from around the world
15 countries
All continents: Europe, (North) America, Asia, Africa, Australia
All types: from large comprehensive over small private universities to universities of applied sciences
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012 22
What it does…
Memo©| CHE Consult | Uwe Brandenburg| September 2012IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012 23
How it functions…
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
24
What it produces…
24
Sociometricresults
Who goesabroad,
biases, over-representation
s groups
Sociometricresults
Who goesabroad,
biases, over-representation
s groups
Perceptionresults
How are theservices
provided, whatis evaluatedwell/badly?
Perceptionresults
How are theservices
provided, whatis evaluatedwell/badly?
Pre-departure
psychome-tric resultsWhat are the
attitudes?
Pre-departure
psychome-tric resultsWhat are the
attitudes?
Post-returnpsychome-tric resultsWhat are the
new attitudes?
Post-returnpsychome-tric resultsWhat are the
new attitudes?
CHANGECHANGE
What remains unchanged?
Influence
Influence
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
25
Male students show development, but they…
0
2
4
6
8
10Factor 1: Confidence
Factor 2: Tolerance ofAmbiguity
Factor 3: Self‐Efficacy
Factor 4: Sociality
Factor 5: Vigor
Factor 6: Curiosity
Factor 7: Serenity
Factor 8: Decisiveness
Factor 9: Disputability
Factor 10: Resilience
MEMO
Male students: change
Pre Post statistically significant change
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
26
Slightly differ from female students…
0
2
4
6
8
10Factor 1: Confidence
Factor 2: Tolerance ofAmbiguity
Factor 3: Self‐Efficacy
Factor 4: Sociality
Factor 5: Vigor
Factor 6: Curiosity
Factor 7: Serenity
Factor 8: Decisiveness
Factor 9: Disputability
Factor 10: Resilience
MEMO
Change for female students
Pre Post statistically significant change
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
27
You could also analysis your entire network…
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
28
The memo© conference
First time 2013
25-26 June only for MEMO© partners
27 June for public audience
The internal conference will contain
Presentation of prelimiray results of the year (academic year not finished)
Presentation of some universities on good practices
Networking with other MEMO© partners
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012
29
Where do I find more information?
www.impi-project.eu
www.memo-tool.net
IMPI and Memo©| CHE Consult | Uwe Brandenburg| October 2012