View
778
Download
2
Category
Tags:
Preview:
DESCRIPTION
The article reports the findings of a Group Concept Mapping study that was conducted within the framework of the Learning Analytics Summer Institute (LASI) in the Netherlands. Learning Analytics are expected to be beneficial for students and teacher empowerment, personalization, research on learning design, and feedback for performance. The study depicted some management and economics issues and identified some possible treats. No differences were found between novices and experts on how important and feasible are changes in education triggered by Learning Analytics. Paper available at: http://dl.acm.org/citation.cfm?id=2567617&CFID=427722877&CFTOKEN=73282080
Citation preview
The Impact of Learning Analytics on the Dutch Education System
Hendrik Drachsler, Slavi Stoyanov, Marcus Specht
8. April 2023
Hendrik Drachsler 2 2 / 31
Onderwerp via >Beeld >Koptekst en voettekstPagina 3
27 March 2014@HDrachsler 3 / 31
• Structured approach to objectively identify the common understanding of a group of experts about a particular issue
• Involves participants in 3 simple activities (1. brainstorming, 2. sorting and 3. rating of ideas)
• Applies a robust analysis (Multi Dimensional Scaling (MDS) and Hierarchical Clustering Analysis (HCA)).
• GCM presents the results from the analysis as conceptual maps and other graphical representations (pattern matches and go-zones)
27 March 2014@HDrachsler
What is Group Concept Mapping?
4 / 31
• innovations in way network is delivered• (investigate) corporate/structural alignment• assist in the development of non-traditional partnerships (Rehab with the
Medicine Community)• expand investigation and knowledge of PSN'S/PSO's• continue STHCS sponsored forums on public health issues (medicine
managed care forum)• inventory assets of all participating agencies (providers, Venn Diagrams)• access additional funds for telemedicine expansion • better utilization of current technological bridge• continued support by STHCS to member facilities• expand and encourage utilization of interface programs to strengthen the
viability and to improve the health care delivery system (ie teleconference)• discussion with CCHN
...organize the issues...
Work quickly and effectively
under pressure
49
Organize the work when
directions are not specific.
39
Decide how to manage
multiple tasks.20 Manage resources effectively.
4
2. Sort
12
34
5
12
34
5
3Scan a multitu
de of inform
ation
and decide what is im
portant.
12
34
5
12
34
5
12
34
5
12
34
5
12
34
5
1Manage tim
e effectively
2Manage resources effectively.
3Scan a multitu
de of
information and decide what is
important.
4Decide how to manage multip
le tasks.
5Organize the work when directions are not specific
.
1Manage tim
e effectively
Rating Sheet
3. Rate
1. Brainstorm
What is Group Concept Mapping?
27 March 2014@HDrachsler 5 / 31
Binary, square similarity
matrix
Sort for one participant
Total square similarity
matrix across participants
What is Group Concept Mapping?
27 March 2014@HDrachsler 6 / 31
Multidimensional Scaling
Output: An 2-dimensional mapping of the entities
5655
54
53
52
51
50
4948
47
46
45
44
43
42
41
40
39
38
37 36
35
34
33
32
31
3029
28
2726
25
242322
21
20 19
181716
15
14
13
12
11
10
9
8
7
6
5
4
3
1
Input: A square matrix of relationships among a set of entities
5 1 2 4 0 1 1 3 1 01 5 0 0 0 1 0 0 2 02 0 5 3 0 0 0 0 0 04 0 3 5 0 0 0 0 0 00 0 0 0 5 0 0 2 0 01 1 0 0 0 5 0 0 4 01 0 0 0 0 0 5 0 0 03 0 0 0 2 0 0 5 0 01 2 0 0 0 4 0 0 5 00 0 0 0 0 0 0 0 0 5
27 March 2014@HDrachsler 7 / 31
Hierarchical Cluster Analysis
1 + 65 + 79 + 10(1 + 6) + 83 + 42 + (9 + 10)((1 + 6) + 8)) + (3 + 4) (5 + 7) + ((2 + (9 + 10))(((1 + 6) + 8)) + (3 + 4)) + (5 + 7) + ((2 + (9 + 10))
1 6 8 3 4 7 5 9 10 2
10987654321
Nu
mb
er o
f C
lust
ers
Merge Points Merged
123456789
16
8
7
5
9
10
2
4
3
27 March 2014@HDrachsler 8 / 31
Online brainstorming
Onderwerp via >Beeld >Koptekst en voettekstPagina 9
27 March 2014@HDrachsler 9 / 31
Online sorting
27 March 2014@HDrachsler 10 / 31
Online rating
27 March 2014@HDrachsler 11 / 31
Hypothesis
H1: The most important items (clusters) will be less feasible to implement in the Dutch education system.
H2: There will be a significant difference between Novice participants compared to more Expert participants on their rating for Importance and Feasibility.
27 March 2014@HDrachsler 12 / 31
Descriptive Statistics
27 March 2014@HDrachsler 13 / 31
Descriptive Statistics
27 March 2014@HDrachsler 14 / 31
Descriptive Statistics
27 March 2014@HDrachsler 15 / 31
Descriptive Statistics
27 March 2014@HDrachsler 16 / 31
Descriptive Statistics
27 March 2014@HDrachsler 17 / 31
Point Map
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
1718
19
20
21
22
2324 25
26
27
28
29
30
31
32
33
34
3536
37
38
39
40
41
42
43
4445
46
47
48 49
5051
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
686970
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
9293
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
27 March 2014@HDrachsler 18 / 31
Cluster Map points
1
5
920 3337
42
46
47
48
5051
54
55 59
62
64
7174
84
89
97
101
106
1623 2527
3536
49
63
67
72
80
2
1018
26
29
53
6869
76 78
79
82 87
103
105 3
13
17
22 57
707594
95
100
46
19
28
38
40
4144
616573
83
91
92
102
104
7
15
2431
39
43
58
81
86
96
98
107
108
8
11
1214
21
30
32
34
45
5256
60
66 77
85
88
90
93
99
27 March 2014@HDrachsler 19 / 31
Cluster Map 7 labeled
1. Students empowerment
2. Personalisation
3. Research& Learning Design
4. Teacher empowerment
5. Feedback & Performance
6. Risks
7. Management& Economics
27 March 2014@HDrachsler 20 / 31
Cluster Rating Map Importance
1. Students empowerment
2. Personalisation
3. Research & Learning Design
4. Teacher empowerment
5. Feedback & Performance
6. Risks
7. Management & Economics
Cluster Legend Layer Value 1 2.75 to 3.00 2 3.00 to 3.25 3 3.25 to 3.50 4 3.50 to 3.75 5 3.75 to 4.00
27 March 2014@HDrachsler 21 / 31
Cluster Rating Map Feasibility
1. Students empowerment
2. Personalisation
3. Research& Learning Design
4. Teacherempowerment
5. Feedback& Performance
6. Risks
7. Management& Economics
Cluster Legend Layer Value 1 2.91 to 3.10 2 3.10 to 3.28 3 3.28 to 3.46 4 3.46 to 3.64 5 3.64 to 3.83
27 March 2014@HDrachsler 22 / 31
H1: The most important items (clusters) will be less feasible to implement in the Dutch education system.
27 March 2014@HDrachsler 23 / 31
Pattern Match Importance vs. FeasibilityImportance Feasibility
Teacher empowerment Teacher empowerment
Personalisation
Personalisation
Feedback & Performance
Feedback & Performance
Research & Learning DesignResearch & Learning Design
Students empowerment
Students empowerment
Management & Economics Management & Economics
Risks Risks2.75 2.91
4.00 3.83
r = 0.94
27 March 2014@HDrachsler 24 / 31
H2: There will be a significant difference between Novice participants compared to more Expert participants on their rating for Importance and Feasibility.
27 March 2014@HDrachsler 25 / 31
Pattern Match Novice vs. Experts on Importance
Novice Expert
Personalisation
PersonalisationTeacher empowerment
Teacher empowerment
Feedback & Performance Feedback & Performance
Students empowerment
Students empowermentResearch & Learning Design
Research & Learning Design
Management & EconomicsManagement & Economics
Risks Risks2.79 2.70
4.05 3.99
r = 0.99
27 March 2014@HDrachsler 26 / 31
Pattern Match Novice vs. Experts on FeasibilityNovice Experts
Teacher empowerment Teacher empowerment
Research & Learning DesignResearch & Learning DesignPersonalisation
PersonalisationFeedback & Performance
Feedback & Performance
Students empowerment
Students empowerment
Management & Economics Management & Economics
Risks Risks2.96 2.88
3.67 3.97
r = 0.99
27 March 2014@HDrachsler 27 / 31
Conclusions
27 March 2014@HDrachsler
We rejected H1 and H2, the GCM study shows a very high agreement between the Novice and Expert participants on how Important and Feasible are changes that LA brings to the Dutch education.
The Dutch community highly agrees on topics that are of importance to influence the educational system with LA.
Conclusions
NL is ready to roll out LA in K12 & Higher Education
28 / 31
Conclusions
27 March 2014@HDrachsler
Future Research
H3: There will be a significant difference between the stakeholder groups (Higher Education vs. K12), (Business vs. Educational Sector) Find partners that are interested to run a GCM on LA in their countries - Contact us!
29 / 31
bit.ly/LAK14
30 / 3127 March 2014@HDrachsler
31 / 3127 March 2014@HDrachsler
Recommended