Engaging Learning Analytics in MOOCs:
the good, the bad, and the ugly
Mohammad Khalil, Behnam Taraghi and Martin EbnerEducational Technology
hello!
I amMohammad
Khalil
You can find me:
@TuMohdKhalil Mohdkhalil.wordpress.com [email protected]
PhD Candidate
Where is our research Department located...
our department
Educational TechnologyTUGraz, Austria
OER
MOOCs
Learning AnalyticsPersonalized Learning
Big Data
Adaptive Learning
Educational Data Mining
Technology Enhanced Learning
Lifelong Learning
1.MOOCsThe new generation of Distance Learning
MOOCs ?
Image from: http://cdn2.hubspot.net/hub/685689/file-3231367982-jpg/blog-files/massiveopenonline_620x400.jpg?t=1462361738877
To Summarize:You can attend courses
from prestigious universitiesfor free
2. Learning AnalyticsIt is a data analytics...but in educational systems
like...MOOCs
“Collecting traces that learners leave behind and using
those traces to improve learning.
-Erik Duval
Learning Analytics
Data Collection
Mouse Clicks
Quizzes
Activity & Engagement
Forums
Assignments
Video LEcturesLogins
Learning Analytics
Analysis & Interpretation
Lackner, E., Khalil, M., Ebner, M. “How to foster forum discussions within MOOCs: A case study”, IJARE (in review).
Khalil, M., Ebner, M. (2016). “What Massive Open Online Course (MOOC) Stakeholders Can Learn from Learning Analytics?”. Learning, Design & Technology. Springer International Publishing.
How does it look like?
Source: BME Solutions Ltd
iMooX Learning Analytics (iLAP)
Is it only great like this?
The GoodX 9
The BadX 6
The UglyX 4
Learning Analytics of MOOCs ...
The GOOD
▸Prediction (... students at risk, performance...)
▸Recommendation (... suggest course, article...)
▸Visualization (... dashboards, plots...)
▸Entertainment (... Gamification elements...)
9
The GOOD
▸Benchmarking (... evaluate courses, difficulties...)
▸Personalization (... customize courses, notes...)
▸Enhance Engagement (... interventions for subpopulations...)
▸Communicate Information (... statistical analysis to different stakeholders…)
▸Cost Saving (... allocate resources effectively...)
9
The Bad
▸Security○Students Database security configuration is overlooked.○Achieve confidentiality, integrity, and availability.
▸Privacy○MOOC datasets may hold sensitive information.○Considered as a threat and constraint.
▸Ownership○Who owns the collected data?
6
The Bad
▸Consent○Declaration on data collection○Processed data usage, sell to third parties or research?
▸Transparency○Transparent of research or data usage
▸Storage○Storing big data can be costly and complex○European Directive 95/46/EC says personal data needs to
be stored no longer than necessary.
6
The Ugly▸False Positives
○ Decisions based on small subset of data.○ Forums activity as an example!
▸Fallacy Analytics○ Analytics could fail! ○ Wrong predictions, interventions, visualizations...
▸Bias○ Bias towards certain hypothesis leads to biased LA
▸Distill meaningful data○Pay efforts for ineffective results
4
Conclusion
▸Learning Analytics imply high potential in MOOCs.
▸Code of practice is required to carry out the optimum outcomes.
Thanks!
anyquestions
?
@TuMohdKhalil Mohdkhalil.wordpress.com [email protected]
Educational Technology
Presentation available on: http://elearningblog.tugraz.at & http://mohdkhalil.wordpress.com